-- Logs begin at Mon 2022-10-31 11:55:10 UTC, end at Mon 2022-10-31 12:47:29 UTC. -- Oct 31 12:18:55.048382 dv-cinder-796170-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 31 12:18:55.055628 dv-cinder-796170-6-smb devstack@keystone.service[81443]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 31 12:18:55.060069 dv-cinder-796170-6-smb devstack@keystone.service[81443]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 31 12:18:55 2022] *** Oct 31 12:18:55.060069 dv-cinder-796170-6-smb devstack@keystone.service[81443]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 31 12:18:55.060069 dv-cinder-796170-6-smb devstack@keystone.service[81443]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 31 12:18:55.060069 dv-cinder-796170-6-smb devstack@keystone.service[81443]: nodename: dv-cinder-796170-6-smb Oct 31 12:18:55.060069 dv-cinder-796170-6-smb devstack@keystone.service[81443]: machine: x86_64 Oct 31 12:18:55.060069 dv-cinder-796170-6-smb devstack@keystone.service[81443]: clock source: unix Oct 31 12:18:55.060069 dv-cinder-796170-6-smb devstack@keystone.service[81443]: pcre jit disabled Oct 31 12:18:55.060069 dv-cinder-796170-6-smb devstack@keystone.service[81443]: detected number of CPU cores: 4 Oct 31 12:18:55.060069 dv-cinder-796170-6-smb devstack@keystone.service[81443]: current working directory: / Oct 31 12:18:55.060069 dv-cinder-796170-6-smb devstack@keystone.service[81443]: detected binary path: /usr/bin/uwsgi-core Oct 31 12:18:55.060069 dv-cinder-796170-6-smb devstack@keystone.service[81443]: your processes number limit is 47680 Oct 31 12:18:55.060069 dv-cinder-796170-6-smb devstack@keystone.service[81443]: your memory page size is 4096 bytes Oct 31 12:18:55.060069 dv-cinder-796170-6-smb devstack@keystone.service[81443]: detected max file descriptor number: 2048 Oct 31 12:18:55.060069 dv-cinder-796170-6-smb devstack@keystone.service[81443]: lock engine: pthread robust mutexes Oct 31 12:18:55.060069 dv-cinder-796170-6-smb devstack@keystone.service[81443]: thunder lock: enabled Oct 31 12:18:55.060069 dv-cinder-796170-6-smb devstack@keystone.service[81443]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 31 12:18:55.060069 dv-cinder-796170-6-smb devstack@keystone.service[81443]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 31 12:18:55.099192 dv-cinder-796170-6-smb devstack@keystone.service[81443]: Python main interpreter initialized at 0x55da860fa9c0 Oct 31 12:18:55.099192 dv-cinder-796170-6-smb devstack@keystone.service[81443]: python threads support enabled Oct 31 12:18:55.099192 dv-cinder-796170-6-smb devstack@keystone.service[81443]: your server socket listen backlog is limited to 100 connections Oct 31 12:18:55.099192 dv-cinder-796170-6-smb devstack@keystone.service[81443]: your mercy for graceful operations on workers is 90 seconds Oct 31 12:18:55.099539 dv-cinder-796170-6-smb devstack@keystone.service[81443]: mapped 403077 bytes (393 KB) for 2 cores Oct 31 12:18:55.099643 dv-cinder-796170-6-smb devstack@keystone.service[81443]: *** Operational MODE: preforking *** Oct 31 12:18:55.099915 dv-cinder-796170-6-smb devstack@keystone.service[81443]: *** uWSGI is running in multiple interpreter mode *** Oct 31 12:18:55.099915 dv-cinder-796170-6-smb devstack@keystone.service[81443]: spawned uWSGI master process (pid: 81443) Oct 31 12:18:55.100109 dv-cinder-796170-6-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 31 12:18:55.100771 dv-cinder-796170-6-smb devstack@keystone.service[81443]: spawned uWSGI worker 1 (pid: 81457, cores: 1) Oct 31 12:18:55.101146 dv-cinder-796170-6-smb devstack@keystone.service[81443]: spawned uWSGI worker 2 (pid: 81458, cores: 1) Oct 31 12:18:55.101256 dv-cinder-796170-6-smb devstack@keystone.service[81443]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 31 12:18:59.369421 dv-cinder-796170-6-smb devstack@keystone.service[81458]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 12:18:59.369421 dv-cinder-796170-6-smb devstack@keystone.service[81458]: from cryptography.utils import int_from_bytes Oct 31 12:18:59.370230 dv-cinder-796170-6-smb devstack@keystone.service[81458]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 12:18:59.370230 dv-cinder-796170-6-smb devstack@keystone.service[81458]: from cryptography.utils import int_from_bytes Oct 31 12:18:59.372914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 12:18:59.372914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: from cryptography.utils import int_from_bytes Oct 31 12:18:59.373408 dv-cinder-796170-6-smb devstack@keystone.service[81457]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 12:18:59.373408 dv-cinder-796170-6-smb devstack@keystone.service[81457]: from cryptography.utils import int_from_bytes Oct 31 12:18:59.420033 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 12:18:59.420225 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 12:18:59.420416 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] command line args: [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 12:18:59.420680 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 12:18:59.420854 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ================================================================================ {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 12:18:59.421116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] admin_token = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.421385 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] config_dir = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.421486 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 12:18:59.421565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.421682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 12:18:59.421758 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] config_source = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.421883 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] command line args: [] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 12:18:59.421967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] debug = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.422083 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.422346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 12:18:59.422346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ================================================================================ {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 12:18:59.422461 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.422594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] admin_token = **** {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.422676 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.422811 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] config_dir = [] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.422892 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.423002 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.423079 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.423187 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] config_source = [] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.423295 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.423392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] debug = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.423486 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_config_append = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.423585 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.423719 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.423822 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_dir = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.423922 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.424017 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_file = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.424122 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.424222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.424327 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.424449 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.424529 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.424645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.424723 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] list_limit = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.424829 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] log_config_append = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.424915 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.425009 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.425085 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.425189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.425319 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] log_dir = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.425405 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] log_file = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.425475 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.425590 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.425664 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.425839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.425925 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.426086 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.426162 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.426316 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.426401 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.426498 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.426583 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.426662 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.426778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.426908 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.427022 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.427152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.427295 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.427380 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.427605 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.427780 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.427857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.427980 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] publish_errors = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.428064 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.428180 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.428294 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.428407 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.428540 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.428627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.428810 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.428884 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.429041 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.429292 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] standard_threads = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.429380 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.429497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] publish_errors = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.429573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.429735 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.429822 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.429899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.429968 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.430068 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] use_journal = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.430151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.430229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] use_json = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.430369 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.430446 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] use_stderr = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.430558 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] use_syslog = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.430634 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.430785 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.430928 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] standard_threads = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.431034 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.431110 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.431267 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.431342 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.431441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.431524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.431619 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] use_journal = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.431746 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.431823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] use_json = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.431959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] use_stderr = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.432039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.432137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] use_syslog = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.432220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.432369 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 12:18:59.432445 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.432624 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.432701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.432864 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.432947 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.433147 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.433226 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.433392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.433469 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.433624 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.433706 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.433869 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.433951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.434103 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.434179 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.434346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.434422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.434589 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.434672 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.434824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.434906 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.435077 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.435155 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.435314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.435388 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.435560 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.435634 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.435793 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.435876 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.436040 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.436126 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.436290 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.436441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.436514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.436583 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.436796 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.436877 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.437029 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.437139 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.437282 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.437369 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.437514 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.437596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.437746 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.437829 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.437998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.438074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.438244 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.438320 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.438473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.438557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.438700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.438776 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.438945 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.439027 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.439184 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.439267 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.439417 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.439498 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.439663 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.439745 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.439892 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.439983 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.440124 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.440199 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.440354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.440434 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.440580 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.440662 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.440809 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.440891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.441037 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.441169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.441289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.441376 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.441523 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.441599 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.441770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.441851 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.442000 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.442150 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.442224 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.442291 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.442449 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.442525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.442681 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.442764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.442910 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.442991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.443147 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.443224 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.443373 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.443456 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.443609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.443686 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.443843 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.443919 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.444073 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.444156 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.444305 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.444379 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.444539 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.444614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.444766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.444848 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.445006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.445087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.445259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.445336 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.445495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.445563 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.445723 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.445799 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.445963 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.446029 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.446199 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.446326 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.446416 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.446493 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.446648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.446725 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.446882 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.446967 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.447117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.447194 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.447350 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.447434 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.447611 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.447689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.447848 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.447925 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.448080 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.448162 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.448319 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.448395 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.448554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.448638 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.448814 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.448895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.449050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.449170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.449308 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.449386 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.449550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.449627 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.449785 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.449863 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.450021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.450098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.450256 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.450332 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.450491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.450570 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.450727 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.450819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.450963 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.451040 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.451196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.451274 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.451435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.451511 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.451681 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.451757 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.451919 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.451995 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.452157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.452234 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.452907 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.452992 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.453168 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.453251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.453402 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.453480 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.453638 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.453715 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.453871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.453955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.454105 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.454179 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.454314 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.454392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.454543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.454629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.454775 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.454861 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.455002 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.455080 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.455243 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.455327 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.455477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.455562 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.455719 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.455796 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.455954 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.456045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.456187 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.456280 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.456424 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.456502 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.456656 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.456734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.456893 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.external = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.456980 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.457143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.457260 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.457396 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.457477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.457640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.457727 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.457876 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.password = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.457961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.458104 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.token = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.458184 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.458348 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.458427 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.458579 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.458665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] auth.external = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.458824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.458907 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.459052 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.459130 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.459298 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.459387 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.459541 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.459620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] auth.password = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.459770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.459854 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] auth.token = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.460003 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.460089 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.460238 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.460323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.460484 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.460561 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.460717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.460802 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.460969 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.461046 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.461231 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.461309 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.461465 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.461554 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.461704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] credential.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.461781 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.461952 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.462029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.462187 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.462274 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.462436 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.462513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.462692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.462769 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.462937 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.463048 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.463174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.463313 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.463423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.463553 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.463679 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.463807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.463917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.464039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.464171 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.464273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.464454 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.464533 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.464698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.464775 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.464966 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.465043 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.465233 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.465314 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.465466 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.465543 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.465718 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] federation.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.465795 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.465951 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.466030 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.466197 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.466275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.466432 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.466509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.466665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.466743 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.466897 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.466974 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.467135 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.467211 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.467378 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.467462 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.467612 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.467690 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.467846 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.467924 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.468693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.468777 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.468879 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.468957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.469158 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.469239 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.469388 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.469468 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.469638 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.469715 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.469868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.469954 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.470096 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.470176 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.470338 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.470415 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.470566 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.470643 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.470806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.470884 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.471048 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.471125 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.471300 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.471376 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.471534 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.471613 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.471768 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.471846 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.472002 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.472080 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.472243 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.472321 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.472476 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.472554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.472711 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.472789 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.472941 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.473020 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.473195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.473277 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.473435 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.473514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.473673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.473752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.473918 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.473996 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.474146 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.474232 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.474385 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.474462 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.474619 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.474703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.474849 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.474934 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.475093 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.475172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.475334 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.475411 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.475562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.475646 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.475797 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.475874 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.476024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.476102 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.476258 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.476347 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.476492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.476570 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.476739 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.476836 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.476988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.477077 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.477246 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.477325 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.477489 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.477566 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.477722 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.477812 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.477963 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.478041 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.478204 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.478281 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.478449 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.478534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.478689 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.478767 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.478930 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.479007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.479163 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.479247 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.479398 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.479476 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.479628 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.479706 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.479863 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.479947 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.480115 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.480193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.480345 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.480421 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.480590 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.480676 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.480826 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.480903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.481068 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.481191 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.481324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.481415 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.481553 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.481661 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.481788 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.481927 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.482005 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.482164 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.482243 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.482417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.482494 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.482669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.482747 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.482921 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.483000 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.483158 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.483234 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.483393 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.483470 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.483654 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.483738 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.483883 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.483960 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.484123 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.484203 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.484353 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.484432 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.484588 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.484666 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.484821 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.484899 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.485055 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.485153 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.485322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.485401 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.485567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.485645 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.485807 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.485885 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.486057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.486135 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.486284 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.486361 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.486524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.486603 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.486759 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.486837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.486991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.487069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.487227 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.487307 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.487473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.487551 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.487710 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.487786 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.487938 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.488016 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.488172 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.488251 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.488410 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.488488 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.488647 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.488730 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.488885 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.488963 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.489150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.489231 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.489388 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.489468 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.489631 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.489708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.489860 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.489945 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.490097 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.490174 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.490330 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.490407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] resource.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.490566 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.490652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.490798 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] role.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.490876 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.491042 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] role.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.491119 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.491270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.491423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.491518 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.491597 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.491757 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.491834 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.492001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.492085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.492237 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.492314 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.492479 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.492576 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.492717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] role.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.492804 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.492958 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.493035 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] role.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.493213 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.493302 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.493443 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.493529 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.493688 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.493767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.493932 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.494009 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.494174 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.494274 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.494420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.494552 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.494666 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.494805 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.494919 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.495039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.495171 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.495286 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.495405 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.495533 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.495654 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.495778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.495903 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.496031 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.496159 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.496235 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.496387 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.496489 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.496739 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.496816 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.496974 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.497053 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.497225 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.497306 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.497461 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.497572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.497690 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.497783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.497939 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.498023 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.498190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.498269 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.498435 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.498512 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.498673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.498753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.498906 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.498984 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.499135 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.499213 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.499392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.499470 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.499626 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.499704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.499871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.499948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.500106 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.500191 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.500360 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.500437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.500598 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.500675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.500830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.500907 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.501060 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.501164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.501324 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] token.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.501402 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.501565 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.501645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.501797 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.501875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.502033 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.502111 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.502266 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.502345 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.502510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.502587 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.502749 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.502826 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.502996 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.503075 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.503232 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.503321 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.503480 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.503557 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.503718 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.503804 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.connection = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.503959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.504037 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.504193 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.504271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.504427 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.504512 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.504664 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.504743 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.504896 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.504974 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.505147 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.505241 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.505383 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.505473 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.505616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.505696 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.connection = **** {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.505857 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.505935 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.506090 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.506176 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.506330 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.506408 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.506562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.506641 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.506806 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.506892 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.507037 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.507116 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.507272 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.507349 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.507498 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.507584 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.507734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.507813 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.507967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.508045 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.508136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 12:18:59.508228 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.508434 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.508686 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.508922 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.509191 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.509427 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.509668 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.509905 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 12:18:59.510077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 12:18:59.538205 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.538435 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.538662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.539330 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.539569 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.540044 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.547217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.548394 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.576644 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.576758 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.576877 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.576962 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.629761 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.629887 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.681876 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.682150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.686500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.687438 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.837118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.837305 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.837496 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.837580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.837723 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.837896 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.837980 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.838154 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.838266 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.838372 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.838604 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.838886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.861121 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.861367 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.861459 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.861593 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.861678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.861819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.861900 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.862040 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.862121 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.862259 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.862342 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.862477 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.862559 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.862735 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.873577 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.873851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.886646 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.886856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.887057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.887149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.887279 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.887360 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.887497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.887577 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.887714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.887804 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.887931 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.888012 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.888154 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.888372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 12:18:59.905263 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.905404 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.905489 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 31 12:18:59.905628 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 31 12:18:59.905838 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.905971 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.906054 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 31 12:18:59.906174 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 31 12:18:59.906304 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.906452 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.906571 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.906717 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.906834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.907095 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.907235 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.907498 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.917015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.917237 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.917322 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.917522 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.917604 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.917798 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.917888 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.918087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.924877 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:18:59.925124 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:18:59.927833 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:18:59.928054 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:18:59.928137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.928339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.928419 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.928624 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.928714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.928907 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.928988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.929213 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.929294 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.929476 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.929568 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.929748 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.929830 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.930021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.930099 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.930301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.930406 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.930577 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.930686 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.930958 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.954367 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.954700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.955853 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:18:59.956140 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.956221 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:18:59.956450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.960853 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:18:59.961165 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.961451 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.962860 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:18:59.963146 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.963439 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.967862 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:18:59.968170 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.969966 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:18:59.970263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.973838 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:18:59.974140 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.974436 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.974516 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:18:59.974730 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.974811 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.975017 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.975099 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.975298 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.975378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.975580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.975670 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.975856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.975939 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.976127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.976407 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.991882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.992164 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.992586 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.992866 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:18:59.996018 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:18:59.996789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:18:59.999306 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.000095 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.000679 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.000980 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.004295 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:19:00.005310 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:19:00.007465 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:19:00.008458 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:19:00.010744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.011050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.011341 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.011630 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.011734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.011927 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.012039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.012220 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.012329 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.012634 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.012928 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.013246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.028594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:19:00.028883 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.029176 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.029448 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.029621 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:19:00.029908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.030175 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.030461 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.036969 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.037995 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.038551 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.039550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.040395 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.040676 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.041418 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.041700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.043459 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:19:00.043748 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.044038 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.044330 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.044410 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:19:00.044628 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.044721 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.045021 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.045335 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.045634 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.056024 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:19:00.056297 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.056585 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.056810 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:19:00.056891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.057115 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.057279 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.057505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.057598 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.057793 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.057875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.058088 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.058373 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.058651 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.073497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:19:00.074204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:19:00.076314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:19:00.077170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:19:00.079799 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.080626 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.081315 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.082121 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.082947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:19:00.083235 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.083639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.083757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:19:00.084043 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.084337 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.090115 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.090772 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.091616 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:19:00.092259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:19:00.095163 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.095567 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.095861 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.095942 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.096146 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.096241 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.096434 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.096712 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.104057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:19:00.104354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.104590 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:19:00.104673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.104888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.105204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.111607 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:19:00.111894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.112181 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.112463 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.112742 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.113021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.113118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 12:19:00.113342 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.113425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.113624 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.113707 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.113897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.113986 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.114168 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.114260 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.114442 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.114530 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.114715 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.114796 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.114994 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.115074 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.115273 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.115356 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.115605 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.115883 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.116157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.116435 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.116710 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 12:19:00.149848 dv-cinder-796170-6-smb devstack@keystone.service[81457]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55da860fa9c0 pid: 81457 (default app) Oct 31 12:19:00.150290 dv-cinder-796170-6-smb devstack@keystone.service[81458]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55da860fa9c0 pid: 81458 (default app) Oct 31 12:19:00.153066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0fa00-68aa-4b44-b897-ba88fc7e5673 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:00.153379 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0fa00-68aa-4b44-b897-ba88fc7e5673 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:00.153656 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0fa00-68aa-4b44-b897-ba88fc7e5673 None None] PATH_INFO: `/v3` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:00.158461 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Mon Oct 31 12:19:00 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:06.861683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98f21f-7681-4c66-9f23-1b189418e085 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:06.862202 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98f21f-7681-4c66-9f23-1b189418e085 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:06.862309 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98f21f-7681-4c66-9f23-1b189418e085 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:06.866486 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:19:06.871499 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1622b-d7d5-4f6f-adc5-1f50157e33ad None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:06.872064 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1622b-d7d5-4f6f-adc5-1f50157e33ad None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:06.872064 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1622b-d7d5-4f6f-adc5-1f50157e33ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:06.942948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: INFO dbcounter [None req-1ea1622b-d7d5-4f6f-adc5-1f50157e33ad None None] Registered counter for database keystone Oct 31 12:19:06.961493 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG oslo_db.sqlalchemy.engines [None req-1ea1622b-d7d5-4f6f-adc5-1f50157e33ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 12:19:06.967561 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writer thread running {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 12:19:07.143308 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG passlib.handlers.bcrypt [None req-1ea1622b-d7d5-4f6f-adc5-1f50157e33ad None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81457) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 31 12:19:07.143624 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG passlib.handlers.bcrypt [None req-1ea1622b-d7d5-4f6f-adc5-1f50157e33ad None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81457) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 31 12:19:07.201346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-1ea1622b-d7d5-4f6f-adc5-1f50157e33ad None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:07.202937 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1ea1622b-d7d5-4f6f-adc5-1f50157e33ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:07.328024 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 12:19:07.764658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98f21f-7681-4c66-9f23-1b189418e085 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:07.833896 dv-cinder-796170-6-smb devstack@keystone.service[81458]: INFO dbcounter [None req-2c98f21f-7681-4c66-9f23-1b189418e085 None None] Registered counter for database keystone Oct 31 12:19:07.854762 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG oslo_db.sqlalchemy.engines [None req-2c98f21f-7681-4c66-9f23-1b189418e085 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 12:19:07.860845 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writer thread running {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 12:19:07.978228 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98f21f-7681-4c66-9f23-1b189418e085 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:07.982522 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce56888-6861-4c63-a78f-31812abe5483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:07.983171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce56888-6861-4c63-a78f-31812abe5483 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:07.983453 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce56888-6861-4c63-a78f-31812abe5483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:07.983727 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce56888-6861-4c63-a78f-31812abe5483 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:07.991815 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce56888-6861-4c63-a78f-31812abe5483 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:08.043842 dv-cinder-796170-6-smb devstack@keystone.service[81458]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4ce56888-6861-4c63-a78f-31812abe5483 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 31 12:19:08.044231 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce56888-6861-4c63-a78f-31812abe5483 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:08.053496 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Oct 31 12:19:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 12:19:08.059384 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1622b-d7d5-4f6f-adc5-1f50157e33ad None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:08.077437 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1622b-d7d5-4f6f-adc5-1f50157e33ad None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:08.081876 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcfa2e-b277-48af-8417-1a7498c2ad5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:08.082984 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcfa2e-b277-48af-8417-1a7498c2ad5f admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:08.083269 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcfa2e-b277-48af-8417-1a7498c2ad5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:08.083541 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcfa2e-b277-48af-8417-1a7498c2ad5f admin admin] PATH_INFO: `/v3/projects/771b2157d2a94a5f8b2df37d397dbb5d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:08.085184 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcfa2e-b277-48af-8417-1a7498c2ad5f admin admin] RBAC: Authorizing `identity:get_project(project_id=771b2157d2a94a5f8b2df37d397dbb5d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:08.136775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: WARNING keystone.common.rbac_enforcer.enforcer [None req-12fcfa2e-b277-48af-8417-1a7498c2ad5f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 31 12:19:08.137152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcfa2e-b277-48af-8417-1a7498c2ad5f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:08.142272 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Oct 31 12:19:08 2022] GET /identity/v3/projects/771b2157d2a94a5f8b2df37d397dbb5d => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:10.246100 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f38a15-4488-4fa4-8368-b3d4f385a900 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:10.246650 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f38a15-4488-4fa4-8368-b3d4f385a900 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:10.246650 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f38a15-4488-4fa4-8368-b3d4f385a900 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:10.250774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:19:10.256225 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d3870-be34-4fb0-98b8-4750c795c8f0 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:10.256654 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d3870-be34-4fb0-98b8-4750c795c8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:10.256776 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d3870-be34-4fb0-98b8-4750c795c8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:10.276525 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-663d3870-be34-4fb0-98b8-4750c795c8f0 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:10.278061 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-663d3870-be34-4fb0-98b8-4750c795c8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:10.286269 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 12:19:10.554034 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f38a15-4488-4fa4-8368-b3d4f385a900 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:10.566524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f38a15-4488-4fa4-8368-b3d4f385a900 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:10.570737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e251df-c5a4-4494-a80a-009f596b22a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:10.571330 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e251df-c5a4-4494-a80a-009f596b22a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:10.571612 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e251df-c5a4-4494-a80a-009f596b22a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:10.571887 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e251df-c5a4-4494-a80a-009f596b22a5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:10.579382 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e251df-c5a4-4494-a80a-009f596b22a5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:10.581159 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e251df-c5a4-4494-a80a-009f596b22a5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:10.589731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Oct 31 12:19:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 12:19:10.594933 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d3870-be34-4fb0-98b8-4750c795c8f0 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:10.603850 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d3870-be34-4fb0-98b8-4750c795c8f0 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:10.608595 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d303f4d-b644-49cd-b735-a70b89ef48b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:10.609244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d303f4d-b644-49cd-b735-a70b89ef48b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:10.609526 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d303f4d-b644-49cd-b735-a70b89ef48b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:10.609799 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d303f4d-b644-49cd-b735-a70b89ef48b1 admin admin] PATH_INFO: `/v3/users/c1e64987ec354c7fb596a7e6d0af67ef` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:10.611097 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d303f4d-b644-49cd-b735-a70b89ef48b1 admin admin] RBAC: Authorizing `identity:get_user(user_id=c1e64987ec354c7fb596a7e6d0af67ef)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:10.612915 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d303f4d-b644-49cd-b735-a70b89ef48b1 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:10.614453 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Oct 31 12:19:10 2022] GET /identity/v3/users/c1e64987ec354c7fb596a7e6d0af67ef => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:12.773794 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e742935-c8cb-4e64-b4ca-c9995e6322f2 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:12.774321 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e742935-c8cb-4e64-b4ca-c9995e6322f2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:12.774321 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e742935-c8cb-4e64-b4ca-c9995e6322f2 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:12.775639 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:12.781372 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db69dc-7d5f-4635-81cc-b2d74d87b5fe None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:12.781763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db69dc-7d5f-4635-81cc-b2d74d87b5fe None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:12.781931 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db69dc-7d5f-4635-81cc-b2d74d87b5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:12.799851 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-c7db69dc-7d5f-4635-81cc-b2d74d87b5fe None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:12.801031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c7db69dc-7d5f-4635-81cc-b2d74d87b5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:12.847455 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073759d1-3ec6-4c58-a82b-fe4d50b6ab23 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:12.847763 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073759d1-3ec6-4c58-a82b-fe4d50b6ab23 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:12.848037 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073759d1-3ec6-4c58-a82b-fe4d50b6ab23 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:12.849385 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:19:12.854511 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f36be5-add7-4f3c-8460-3d26a4e2a51e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:12.854793 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f36be5-add7-4f3c-8460-3d26a4e2a51e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:12.855066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f36be5-add7-4f3c-8460-3d26a4e2a51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:12.883979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:12.896839 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG passlib.handlers.bcrypt [None req-06f36be5-add7-4f3c-8460-3d26a4e2a51e None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81458) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 31 12:19:12.897338 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG passlib.handlers.bcrypt [None req-06f36be5-add7-4f3c-8460-3d26a4e2a51e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81458) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 31 12:19:12.946626 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-06f36be5-add7-4f3c-8460-3d26a4e2a51e None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:12.948175 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-06f36be5-add7-4f3c-8460-3d26a4e2a51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:13.044476 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:13.153271 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db69dc-7d5f-4635-81cc-b2d74d87b5fe None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:13.176952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:13.257131 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db69dc-7d5f-4635-81cc-b2d74d87b5fe None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:13.290113 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c70a7c-e76a-432d-8873-9154b751b99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:13.290753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c70a7c-e76a-432d-8873-9154b751b99c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:13.291039 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c70a7c-e76a-432d-8873-9154b751b99c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:13.291319 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c70a7c-e76a-432d-8873-9154b751b99c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:13.302223 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c70a7c-e76a-432d-8873-9154b751b99c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:13.308345 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f36be5-add7-4f3c-8460-3d26a4e2a51e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:13.311572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-03c70a7c-e76a-432d-8873-9154b751b99c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:19:13.311572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:13.311572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:13.311572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:13.311572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:13.311572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:13.311572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:13.311572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:13.311572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:13.311572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:13.311572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:13.311572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:13.311572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:13.311572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:13.311572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:13.311572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:13.312466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:13.312466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:13.312466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:13.312466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:13.312466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:13.312466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:13.312466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:13.312466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:13.312466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:13.312466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:13.312466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:13.312466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:13.312466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:13.312466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:13.312466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:13.312466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:13.313594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:13.313594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:13.313594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:13.313594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:13.313594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:13.313594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:13.313594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:13.313594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:13.313594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:13.313594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:13.313594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:19:13.313594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:19:13.313594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 31 12:19:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:19:13.318223 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c70a7c-e76a-432d-8873-9154b751b99c None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:13.397813 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:13.408845 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f36be5-add7-4f3c-8460-3d26a4e2a51e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:13.412130 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:13.417099 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c70a7c-e76a-432d-8873-9154b751b99c None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:13.447161 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880eca79-2eca-49fd-a6b5-5489cf20d798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:13.448027 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880eca79-2eca-49fd-a6b5-5489cf20d798 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:13.448313 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880eca79-2eca-49fd-a6b5-5489cf20d798 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:13.448579 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880eca79-2eca-49fd-a6b5-5489cf20d798 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:13.449578 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880eca79-2eca-49fd-a6b5-5489cf20d798 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:13.450624 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9402391f-b4e6-4704-b676-1b3767df2d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:13.451602 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880eca79-2eca-49fd-a6b5-5489cf20d798 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:13.451767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402391f-b4e6-4704-b676-1b3767df2d49 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:13.452050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402391f-b4e6-4704-b676-1b3767df2d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:13.452325 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402391f-b4e6-4704-b676-1b3767df2d49 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:13.453027 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9402391f-b4e6-4704-b676-1b3767df2d49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:13.453358 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9402391f-b4e6-4704-b676-1b3767df2d49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:13.454736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9402391f-b4e6-4704-b676-1b3767df2d49 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:13.462610 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.sql.core [None req-880eca79-2eca-49fd-a6b5-5489cf20d798 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 12:19:13.462610 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 12:19:13.462610 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [parameters: {'id': '5274102b82d74006a4369a8708a41756', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 12:19:13.462610 dv-cinder-796170-6-smb devstack@keystone.service[81458]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81458) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 12:19:13.466802 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:19:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:19:13.472148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9402391f-b4e6-4704-b676-1b3767df2d49 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:13.480895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-880eca79-2eca-49fd-a6b5-5489cf20d798 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 31 12:19:13.480895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:13.480895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 12:19:13.480895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 12:19:13.480895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 12:19:13.480895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 12:19:13.480895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 12:19:13.480895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 12:19:13.480895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 12:19:13.480895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application conn.query(q) Oct 31 12:19:13.480895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 12:19:13.480895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 12:19:13.480895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 12:19:13.480895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result.read() Oct 31 12:19:13.481774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 12:19:13.481774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 12:19:13.481774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 12:19:13.481774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 12:19:13.481774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 12:19:13.481774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 12:19:13.481774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 12:19:13.481774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 12:19:13.481774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 12:19:13.481774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:19:13.481774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 12:19:13.481774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:19:13.481774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:13.481774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 12:19:13.481774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 12:19:13.481774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 31 12:19:13.481774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 31 12:19:13.481774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 12:19:13.483505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application next(self.gen) Oct 31 12:19:13.483505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 12:19:13.483505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application yield resource Oct 31 12:19:13.483505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 12:19:13.483505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application next(self.gen) Oct 31 12:19:13.483505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 12:19:13.483505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 12:19:13.483505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 12:19:13.483505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 12:19:13.483505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 12:19:13.483505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise self.value Oct 31 12:19:13.483505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 12:19:13.483505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 12:19:13.483505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 12:19:13.483505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application session.commit() Oct 31 12:19:13.483505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 12:19:13.483505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 12:19:13.484614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 12:19:13.484614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 12:19:13.484614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 12:19:13.484614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.session.flush() Oct 31 12:19:13.484614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 12:19:13.484614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 12:19:13.484614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 12:19:13.484614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 12:19:13.484614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 12:19:13.484614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application compat.raise_( Oct 31 12:19:13.484614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 12:19:13.484614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception Oct 31 12:19:13.484614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 12:19:13.484614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 12:19:13.484614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 12:19:13.484614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 12:19:13.484614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 12:19:13.485733 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 12:19:13.485733 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 12:19:13.485733 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 12:19:13.485733 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 12:19:13.485733 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 12:19:13.485733 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 12:19:13.485733 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 12:19:13.485733 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 12:19:13.485733 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 12:19:13.485733 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 12:19:13.485733 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 12:19:13.485733 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 12:19:13.485733 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 12:19:13.485733 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 12:19:13.485733 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 12:19:13.486675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 12:19:13.486675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception Oct 31 12:19:13.486675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 12:19:13.486675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 12:19:13.486675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 12:19:13.486675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 12:19:13.486675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 12:19:13.486675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 12:19:13.486675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 12:19:13.486675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application conn.query(q) Oct 31 12:19:13.486675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 12:19:13.486675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 12:19:13.486675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 12:19:13.486675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result.read() Oct 31 12:19:13.486675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 12:19:13.486675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 12:19:13.486675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 12:19:13.488289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 12:19:13.488289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 12:19:13.488289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 12:19:13.488289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 12:19:13.488289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 12:19:13.488289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 12:19:13.488289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 12:19:13.488289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [parameters: {'id': '5274102b82d74006a4369a8708a41756', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 12:19:13.488289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 12:19:13.488289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:19:13.488289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:19:13.488289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:19:13.488289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:13.488289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 31 12:19:13.488289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 31 12:19:13.489700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 12:19:13.489700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 12:19:13.489700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 31 12:19:13.489700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:19:13.489700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:19:13.489700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:19:13.489700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:13.489700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:13.489700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:13.489700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:13.489700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:13.489700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:13.489700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:13.489700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:13.489700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:13.489700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:13.489700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:13.490805 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 31 12:19:13.490805 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 31 12:19:13.490805 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:13.490805 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:13.490805 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 31 12:19:13.490805 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 31 12:19:13.490805 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:13.490805 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:13.490805 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 31 12:19:13.490805 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 31 12:19:13.490805 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 31 12:19:13.490805 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:19:13.490805 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 8/16] 10.222.0.18 () {60 vars in 1137 bytes} [Mon Oct 31 12:19:13 2022] POST /identity/v3/domains => generated 190 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:19:13.490805 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880eca79-2eca-49fd-a6b5-5489cf20d798 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:13.576973 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9402391f-b4e6-4704-b676-1b3767df2d49 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:13.586156 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880eca79-2eca-49fd-a6b5-5489cf20d798 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:13.609486 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911eb78-41ef-4a8d-a3da-f0599bfea1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:13.610113 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911eb78-41ef-4a8d-a3da-f0599bfea1c5 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:13.610389 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911eb78-41ef-4a8d-a3da-f0599bfea1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:13.610650 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911eb78-41ef-4a8d-a3da-f0599bfea1c5 None admin] PATH_INFO: `/v3/users/c1e64987ec354c7fb596a7e6d0af67ef` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:13.611768 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911eb78-41ef-4a8d-a3da-f0599bfea1c5 None admin] RBAC: Authorizing `identity:get_user(user_id=c1e64987ec354c7fb596a7e6d0af67ef)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:13.613237 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911eb78-41ef-4a8d-a3da-f0599bfea1c5 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:13.614785 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:13 2022] GET /identity/v3/users/c1e64987ec354c7fb596a7e6d0af67ef => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:19:13.619134 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d7b13-4e14-4338-b0fb-6f8c45c8bd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:13.619995 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d7b13-4e14-4338-b0fb-6f8c45c8bd08 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:13.620277 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d7b13-4e14-4338-b0fb-6f8c45c8bd08 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:13.620416 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911eb78-41ef-4a8d-a3da-f0599bfea1c5 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:13.620555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d7b13-4e14-4338-b0fb-6f8c45c8bd08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:13.635395 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:13.639415 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d7b13-4e14-4338-b0fb-6f8c45c8bd08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:13.640880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d7b13-4e14-4338-b0fb-6f8c45c8bd08 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:13.656333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-cc5d7b13-4e14-4338-b0fb-6f8c45c8bd08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:19:13.656333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:13.656333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:13.656333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:13.656333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:13.656333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:13.656333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:13.656333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:13.656333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:13.656333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:13.656333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:13.656333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:13.656333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:19:13.656333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:19:13.656333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:19:13.656333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:19:13.657339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:13.657339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:13.657339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:13.657339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:13.657339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:13.657339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:13.657339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:13.657339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:13.657339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:13.657339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:13.657339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:13.657339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:13.657339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:13.657339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:13.657339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:13.657339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:13.657339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:19:13.658141 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:19:13.658141 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:19:13.658141 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:19:13.658141 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:19:13.664478 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d7b13-4e14-4338-b0fb-6f8c45c8bd08 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:13.689469 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:13.719297 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911eb78-41ef-4a8d-a3da-f0599bfea1c5 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:13.754572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe2dca-48eb-48cb-ae53-5d0c139449b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:13.755196 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe2dca-48eb-48cb-ae53-5d0c139449b1 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:13.755474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe2dca-48eb-48cb-ae53-5d0c139449b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:13.755742 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe2dca-48eb-48cb-ae53-5d0c139449b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:13.756845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe2dca-48eb-48cb-ae53-5d0c139449b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:13.758330 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe2dca-48eb-48cb-ae53-5d0c139449b1 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:13.760062 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:19:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:19:13.765460 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe2dca-48eb-48cb-ae53-5d0c139449b1 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:13.768544 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d7b13-4e14-4338-b0fb-6f8c45c8bd08 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:13.801072 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb1989-d8b8-4dba-a078-647fa5ce58bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:13.801716 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb1989-d8b8-4dba-a078-647fa5ce58bb None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:13.801986 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb1989-d8b8-4dba-a078-647fa5ce58bb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:13.802259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb1989-d8b8-4dba-a078-647fa5ce58bb None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:13.802903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb1989-d8b8-4dba-a078-647fa5ce58bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:13.803208 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb1989-d8b8-4dba-a078-647fa5ce58bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:13.804566 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb1989-d8b8-4dba-a078-647fa5ce58bb None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:13.821812 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 10/20] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:19:13.846334 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:13.867155 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe2dca-48eb-48cb-ae53-5d0c139449b1 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:13.902413 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679d60e-a039-4c6d-9199-980f03e3be65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:13.903090 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679d60e-a039-4c6d-9199-980f03e3be65 None admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:13.903371 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679d60e-a039-4c6d-9199-980f03e3be65 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:13.903646 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679d60e-a039-4c6d-9199-980f03e3be65 None admin] PATH_INFO: `/v3/domains/default/users/c1e64987ec354c7fb596a7e6d0af67ef/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:13.906178 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679d60e-a039-4c6d-9199-980f03e3be65 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c1e64987ec354c7fb596a7e6d0af67ef, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:13.907630 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679d60e-a039-4c6d-9199-980f03e3be65 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:14.021273 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 11/21] 10.222.0.18 () {58 vars in 1361 bytes} [Mon Oct 31 12:19:13 2022] PUT /identity/v3/domains/default/users/c1e64987ec354c7fb596a7e6d0af67ef/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:19:16.380532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1958bca-c933-4ce8-ba91-0c84e7e20374 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:16.381038 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1958bca-c933-4ce8-ba91-0c84e7e20374 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:16.381155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1958bca-c933-4ce8-ba91-0c84e7e20374 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:16.382946 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 11/22] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:16.388640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db014f-2533-4aab-a327-5961ad4c5af0 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:16.389062 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db014f-2533-4aab-a327-5961ad4c5af0 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:16.389271 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db014f-2533-4aab-a327-5961ad4c5af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:16.418294 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-09db014f-2533-4aab-a327-5961ad4c5af0 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:16.420687 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-09db014f-2533-4aab-a327-5961ad4c5af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:16.511340 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 12/23] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:16.766619 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e8455-0903-47f0-a063-294e58874a8f None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:16.766946 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e8455-0903-47f0-a063-294e58874a8f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:16.767115 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e8455-0903-47f0-a063-294e58874a8f None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:16.768649 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:16.774135 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b7942-9d60-4681-92a7-839aaf245118 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:16.774447 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b7942-9d60-4681-92a7-839aaf245118 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:16.774696 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b7942-9d60-4681-92a7-839aaf245118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:16.802175 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ff8b7942-9d60-4681-92a7-839aaf245118 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:16.803399 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ff8b7942-9d60-4681-92a7-839aaf245118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:16.889589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:16.894515 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 13/25] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:16.976694 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02237702-6201-4d90-8171-ae0d001bac8a None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:16.977343 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02237702-6201-4d90-8171-ae0d001bac8a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:16.977839 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02237702-6201-4d90-8171-ae0d001bac8a None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:16.979642 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 13/26] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:16.984550 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b72ed8-909f-4c7f-8a39-b1d082a44fe9 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:16.984847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b72ed8-909f-4c7f-8a39-b1d082a44fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:16.985150 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b72ed8-909f-4c7f-8a39-b1d082a44fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:17.010148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-35b72ed8-909f-4c7f-8a39-b1d082a44fe9 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:17.011352 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-35b72ed8-909f-4c7f-8a39-b1d082a44fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:17.078652 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02237702-6201-4d90-8171-ae0d001bac8a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:17.097939 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 14/27] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:17.101146 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65882daa-e9eb-49aa-9fac-462ca1576c29 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:17.101146 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65882daa-e9eb-49aa-9fac-462ca1576c29 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:17.101146 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65882daa-e9eb-49aa-9fac-462ca1576c29 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:17.104141 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 15/28] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:17.109444 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27e6c8-5b80-4a25-bc9e-ae38bc11c2cc None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:17.109928 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27e6c8-5b80-4a25-bc9e-ae38bc11c2cc None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:17.110406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27e6c8-5b80-4a25-bc9e-ae38bc11c2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:17.137917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-2d27e6c8-5b80-4a25-bc9e-ae38bc11c2cc None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:17.140575 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2d27e6c8-5b80-4a25-bc9e-ae38bc11c2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:17.232297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:17.269193 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 16/29] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 12:19:17.271200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27e6c8-5b80-4a25-bc9e-ae38bc11c2cc None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:17.276421 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02237702-6201-4d90-8171-ae0d001bac8a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:17.353509 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec8605-ddc9-494c-8635-c591e2f99c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:17.354477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec8605-ddc9-494c-8635-c591e2f99c9e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:17.354961 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec8605-ddc9-494c-8635-c591e2f99c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:17.355433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec8605-ddc9-494c-8635-c591e2f99c9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:17.378493 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec8605-ddc9-494c-8635-c591e2f99c9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:17.388598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-2bec8605-ddc9-494c-8635-c591e2f99c9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:19:17.388598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:17.388598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:17.388598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:17.388598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:17.388598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:17.388598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:17.388598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:17.388598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:17.388598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:17.388598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:17.388598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:17.388598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:17.388598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:17.388598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:17.388598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:17.389949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:17.389949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:17.389949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:17.389949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:17.389949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:17.389949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:17.389949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:17.389949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:17.389949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:17.389949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:17.389949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:17.389949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:17.389949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:17.389949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:17.389949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:17.389949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:17.390734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:17.390734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:17.390734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:17.390734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:17.390734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:17.390734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:17.390734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:17.390734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:17.390734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:17.390734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:17.390734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:19:17.390734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:19:17.393761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 14/30] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 31 12:19:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:19:17.399877 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec8605-ddc9-494c-8635-c591e2f99c9e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:17.406198 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:17.474424 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27e6c8-5b80-4a25-bc9e-ae38bc11c2cc None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:17.538895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016a367-aaaa-4e9f-a11f-ca1403546aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:17.539663 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016a367-aaaa-4e9f-a11f-ca1403546aed None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:17.540133 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016a367-aaaa-4e9f-a11f-ca1403546aed None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:17.541370 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016a367-aaaa-4e9f-a11f-ca1403546aed None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:17.542868 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016a367-aaaa-4e9f-a11f-ca1403546aed None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:17.545908 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016a367-aaaa-4e9f-a11f-ca1403546aed None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:17.577487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 17/31] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Oct 31 12:19:17 2022] POST /identity/v3/roles => generated 219 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:19:17.578688 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016a367-aaaa-4e9f-a11f-ca1403546aed None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:17.582597 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec8605-ddc9-494c-8635-c591e2f99c9e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:17.658520 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecf5bd-7a9c-47e9-b024-19b6430923dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:17.659070 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecf5bd-7a9c-47e9-b024-19b6430923dd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:17.659353 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecf5bd-7a9c-47e9-b024-19b6430923dd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:17.659629 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecf5bd-7a9c-47e9-b024-19b6430923dd None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:17.662235 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecf5bd-7a9c-47e9-b024-19b6430923dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:17.662548 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecf5bd-7a9c-47e9-b024-19b6430923dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:17.666492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecf5bd-7a9c-47e9-b024-19b6430923dd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:17.694204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 15/32] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:19:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:17.697508 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecf5bd-7a9c-47e9-b024-19b6430923dd None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:17.704058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:17.799115 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016a367-aaaa-4e9f-a11f-ca1403546aed None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:17.827307 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:17.844722 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5715797-b2e9-46fe-9b52-7690db82ac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:17.845729 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5715797-b2e9-46fe-9b52-7690db82ac23 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:17.846211 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5715797-b2e9-46fe-9b52-7690db82ac23 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:17.846715 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5715797-b2e9-46fe-9b52-7690db82ac23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:17.860304 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5715797-b2e9-46fe-9b52-7690db82ac23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:17.860586 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecf5bd-7a9c-47e9-b024-19b6430923dd None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:17.862283 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5715797-b2e9-46fe-9b52-7690db82ac23 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:17.880059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-d5715797-b2e9-46fe-9b52-7690db82ac23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:19:17.880059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:17.880059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:17.880059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:17.880059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:17.880059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:17.880059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:17.880059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:17.880059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:17.880059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:17.880059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:17.880059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:17.880059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:19:17.880059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:19:17.880059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:19:17.880059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:19:17.880979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:17.880979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:17.880979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:17.880979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:17.880979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:17.880979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:17.880979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:17.880979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:17.880979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:17.880979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:17.880979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:17.880979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:17.880979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:17.880979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:17.880979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:17.880979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:17.880979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:19:17.881839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:19:17.881839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:19:17.881839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:19:17.881839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 18/33] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:19:17.881839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5715797-b2e9-46fe-9b52-7690db82ac23 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:17.909470 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c489cd-fbd9-4503-a473-804699177c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:17.910022 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c489cd-fbd9-4503-a473-804699177c2c None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:17.910309 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c489cd-fbd9-4503-a473-804699177c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:17.910589 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c489cd-fbd9-4503-a473-804699177c2c None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:17.911273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c489cd-fbd9-4503-a473-804699177c2c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:17.912780 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c489cd-fbd9-4503-a473-804699177c2c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:17.988539 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5715797-b2e9-46fe-9b52-7690db82ac23 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:18.021314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5941bb-515b-40b8-86ee-404565d1505f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:18.021946 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5941bb-515b-40b8-86ee-404565d1505f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:18.022238 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5941bb-515b-40b8-86ee-404565d1505f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:18.022515 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5941bb-515b-40b8-86ee-404565d1505f None admin] PATH_INFO: `/v3/users/c1e64987ec354c7fb596a7e6d0af67ef` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:18.023654 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5941bb-515b-40b8-86ee-404565d1505f None admin] RBAC: Authorizing `identity:get_user(user_id=c1e64987ec354c7fb596a7e6d0af67ef)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:18.025128 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5941bb-515b-40b8-86ee-404565d1505f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:18.031827 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 19/34] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:17 2022] GET /identity/v3/users/c1e64987ec354c7fb596a7e6d0af67ef => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:18.031827 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3c2ba-739b-41f7-8421-7702a7d224ef None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:18.031827 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3c2ba-739b-41f7-8421-7702a7d224ef None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:18.031827 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3c2ba-739b-41f7-8421-7702a7d224ef None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:18.031827 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 20/35] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:18.034888 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3c2ba-739b-41f7-8421-7702a7d224ef None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:18.043319 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 16/36] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Oct 31 12:19:17 2022] POST /identity/v3/roles => generated 225 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:19:18.044403 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c489cd-fbd9-4503-a473-804699177c2c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:18.106830 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:18.129928 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:18.174269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c489cd-fbd9-4503-a473-804699177c2c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:18.186623 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3c2ba-739b-41f7-8421-7702a7d224ef None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:18.212414 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e9f1b-19a8-4b40-8d7a-12e600e13df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:18.213061 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e9f1b-19a8-4b40-8d7a-12e600e13df9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:18.213470 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e9f1b-19a8-4b40-8d7a-12e600e13df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:18.213657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e9f1b-19a8-4b40-8d7a-12e600e13df9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:18.214916 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e9f1b-19a8-4b40-8d7a-12e600e13df9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:18.217178 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e9f1b-19a8-4b40-8d7a-12e600e13df9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:18.219040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 17/37] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:19:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:18.220045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299076eb-811e-4e21-a704-d6b283c87c6e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:18.220328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299076eb-811e-4e21-a704-d6b283c87c6e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:18.220604 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299076eb-811e-4e21-a704-d6b283c87c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:18.232549 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be7667-14a7-4637-bb3a-7e45abbe1143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:18.233439 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be7667-14a7-4637-bb3a-7e45abbe1143 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:18.233878 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be7667-14a7-4637-bb3a-7e45abbe1143 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:18.234155 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be7667-14a7-4637-bb3a-7e45abbe1143 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:18.234866 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be7667-14a7-4637-bb3a-7e45abbe1143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:18.235180 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be7667-14a7-4637-bb3a-7e45abbe1143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:18.236561 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be7667-14a7-4637-bb3a-7e45abbe1143 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:18.239161 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-299076eb-811e-4e21-a704-d6b283c87c6e None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:18.240724 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-299076eb-811e-4e21-a704-d6b283c87c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:18.256173 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 21/38] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:18.257514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e690e8-2f48-407b-96c9-175de71d316a None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:18.257863 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e690e8-2f48-407b-96c9-175de71d316a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:18.258077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e690e8-2f48-407b-96c9-175de71d316a None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:18.259307 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 22/39] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:18.260009 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e690e8-2f48-407b-96c9-175de71d316a None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:18.320106 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 18/40] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:18.320968 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299076eb-811e-4e21-a704-d6b283c87c6e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:18.390810 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:18.435626 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299076eb-811e-4e21-a704-d6b283c87c6e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:18.471194 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92d10f-c516-418b-99f1-2b9ca3c681e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:18.471808 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92d10f-c516-418b-99f1-2b9ca3c681e3 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:18.472091 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92d10f-c516-418b-99f1-2b9ca3c681e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:18.472364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92d10f-c516-418b-99f1-2b9ca3c681e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:18.473009 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92d10f-c516-418b-99f1-2b9ca3c681e3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:18.474468 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92d10f-c516-418b-99f1-2b9ca3c681e3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:18.476512 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:18.481375 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e690e8-2f48-407b-96c9-175de71d316a None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:18.505230 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 19/41] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 31 12:19:18 2022] POST /identity/v3/projects => generated 301 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:19:18.505230 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aaa505-b78a-4a1c-a975-4e62e102acf1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:18.505230 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aaa505-b78a-4a1c-a975-4e62e102acf1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:18.505230 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aaa505-b78a-4a1c-a975-4e62e102acf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:18.524978 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c0aaa505-b78a-4a1c-a975-4e62e102acf1 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:18.526281 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c0aaa505-b78a-4a1c-a975-4e62e102acf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:18.531173 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eef151-0f26-4b41-a38f-2de89e339dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:18.532080 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eef151-0f26-4b41-a38f-2de89e339dde None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:18.532544 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eef151-0f26-4b41-a38f-2de89e339dde None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:18.533019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eef151-0f26-4b41-a38f-2de89e339dde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:18.534036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eef151-0f26-4b41-a38f-2de89e339dde None admin] RBAC: Adding query filter params (role.id=e1b3a811029244d2a7e2664cd3246eec, scope.domain.id=default, user.id=c1e64987ec354c7fb596a7e6d0af67ef) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:18.534533 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eef151-0f26-4b41-a38f-2de89e339dde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:18.536392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eef151-0f26-4b41-a38f-2de89e339dde None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:18.545821 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 23/42] 10.222.0.18 () {56 vars in 1322 bytes} [Mon Oct 31 12:19:18 2022] GET /identity/v3/role_assignments?user.id=c1e64987ec354c7fb596a7e6d0af67ef&scope.domain.id=default&role.id=e1b3a811029244d2a7e2664cd3246eec => generated 530 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:18.592429 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eef151-0f26-4b41-a38f-2de89e339dde None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:18.624074 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 20/43] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:18.722139 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eef151-0f26-4b41-a38f-2de89e339dde None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:18.760595 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a9cae-4013-4889-8763-3b8b8b337432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:18.761245 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a9cae-4013-4889-8763-3b8b8b337432 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:18.761587 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a9cae-4013-4889-8763-3b8b8b337432 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:18.761810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a9cae-4013-4889-8763-3b8b8b337432 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:18.762490 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a9cae-4013-4889-8763-3b8b8b337432 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:18.763905 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a9cae-4013-4889-8763-3b8b8b337432 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:18.782596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 24/44] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Oct 31 12:19:18 2022] POST /identity/v3/roles => generated 223 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:19:18.915242 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aaa505-b78a-4a1c-a975-4e62e102acf1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:18.959336 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:19.016828 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aaa505-b78a-4a1c-a975-4e62e102acf1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:19.049465 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a4fa8-a5fa-4171-a062-aee7db038e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:19.050096 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a4fa8-a5fa-4171-a062-aee7db038e7f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:19.050382 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a4fa8-a5fa-4171-a062-aee7db038e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:19.050659 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a4fa8-a5fa-4171-a062-aee7db038e7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:19.051758 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a4fa8-a5fa-4171-a062-aee7db038e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:19.053240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a4fa8-a5fa-4171-a062-aee7db038e7f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:19.054793 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 21/45] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:19:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:19.060991 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a9cae-4013-4889-8763-3b8b8b337432 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:19.086373 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:19.159477 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a9cae-4013-4889-8763-3b8b8b337432 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:19.192124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf816c40-a5e4-4f36-b1bf-2fd02af0b473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:19.192738 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf816c40-a5e4-4f36-b1bf-2fd02af0b473 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:19.193023 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf816c40-a5e4-4f36-b1bf-2fd02af0b473 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:19.193339 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf816c40-a5e4-4f36-b1bf-2fd02af0b473 None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:19.193988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf816c40-a5e4-4f36-b1bf-2fd02af0b473 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:19.195412 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf816c40-a5e4-4f36-b1bf-2fd02af0b473 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:19.222614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 25/46] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 31 12:19:19 2022] POST /identity/v3/projects => generated 312 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:19:21.332591 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b70822-a987-45ce-92b3-30c20fe590ff None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:21.333078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b70822-a987-45ce-92b3-30c20fe590ff None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:21.333078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b70822-a987-45ce-92b3-30c20fe590ff None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:21.334438 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 22/47] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:21.339543 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7bccc-5b5d-471d-8009-9c74bf9f60b0 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:21.339933 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7bccc-5b5d-471d-8009-9c74bf9f60b0 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:21.340104 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7bccc-5b5d-471d-8009-9c74bf9f60b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:21.359300 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3fe7bccc-5b5d-471d-8009-9c74bf9f60b0 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:21.360489 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3fe7bccc-5b5d-471d-8009-9c74bf9f60b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:21.425047 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 26/48] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:21.690802 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b70822-a987-45ce-92b3-30c20fe590ff None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:21.788181 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b70822-a987-45ce-92b3-30c20fe590ff None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:21.798796 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:21.820622 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0530ed-55b6-48f2-ae09-c20bc786e163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:21.821266 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0530ed-55b6-48f2-ae09-c20bc786e163 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:21.821547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0530ed-55b6-48f2-ae09-c20bc786e163 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:21.821819 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0530ed-55b6-48f2-ae09-c20bc786e163 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:21.822908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0530ed-55b6-48f2-ae09-c20bc786e163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:21.824340 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0530ed-55b6-48f2-ae09-c20bc786e163 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:21.826418 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 23/49] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:19:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:21.831832 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7bccc-5b5d-471d-8009-9c74bf9f60b0 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:21.839827 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:21.929726 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7bccc-5b5d-471d-8009-9c74bf9f60b0 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:21.962068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafc4cd-1243-4644-8b94-0f9df89faad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:21.962614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafc4cd-1243-4644-8b94-0f9df89faad7 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:21.962900 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafc4cd-1243-4644-8b94-0f9df89faad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:21.963180 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafc4cd-1243-4644-8b94-0f9df89faad7 None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:21.963837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bafc4cd-1243-4644-8b94-0f9df89faad7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:21.965310 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bafc4cd-1243-4644-8b94-0f9df89faad7 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:21.990637 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 27/50] 10.222.0.18 () {60 vars in 1140 bytes} [Mon Oct 31 12:19:21 2022] POST /identity/v3/projects => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:19:24.147518 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3ad19-269e-4473-bcb0-af4b65ef60bf None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:24.147961 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3ad19-269e-4473-bcb0-af4b65ef60bf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:24.148068 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3ad19-269e-4473-bcb0-af4b65ef60bf None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:24.149447 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 24/51] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:24.154564 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237083e-b7f6-4f76-84d9-e71bd9f321cc None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:24.154959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237083e-b7f6-4f76-84d9-e71bd9f321cc None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:24.155119 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237083e-b7f6-4f76-84d9-e71bd9f321cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:24.173358 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-8237083e-b7f6-4f76-84d9-e71bd9f321cc None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:24.174541 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8237083e-b7f6-4f76-84d9-e71bd9f321cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:24.224533 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:24.238585 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 28/52] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:24.507182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3ad19-269e-4473-bcb0-af4b65ef60bf None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:24.603054 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3ad19-269e-4473-bcb0-af4b65ef60bf None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:24.634801 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15fe39-2119-4737-a97f-30149a0f16b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:24.635409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15fe39-2119-4737-a97f-30149a0f16b1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:24.635690 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15fe39-2119-4737-a97f-30149a0f16b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:24.635962 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15fe39-2119-4737-a97f-30149a0f16b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:24.637064 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15fe39-2119-4737-a97f-30149a0f16b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:24.638549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15fe39-2119-4737-a97f-30149a0f16b1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:24.640054 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 25/53] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:19:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:24.645284 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237083e-b7f6-4f76-84d9-e71bd9f321cc None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:24.740473 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237083e-b7f6-4f76-84d9-e71bd9f321cc None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:24.772874 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d36a9a-a42c-432b-8b2d-eb17af13dd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:24.773441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d36a9a-a42c-432b-8b2d-eb17af13dd00 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:24.773722 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d36a9a-a42c-432b-8b2d-eb17af13dd00 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:24.773996 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d36a9a-a42c-432b-8b2d-eb17af13dd00 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:24.774635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d36a9a-a42c-432b-8b2d-eb17af13dd00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:24.776054 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d36a9a-a42c-432b-8b2d-eb17af13dd00 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:24.801987 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 29/54] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 31 12:19:24 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:19:27.940664 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37ab26-6017-4c99-bde4-6668100e1993 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:27.941743 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37ab26-6017-4c99-bde4-6668100e1993 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:27.942281 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37ab26-6017-4c99-bde4-6668100e1993 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:27.943833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 26/55] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:27.949463 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85118f-41a7-49d8-a385-4c3c301e22c8 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:27.950307 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85118f-41a7-49d8-a385-4c3c301e22c8 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:27.950787 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85118f-41a7-49d8-a385-4c3c301e22c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:27.969773 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-eb85118f-41a7-49d8-a385-4c3c301e22c8 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:27.971271 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-eb85118f-41a7-49d8-a385-4c3c301e22c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:28.023630 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:28.075826 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 30/56] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:28.249858 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d588c-70b2-4f33-98f4-95b82ca8982b None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:28.250516 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d588c-70b2-4f33-98f4-95b82ca8982b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:28.251016 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d588c-70b2-4f33-98f4-95b82ca8982b None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:28.252626 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 27/57] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:28.257989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3efbe3-f301-43f6-8845-391b9dd0e95a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:28.258531 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3efbe3-f301-43f6-8845-391b9dd0e95a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:28.259033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3efbe3-f301-43f6-8845-391b9dd0e95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:28.286117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-be3efbe3-f301-43f6-8845-391b9dd0e95a None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:28.287643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-be3efbe3-f301-43f6-8845-391b9dd0e95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:28.319713 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25964528-ab10-4e79-9ced-ae6abaeb7dff None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:28.320225 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25964528-ab10-4e79-9ced-ae6abaeb7dff None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:28.320755 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25964528-ab10-4e79-9ced-ae6abaeb7dff None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:28.323469 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 28/58] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:28.329057 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ac8b7-9fca-4938-93d3-8b6e6ed80233 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:28.329594 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ac8b7-9fca-4938-93d3-8b6e6ed80233 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:28.330285 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ac8b7-9fca-4938-93d3-8b6e6ed80233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:28.358377 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ad1ac8b7-9fca-4938-93d3-8b6e6ed80233 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:28.359359 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ad1ac8b7-9fca-4938-93d3-8b6e6ed80233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:28.384757 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 31/59] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:28.392149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3efbe3-f301-43f6-8845-391b9dd0e95a None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:28.442371 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:28.494880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 29/60] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 12:19:28.502203 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3efbe3-f301-43f6-8845-391b9dd0e95a None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:28.517822 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:28.543942 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bbf6c-b2c8-4eb3-a432-07bc245b9169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:28.544926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bbf6c-b2c8-4eb3-a432-07bc245b9169 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:28.545475 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bbf6c-b2c8-4eb3-a432-07bc245b9169 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:28.545975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bbf6c-b2c8-4eb3-a432-07bc245b9169 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:28.556852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bbf6c-b2c8-4eb3-a432-07bc245b9169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:28.562071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-336bbf6c-b2c8-4eb3-a432-07bc245b9169 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:19:28.562071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:28.562071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:28.562071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:28.562071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:28.562071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:28.562071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:28.562071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:28.562071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:28.562071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:28.562071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:28.562071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:28.562071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:28.562071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:28.562071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:28.562071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:28.562909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:28.562909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:28.562909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:28.562909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:28.562909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:28.562909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:28.562909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:28.562909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:28.562909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:28.562909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:28.562909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:28.562909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:28.562909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:28.562909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:28.562909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:28.562909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:28.563648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:28.563648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:28.563648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:28.563648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:28.563648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:28.563648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:28.563648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:28.563648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:28.563648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:28.563648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:28.563648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:19:28.563648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:19:28.565947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 32/61] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:19:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:19:28.572009 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ac8b7-9fca-4938-93d3-8b6e6ed80233 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:28.621317 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79786635-3668-4348-a30d-c0cb5141a645 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:28.621959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79786635-3668-4348-a30d-c0cb5141a645 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:28.622435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79786635-3668-4348-a30d-c0cb5141a645 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:28.623998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 33/62] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:19:28.628867 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c2ca1-9cc0-463c-8074-99a104d320bd None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:28.629389 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c2ca1-9cc0-463c-8074-99a104d320bd None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:28.629862 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c2ca1-9cc0-463c-8074-99a104d320bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:28.658369 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-bc9c2ca1-9cc0-463c-8074-99a104d320bd None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:28.663299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-bc9c2ca1-9cc0-463c-8074-99a104d320bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:28.722853 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ac8b7-9fca-4938-93d3-8b6e6ed80233 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:28.759959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 34/63] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 12:19:28.761185 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c2ca1-9cc0-463c-8074-99a104d320bd None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:28.767386 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b47d9-0a62-46a9-99d2-13d5428abfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:28.768272 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b47d9-0a62-46a9-99d2-13d5428abfb2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:28.768763 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b47d9-0a62-46a9-99d2-13d5428abfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:28.769273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b47d9-0a62-46a9-99d2-13d5428abfb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:28.770142 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b47d9-0a62-46a9-99d2-13d5428abfb2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:28.770641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b47d9-0a62-46a9-99d2-13d5428abfb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:28.772251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b47d9-0a62-46a9-99d2-13d5428abfb2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:28.782153 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 30/64] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 31 12:19:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:28.797893 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b47d9-0a62-46a9-99d2-13d5428abfb2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:28.907356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:28.917203 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c2ca1-9cc0-463c-8074-99a104d320bd None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:28.954574 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32717620-5533-451a-a44c-a90a4e9676b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:28.956003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32717620-5533-451a-a44c-a90a4e9676b0 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:28.956484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32717620-5533-451a-a44c-a90a4e9676b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:28.956954 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32717620-5533-451a-a44c-a90a4e9676b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:28.958258 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:28.969147 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32717620-5533-451a-a44c-a90a4e9676b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:28.974050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-32717620-5533-451a-a44c-a90a4e9676b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:19:28.974050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:28.974050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:28.974050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:28.974050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:28.974050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:28.974050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:28.974050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:28.974050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:28.974050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:28.974050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:28.974050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:28.974050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:28.974050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:28.974050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:28.974050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:28.974957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:28.974957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:28.974957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:28.974957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:28.974957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:28.974957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:28.974957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:28.974957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:28.974957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:28.974957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:28.974957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:28.974957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:28.974957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:28.974957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:28.974957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:28.974957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:28.975711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:28.975711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:28.975711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:28.975711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:28.975711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:28.975711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:28.975711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:28.975711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:28.975711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:28.975711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:28.975711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:19:28.975711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:19:28.975711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 35/65] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 31 12:19:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:19:28.976326 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32717620-5533-451a-a44c-a90a4e9676b0 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:29.026632 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b47d9-0a62-46a9-99d2-13d5428abfb2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:29.063056 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0da70-bd17-4d74-8232-0155606f8385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:29.063056 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0da70-bd17-4d74-8232-0155606f8385 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:29.063056 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0da70-bd17-4d74-8232-0155606f8385 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:29.063056 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0da70-bd17-4d74-8232-0155606f8385 None admin] PATH_INFO: `/v3/users/1ac8a34c1c5541d29cb91cfa44b9e4eb` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:29.078999 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0da70-bd17-4d74-8232-0155606f8385 None admin] RBAC: Authorizing `identity:get_user(user_id=1ac8a34c1c5541d29cb91cfa44b9e4eb)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:29.080476 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0da70-bd17-4d74-8232-0155606f8385 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:29.082166 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 31/66] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:28 2022] GET /identity/v3/users/1ac8a34c1c5541d29cb91cfa44b9e4eb => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:19:29.082890 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32717620-5533-451a-a44c-a90a4e9676b0 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:29.083411 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2af6e-5c85-4245-823c-93abda10874e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:29.083706 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2af6e-5c85-4245-823c-93abda10874e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:29.083985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2af6e-5c85-4245-823c-93abda10874e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:29.089167 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 32/67] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:29.089167 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2af6e-5c85-4245-823c-93abda10874e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:29.120312 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f4929-6b64-41dc-9c62-e7d2d88cfc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:29.121024 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f4929-6b64-41dc-9c62-e7d2d88cfc72 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:29.121852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f4929-6b64-41dc-9c62-e7d2d88cfc72 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:29.122129 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f4929-6b64-41dc-9c62-e7d2d88cfc72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:29.132422 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f4929-6b64-41dc-9c62-e7d2d88cfc72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:29.138265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-e27f4929-6b64-41dc-9c62-e7d2d88cfc72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 12:19:29.138265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:29.138265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:29.138265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:29.138265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:29.138265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:29.138265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:29.138265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:29.138265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:29.138265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:29.138265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:29.138265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:29.138265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:29.138265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:29.138265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:29.138265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:29.139069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:29.139069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:29.139069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:29.139069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:29.139069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:29.139069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:29.139069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:29.139069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:29.139069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:29.139069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:29.139069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:29.139069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:29.139069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:29.139069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:29.139069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:29.139069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:29.139836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:29.139836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:29.139836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:29.139836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:29.139836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:29.139836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:29.139836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:29.139836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:29.139836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:29.139836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:29.139836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 12:19:29.139836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:19:29.139836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 36/68] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 31 12:19:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:19:29.140501 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f4929-6b64-41dc-9c62-e7d2d88cfc72 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:29.155824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:29.186543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:29.194598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2af6e-5c85-4245-823c-93abda10874e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:29.227313 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6852c35-fb33-48a3-b293-fa8cc880e93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:29.227914 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6852c35-fb33-48a3-b293-fa8cc880e93b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:29.228196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6852c35-fb33-48a3-b293-fa8cc880e93b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:29.228471 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6852c35-fb33-48a3-b293-fa8cc880e93b None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:29.229159 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6852c35-fb33-48a3-b293-fa8cc880e93b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:29.229463 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6852c35-fb33-48a3-b293-fa8cc880e93b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:29.231337 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6852c35-fb33-48a3-b293-fa8cc880e93b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:29.238869 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f4929-6b64-41dc-9c62-e7d2d88cfc72 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:29.239034 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 33/69] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:19:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:29.239802 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6852c35-fb33-48a3-b293-fa8cc880e93b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:29.272206 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4779b44-775a-4244-a011-eb892c87dba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:29.272833 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4779b44-775a-4244-a011-eb892c87dba3 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:29.273138 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4779b44-775a-4244-a011-eb892c87dba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:29.273425 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4779b44-775a-4244-a011-eb892c87dba3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:29.283387 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4779b44-775a-4244-a011-eb892c87dba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:29.288784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-a4779b44-775a-4244-a011-eb892c87dba3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:19:29.288784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:29.288784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:29.288784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:29.288784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:29.288784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:29.288784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:29.288784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:29.288784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:29.288784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:29.288784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:29.288784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:29.288784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:29.288784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:29.288784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:29.288784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:29.289803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:29.289803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:29.289803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:29.289803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:29.289803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:29.289803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:29.289803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:29.289803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:29.289803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:29.289803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:29.289803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:29.289803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:29.289803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:29.289803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:29.289803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:29.289803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:29.290824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:29.290824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:29.290824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:29.290824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:29.290824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:29.290824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:29.290824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:29.290824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:29.290824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:29.290824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:29.290824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:19:29.290824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:19:29.290824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 37/70] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:19:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:19:29.291828 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3ef2f-9806-478e-91ea-ad2534c346b0 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:29.291970 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3ef2f-9806-478e-91ea-ad2534c346b0 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:29.292378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3ef2f-9806-478e-91ea-ad2534c346b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:29.310974 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-4ed3ef2f-9806-478e-91ea-ad2534c346b0 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:29.312149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4ed3ef2f-9806-478e-91ea-ad2534c346b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:29.341641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6852c35-fb33-48a3-b293-fa8cc880e93b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:29.375378 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8408ae-f500-4487-a68d-16752af73fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:29.376011 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8408ae-f500-4487-a68d-16752af73fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:29.376326 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8408ae-f500-4487-a68d-16752af73fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:29.376605 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8408ae-f500-4487-a68d-16752af73fa1 None admin] PATH_INFO: `/v3/projects/a526fed604bd4419b5680a31eb366b07` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:29.376977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 38/71] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:29.377726 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3ef2f-9806-478e-91ea-ad2534c346b0 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:29.380619 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:29.385425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8408ae-f500-4487-a68d-16752af73fa1 None admin] RBAC: Authorizing `identity:get_project(project_id=a526fed604bd4419b5680a31eb366b07)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:29.386937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8408ae-f500-4487-a68d-16752af73fa1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:29.388775 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 34/72] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:19:29 2022] GET /identity/v3/projects/a526fed604bd4419b5680a31eb366b07 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:29.390616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8408ae-f500-4487-a68d-16752af73fa1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:29.421613 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:29.485391 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3ef2f-9806-478e-91ea-ad2534c346b0 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:29.499693 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8408ae-f500-4487-a68d-16752af73fa1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:29.527896 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f56233-e2e4-49f9-9337-dfbb2a948acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:29.528509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f56233-e2e4-49f9-9337-dfbb2a948acc None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:29.528789 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f56233-e2e4-49f9-9337-dfbb2a948acc None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:29.529065 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f56233-e2e4-49f9-9337-dfbb2a948acc None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:29.529774 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f56233-e2e4-49f9-9337-dfbb2a948acc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:29.530079 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f56233-e2e4-49f9-9337-dfbb2a948acc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:29.531453 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f56233-e2e4-49f9-9337-dfbb2a948acc None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:29.534741 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b87289-bce4-444b-a38d-87edde645e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:29.535326 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b87289-bce4-444b-a38d-87edde645e25 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:29.535612 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b87289-bce4-444b-a38d-87edde645e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:29.535893 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b87289-bce4-444b-a38d-87edde645e25 None admin] PATH_INFO: `/v3/users/c1e64987ec354c7fb596a7e6d0af67ef` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:29.537483 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b87289-bce4-444b-a38d-87edde645e25 None admin] RBAC: Authorizing `identity:get_user(user_id=c1e64987ec354c7fb596a7e6d0af67ef)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:29.539188 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b87289-bce4-444b-a38d-87edde645e25 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:29.545075 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 39/73] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:19:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:29.545075 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f56233-e2e4-49f9-9337-dfbb2a948acc None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:29.545274 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 35/74] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:29 2022] GET /identity/v3/users/c1e64987ec354c7fb596a7e6d0af67ef => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:29.545274 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b87289-bce4-444b-a38d-87edde645e25 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:29.616415 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:29.648535 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:29.652427 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f56233-e2e4-49f9-9337-dfbb2a948acc None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:29.656962 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b87289-bce4-444b-a38d-87edde645e25 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:29.686488 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94f654-3af8-498a-9360-fb353ab90607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:29.687130 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94f654-3af8-498a-9360-fb353ab90607 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:29.687415 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94f654-3af8-498a-9360-fb353ab90607 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:29.687690 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94f654-3af8-498a-9360-fb353ab90607 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:29.688355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94f654-3af8-498a-9360-fb353ab90607 None admin] RBAC: Adding query filter params (name=member) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:29.688658 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94f654-3af8-498a-9360-fb353ab90607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:29.690061 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94f654-3af8-498a-9360-fb353ab90607 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:29.690152 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bcad5-d793-4674-a084-84b352f98d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:29.690720 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bcad5-d793-4674-a084-84b352f98d93 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:29.691006 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bcad5-d793-4674-a084-84b352f98d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:29.691288 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bcad5-d793-4674-a084-84b352f98d93 None admin] PATH_INFO: `/v3/projects/a526fed604bd4419b5680a31eb366b07/users/1ac8a34c1c5541d29cb91cfa44b9e4eb/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:29.693227 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bcad5-d793-4674-a084-84b352f98d93 None admin] RBAC: Authorizing `identity:create_grant(project_id=a526fed604bd4419b5680a31eb366b07, user_id=1ac8a34c1c5541d29cb91cfa44b9e4eb, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:29.694651 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bcad5-d793-4674-a084-84b352f98d93 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:29.697979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 40/75] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 31 12:19:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:29.698758 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94f654-3af8-498a-9360-fb353ab90607 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:29.709547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 36/76] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:19:29 2022] PUT /identity/v3/projects/a526fed604bd4419b5680a31eb366b07/users/1ac8a34c1c5541d29cb91cfa44b9e4eb/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:19:29.710193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bcad5-d793-4674-a084-84b352f98d93 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:29.822453 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94f654-3af8-498a-9360-fb353ab90607 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:29.827687 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bcad5-d793-4674-a084-84b352f98d93 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:29.852543 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:29.861681 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1120e-9f65-42df-939d-93bf42dc9d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:29.862360 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1120e-9f65-42df-939d-93bf42dc9d44 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:29.862644 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1120e-9f65-42df-939d-93bf42dc9d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:29.862918 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1120e-9f65-42df-939d-93bf42dc9d44 None admin] PATH_INFO: `/v3/users/1ac8a34c1c5541d29cb91cfa44b9e4eb` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:29.864094 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1120e-9f65-42df-939d-93bf42dc9d44 None admin] RBAC: Authorizing `identity:get_user(user_id=1ac8a34c1c5541d29cb91cfa44b9e4eb)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:29.865609 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1120e-9f65-42df-939d-93bf42dc9d44 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:29.867451 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 41/77] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:29 2022] GET /identity/v3/users/1ac8a34c1c5541d29cb91cfa44b9e4eb => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:29.867560 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7d216-a5d8-4133-955e-2fd747dbc16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:29.868030 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1120e-9f65-42df-939d-93bf42dc9d44 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:29.872810 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7d216-a5d8-4133-955e-2fd747dbc16f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:29.874032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7d216-a5d8-4133-955e-2fd747dbc16f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:29.874322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7d216-a5d8-4133-955e-2fd747dbc16f None admin] PATH_INFO: `/v3/projects/a526fed604bd4419b5680a31eb366b07` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:29.875606 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7d216-a5d8-4133-955e-2fd747dbc16f None admin] RBAC: Authorizing `identity:get_project(project_id=a526fed604bd4419b5680a31eb366b07)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:29.877063 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7d216-a5d8-4133-955e-2fd747dbc16f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:29.879025 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 37/78] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:19:29 2022] GET /identity/v3/projects/a526fed604bd4419b5680a31eb366b07 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:29.880290 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7d216-a5d8-4133-955e-2fd747dbc16f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:29.906581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:29.980734 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1120e-9f65-42df-939d-93bf42dc9d44 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:29.989398 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7d216-a5d8-4133-955e-2fd747dbc16f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:30.016146 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d087cd-2552-4a78-b06b-c7bd778b1a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:30.016835 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d087cd-2552-4a78-b06b-c7bd778b1a3a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:30.017053 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d087cd-2552-4a78-b06b-c7bd778b1a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:30.017355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d087cd-2552-4a78-b06b-c7bd778b1a3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:30.018456 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d087cd-2552-4a78-b06b-c7bd778b1a3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:30.019900 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d087cd-2552-4a78-b06b-c7bd778b1a3a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:30.025141 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 42/79] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:19:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:30.025141 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d087cd-2552-4a78-b06b-c7bd778b1a3a None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:30.028146 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45b938-4e27-469f-805a-410e72c0e4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:30.028786 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45b938-4e27-469f-805a-410e72c0e4f7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:30.029067 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45b938-4e27-469f-805a-410e72c0e4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:30.029369 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45b938-4e27-469f-805a-410e72c0e4f7 None admin] PATH_INFO: `/v3/users/1ac8a34c1c5541d29cb91cfa44b9e4eb` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:30.030520 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45b938-4e27-469f-805a-410e72c0e4f7 None admin] RBAC: Authorizing `identity:get_user(user_id=1ac8a34c1c5541d29cb91cfa44b9e4eb)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:30.031932 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45b938-4e27-469f-805a-410e72c0e4f7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:30.033656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 38/80] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:29 2022] GET /identity/v3/users/1ac8a34c1c5541d29cb91cfa44b9e4eb => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:30.038012 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45b938-4e27-469f-805a-410e72c0e4f7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:30.093363 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:30.131302 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d087cd-2552-4a78-b06b-c7bd778b1a3a None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:30.144037 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:30.155792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45b938-4e27-469f-805a-410e72c0e4f7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:30.168092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a94ba-7694-4958-9c2e-2d153269277a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:30.168714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a94ba-7694-4958-9c2e-2d153269277a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:30.169000 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a94ba-7694-4958-9c2e-2d153269277a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:30.169307 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a94ba-7694-4958-9c2e-2d153269277a None admin] PATH_INFO: `/v3/projects/a526fed604bd4419b5680a31eb366b07` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:30.170451 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a94ba-7694-4958-9c2e-2d153269277a None admin] RBAC: Authorizing `identity:get_project(project_id=a526fed604bd4419b5680a31eb366b07)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:30.171912 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a94ba-7694-4958-9c2e-2d153269277a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:30.173745 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 43/81] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:19:30 2022] GET /identity/v3/projects/a526fed604bd4419b5680a31eb366b07 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:30.174414 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a94ba-7694-4958-9c2e-2d153269277a None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:30.195345 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11411886-bee6-428b-8dbe-143e205ce7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:30.196014 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11411886-bee6-428b-8dbe-143e205ce7a2 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:30.196302 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11411886-bee6-428b-8dbe-143e205ce7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:30.196701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11411886-bee6-428b-8dbe-143e205ce7a2 None admin] PATH_INFO: `/v3/projects/a526fed604bd4419b5680a31eb366b07/users/c1e64987ec354c7fb596a7e6d0af67ef/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:30.198696 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11411886-bee6-428b-8dbe-143e205ce7a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a526fed604bd4419b5680a31eb366b07, user_id=c1e64987ec354c7fb596a7e6d0af67ef, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:30.200915 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11411886-bee6-428b-8dbe-143e205ce7a2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:30.216455 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 39/82] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:19:30 2022] PUT /identity/v3/projects/a526fed604bd4419b5680a31eb366b07/users/c1e64987ec354c7fb596a7e6d0af67ef/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:19:30.217046 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11411886-bee6-428b-8dbe-143e205ce7a2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:30.312377 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a94ba-7694-4958-9c2e-2d153269277a None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:30.340519 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11411886-bee6-428b-8dbe-143e205ce7a2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:30.356756 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:30.364528 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e703581-9e6e-4757-a919-1f5dad8f62c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:30.365569 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e703581-9e6e-4757-a919-1f5dad8f62c4 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:30.366633 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e703581-9e6e-4757-a919-1f5dad8f62c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:30.367120 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e703581-9e6e-4757-a919-1f5dad8f62c4 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:30.368318 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e703581-9e6e-4757-a919-1f5dad8f62c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:30.370684 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e703581-9e6e-4757-a919-1f5dad8f62c4 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:30.382401 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77abe9-4e7d-4979-ba70-cc2408881dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:30.383156 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77abe9-4e7d-4979-ba70-cc2408881dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:30.383514 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77abe9-4e7d-4979-ba70-cc2408881dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:30.384347 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77abe9-4e7d-4979-ba70-cc2408881dd6 None admin] PATH_INFO: `/v3/projects/49154018a6d1441086480dd3bba98995` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:30.385584 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77abe9-4e7d-4979-ba70-cc2408881dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=49154018a6d1441086480dd3bba98995)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:30.387792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77abe9-4e7d-4979-ba70-cc2408881dd6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:30.389848 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 40/83] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:19:30 2022] GET /identity/v3/projects/49154018a6d1441086480dd3bba98995 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:30.390627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77abe9-4e7d-4979-ba70-cc2408881dd6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:30.404086 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 44/84] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 31 12:19:30 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:19:30.405422 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e703581-9e6e-4757-a919-1f5dad8f62c4 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:30.421976 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:30.542953 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77abe9-4e7d-4979-ba70-cc2408881dd6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:30.589397 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e703581-9e6e-4757-a919-1f5dad8f62c4 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:30.623537 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d693f-7394-456b-9dbc-c2e5eb9dc7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:30.624588 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d693f-7394-456b-9dbc-c2e5eb9dc7aa None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:30.625096 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d693f-7394-456b-9dbc-c2e5eb9dc7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:30.625601 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d693f-7394-456b-9dbc-c2e5eb9dc7aa None admin] PATH_INFO: `/v3/projects/a526fed604bd4419b5680a31eb366b07/users/1ac8a34c1c5541d29cb91cfa44b9e4eb/roles/209186498dcb49a693401b009f73812e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:30.630038 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d693f-7394-456b-9dbc-c2e5eb9dc7aa None admin] RBAC: Authorizing `identity:create_grant(project_id=a526fed604bd4419b5680a31eb366b07, user_id=1ac8a34c1c5541d29cb91cfa44b9e4eb, role_id=209186498dcb49a693401b009f73812e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:30.631571 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d693f-7394-456b-9dbc-c2e5eb9dc7aa None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:30.650869 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d975db-d641-4fc2-a363-bef2a81dd41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:30.651969 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d975db-d641-4fc2-a363-bef2a81dd41d None admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:30.652960 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d975db-d641-4fc2-a363-bef2a81dd41d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:30.653459 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d975db-d641-4fc2-a363-bef2a81dd41d None admin] PATH_INFO: `/v3/projects/49154018a6d1441086480dd3bba98995/users/1ac8a34c1c5541d29cb91cfa44b9e4eb/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:30.654151 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 41/85] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:19:30 2022] PUT /identity/v3/projects/a526fed604bd4419b5680a31eb366b07/users/1ac8a34c1c5541d29cb91cfa44b9e4eb/roles/209186498dcb49a693401b009f73812e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:19:30.656131 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d975db-d641-4fc2-a363-bef2a81dd41d None admin] RBAC: Authorizing `identity:create_grant(project_id=49154018a6d1441086480dd3bba98995, user_id=1ac8a34c1c5541d29cb91cfa44b9e4eb, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:30.657964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d975db-d641-4fc2-a363-bef2a81dd41d None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:30.688001 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 45/86] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:19:30 2022] PUT /identity/v3/projects/49154018a6d1441086480dd3bba98995/users/1ac8a34c1c5541d29cb91cfa44b9e4eb/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:19:32.115154 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6f712-d7fb-4ba1-92c0-5bda7a58ba36 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:32.116117 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6f712-d7fb-4ba1-92c0-5bda7a58ba36 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:32.116591 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6f712-d7fb-4ba1-92c0-5bda7a58ba36 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:32.118295 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 42/87] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:32.124045 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23804d-246d-435b-a4cd-3156ac00d606 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:32.124963 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23804d-246d-435b-a4cd-3156ac00d606 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:32.125480 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23804d-246d-435b-a4cd-3156ac00d606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:32.147990 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-fa23804d-246d-435b-a4cd-3156ac00d606 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:32.149541 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-fa23804d-246d-435b-a4cd-3156ac00d606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:32.205962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:32.234415 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 46/88] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:32.760241 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6f712-d7fb-4ba1-92c0-5bda7a58ba36 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:32.860561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:32.886342 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6f712-d7fb-4ba1-92c0-5bda7a58ba36 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:32.929263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83128c45-638d-4a18-99d1-46a91d414939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:32.930263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83128c45-638d-4a18-99d1-46a91d414939 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:32.930813 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83128c45-638d-4a18-99d1-46a91d414939 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:32.931278 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83128c45-638d-4a18-99d1-46a91d414939 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:32.942671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83128c45-638d-4a18-99d1-46a91d414939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:32.948190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-83128c45-638d-4a18-99d1-46a91d414939 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:19:32.948190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:32.948190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:32.948190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:32.948190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:32.948190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:32.948190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:32.948190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:32.948190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:32.948190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:32.948190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:32.948190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:32.948190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:32.948190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:32.948190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:32.948190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:32.949026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:32.949026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:32.949026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:32.949026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:32.949026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:32.949026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:32.949026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:32.949026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:32.949026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:32.949026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:32.949026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:32.949026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:32.949026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:32.949026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:32.949026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:32.949026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:32.950426 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:32.950426 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:32.950426 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:32.950426 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:32.950426 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:32.950426 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:32.950426 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:32.950426 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:32.950426 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:32.950426 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:32.950426 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:19:32.950426 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:19:32.952964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1657e-d4d7-4c59-b66f-accc03b86688 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:32.953495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1657e-d4d7-4c59-b66f-accc03b86688 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:32.953963 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1657e-d4d7-4c59-b66f-accc03b86688 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:32.955521 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 47/89] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:32.956881 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 43/90] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:19:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:19:32.962408 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1657e-d4d7-4c59-b66f-accc03b86688 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:32.970605 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41ec4d-e9bc-43b8-9b9b-82a256cecdbe None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:32.970894 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41ec4d-e9bc-43b8-9b9b-82a256cecdbe None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:32.971173 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41ec4d-e9bc-43b8-9b9b-82a256cecdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:33.014474 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5b41ec4d-e9bc-43b8-9b9b-82a256cecdbe None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:33.015385 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5b41ec4d-e9bc-43b8-9b9b-82a256cecdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:33.102951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1657e-d4d7-4c59-b66f-accc03b86688 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:33.159159 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c45b60-b689-47e9-834a-89fe676e07cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:33.160605 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c45b60-b689-47e9-834a-89fe676e07cb None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:33.161143 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c45b60-b689-47e9-834a-89fe676e07cb None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:33.161704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c45b60-b689-47e9-834a-89fe676e07cb None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:33.162878 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c45b60-b689-47e9-834a-89fe676e07cb None admin] RBAC: Adding query filter params (name=member) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:33.163395 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c45b60-b689-47e9-834a-89fe676e07cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:33.165026 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c45b60-b689-47e9-834a-89fe676e07cb None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:33.187335 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 48/91] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 31 12:19:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:33.193218 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c45b60-b689-47e9-834a-89fe676e07cb None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:33.219440 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 44/92] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:33.260325 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:33.348846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c45b60-b689-47e9-834a-89fe676e07cb None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:33.413305 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffc46e-db74-431a-966f-1a575ef22026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:33.414301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffc46e-db74-431a-966f-1a575ef22026 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:33.414784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffc46e-db74-431a-966f-1a575ef22026 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:33.415256 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffc46e-db74-431a-966f-1a575ef22026 None admin] PATH_INFO: `/v3/users/1ac8a34c1c5541d29cb91cfa44b9e4eb` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:33.416622 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffc46e-db74-431a-966f-1a575ef22026 None admin] RBAC: Authorizing `identity:get_user(user_id=1ac8a34c1c5541d29cb91cfa44b9e4eb)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:33.418967 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffc46e-db74-431a-966f-1a575ef22026 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:33.425268 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 49/93] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:33 2022] GET /identity/v3/users/1ac8a34c1c5541d29cb91cfa44b9e4eb => generated 275 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:33.430208 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41ec4d-e9bc-43b8-9b9b-82a256cecdbe None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:33.499050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db412c-b0be-4f23-92d6-205f91200001 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:33.499699 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db412c-b0be-4f23-92d6-205f91200001 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:33.500174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db412c-b0be-4f23-92d6-205f91200001 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:33.502050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 50/94] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:33.514983 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c03fec-fbbf-4ec0-aefc-e4599c8b7c4c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:33.515578 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c03fec-fbbf-4ec0-aefc-e4599c8b7c4c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:33.516066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c03fec-fbbf-4ec0-aefc-e4599c8b7c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:33.535349 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:33.547062 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-b7c03fec-fbbf-4ec0-aefc-e4599c8b7c4c None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:33.548510 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b7c03fec-fbbf-4ec0-aefc-e4599c8b7c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:33.596248 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41ec4d-e9bc-43b8-9b9b-82a256cecdbe None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:33.656341 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec306ad-4e40-4683-ba46-4b00daa91bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:33.656881 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec306ad-4e40-4683-ba46-4b00daa91bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:33.657186 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec306ad-4e40-4683-ba46-4b00daa91bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:33.657463 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec306ad-4e40-4683-ba46-4b00daa91bb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:33.687939 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 51/95] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 12:19:33.688780 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c03fec-fbbf-4ec0-aefc-e4599c8b7c4c None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:33.754082 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:33.818876 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec306ad-4e40-4683-ba46-4b00daa91bb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:33.820387 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec306ad-4e40-4683-ba46-4b00daa91bb7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:33.827264 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c03fec-fbbf-4ec0-aefc-e4599c8b7c4c None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:33.879069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa1cc7-21e7-474d-9002-95331bce5a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:33.879983 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa1cc7-21e7-474d-9002-95331bce5a40 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:33.880409 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa1cc7-21e7-474d-9002-95331bce5a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:33.880825 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa1cc7-21e7-474d-9002-95331bce5a40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:33.894440 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa1cc7-21e7-474d-9002-95331bce5a40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:33.900955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-1faa1cc7-21e7-474d-9002-95331bce5a40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:19:33.900955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:33.900955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:33.900955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:33.900955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:33.900955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:33.900955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:33.900955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:33.900955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:33.900955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:33.900955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:33.900955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:33.900955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:33.900955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:33.900955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:33.900955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:33.902019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:33.902019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:33.902019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:33.902019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:33.902019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:33.902019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:33.902019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:33.902019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:33.902019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:33.902019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:33.902019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:33.902019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:33.902019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:33.902019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:33.902019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:33.902019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:33.903514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:33.903514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:33.903514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:33.903514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:33.903514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:33.903514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:33.903514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:33.903514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:33.903514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:33.903514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:33.903514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:19:33.903514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:19:33.905946 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 52/96] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 31 12:19:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:19:33.912042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa1cc7-21e7-474d-9002-95331bce5a40 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:33.962372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:34.039938 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:34.044371 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa1cc7-21e7-474d-9002-95331bce5a40 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:34.045404 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 45/97] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:19:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 12:19:34.046616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676eb6e9-d7fe-4f09-8427-ba1a05aad022 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:34.046914 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676eb6e9-d7fe-4f09-8427-ba1a05aad022 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:34.047193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676eb6e9-d7fe-4f09-8427-ba1a05aad022 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:34.048562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 46/98] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:34.054169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc7abf-c797-446d-9d4e-e7526eae02d9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:34.054389 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc7abf-c797-446d-9d4e-e7526eae02d9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:34.054673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc7abf-c797-446d-9d4e-e7526eae02d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:34.100602 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4045aa-2bab-4b94-b22e-6d551169f842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:34.101552 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4045aa-2bab-4b94-b22e-6d551169f842 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:34.102087 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4045aa-2bab-4b94-b22e-6d551169f842 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:34.102535 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4045aa-2bab-4b94-b22e-6d551169f842 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:34.102698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c3cc7abf-c797-446d-9d4e-e7526eae02d9 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:34.103537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4045aa-2bab-4b94-b22e-6d551169f842 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:34.103883 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c3cc7abf-c797-446d-9d4e-e7526eae02d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:34.104276 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4045aa-2bab-4b94-b22e-6d551169f842 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:34.106176 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4045aa-2bab-4b94-b22e-6d551169f842 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:34.123444 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 53/99] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:19:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:34.124627 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4045aa-2bab-4b94-b22e-6d551169f842 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:34.194827 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 47/100] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:34.196001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc7abf-c797-446d-9d4e-e7526eae02d9 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:34.243075 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4045aa-2bab-4b94-b22e-6d551169f842 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:34.281269 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36de28f-f58e-4eec-8b61-a106ae51626c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:34.282265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36de28f-f58e-4eec-8b61-a106ae51626c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:34.282788 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36de28f-f58e-4eec-8b61-a106ae51626c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:34.283259 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36de28f-f58e-4eec-8b61-a106ae51626c None admin] PATH_INFO: `/v3/projects/a526fed604bd4419b5680a31eb366b07` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:34.284652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36de28f-f58e-4eec-8b61-a106ae51626c None admin] RBAC: Authorizing `identity:get_project(project_id=a526fed604bd4419b5680a31eb366b07)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:34.286512 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36de28f-f58e-4eec-8b61-a106ae51626c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:34.289221 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 54/101] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:19:34 2022] GET /identity/v3/projects/a526fed604bd4419b5680a31eb366b07 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:34.290359 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36de28f-f58e-4eec-8b61-a106ae51626c None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:34.322229 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:34.329689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:34.334997 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc7abf-c797-446d-9d4e-e7526eae02d9 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:34.374242 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf95c9-21d6-479e-b729-05bbb1ed9a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:34.374878 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf95c9-21d6-479e-b729-05bbb1ed9a55 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:34.375161 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf95c9-21d6-479e-b729-05bbb1ed9a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:34.375465 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf95c9-21d6-479e-b729-05bbb1ed9a55 None admin] PATH_INFO: `/v3/users/c1e64987ec354c7fb596a7e6d0af67ef` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:34.376547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf95c9-21d6-479e-b729-05bbb1ed9a55 None admin] RBAC: Authorizing `identity:get_user(user_id=c1e64987ec354c7fb596a7e6d0af67ef)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:34.378139 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf95c9-21d6-479e-b729-05bbb1ed9a55 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:34.380021 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 48/102] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:34 2022] GET /identity/v3/users/c1e64987ec354c7fb596a7e6d0af67ef => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:34.380797 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf95c9-21d6-479e-b729-05bbb1ed9a55 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:34.419249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36de28f-f58e-4eec-8b61-a106ae51626c None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:34.455399 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11dd57f-00d1-4b1d-a855-02a3a0f3b135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:34.455956 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dd57f-00d1-4b1d-a855-02a3a0f3b135 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:34.456237 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dd57f-00d1-4b1d-a855-02a3a0f3b135 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:34.456506 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11dd57f-00d1-4b1d-a855-02a3a0f3b135 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:34.472477 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11dd57f-00d1-4b1d-a855-02a3a0f3b135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:34.480836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-b11dd57f-00d1-4b1d-a855-02a3a0f3b135 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:19:34.480836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:34.480836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:34.480836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:34.480836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:34.480836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:34.480836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:34.480836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:34.480836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:34.480836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:34.480836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:34.480836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:34.480836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:34.480836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:34.480836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:34.480836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:34.481764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:34.481764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:34.481764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:34.481764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:34.481764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:34.481764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:34.481764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:34.481764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:34.481764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:34.481764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:34.481764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:34.481764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:34.481764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:34.481764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:34.481764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:34.481764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:34.482509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:34.482509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:34.482509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:34.482509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:34.482509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:34.482509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:34.482509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:34.482509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:34.482509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:34.482509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:34.482509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:19:34.482509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:19:34.483089 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 55/103] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:19:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:19:34.483806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c6b44-ee61-4e4c-9b55-2ca4aa0c252f None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:34.484093 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c6b44-ee61-4e4c-9b55-2ca4aa0c252f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:34.484369 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c6b44-ee61-4e4c-9b55-2ca4aa0c252f None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:34.485799 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 56/104] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:34.486370 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c6b44-ee61-4e4c-9b55-2ca4aa0c252f None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:34.499992 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf95c9-21d6-479e-b729-05bbb1ed9a55 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:34.535952 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef15d5-2e08-4c09-94dc-ff71c3fd6f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:34.536563 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef15d5-2e08-4c09-94dc-ff71c3fd6f56 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:34.536850 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef15d5-2e08-4c09-94dc-ff71c3fd6f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:34.537155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef15d5-2e08-4c09-94dc-ff71c3fd6f56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:34.538401 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef15d5-2e08-4c09-94dc-ff71c3fd6f56 None admin] RBAC: Adding query filter params (role.id=b7c6f84505634b978e58bb6f62bd88a0, scope.project.id=a526fed604bd4419b5680a31eb366b07, user.id=1ac8a34c1c5541d29cb91cfa44b9e4eb) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:34.538505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef15d5-2e08-4c09-94dc-ff71c3fd6f56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:34.539866 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef15d5-2e08-4c09-94dc-ff71c3fd6f56 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:34.548931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 49/105] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:19:34 2022] GET /identity/v3/role_assignments?user.id=1ac8a34c1c5541d29cb91cfa44b9e4eb&scope.project.id=a526fed604bd4419b5680a31eb366b07&role.id=b7c6f84505634b978e58bb6f62bd88a0 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:34.550038 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d892ea-e24f-443e-a6fc-e53b350e8574 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:34.550325 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d892ea-e24f-443e-a6fc-e53b350e8574 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:34.550600 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d892ea-e24f-443e-a6fc-e53b350e8574 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:34.551951 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 50/106] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:34.556796 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d892ea-e24f-443e-a6fc-e53b350e8574 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:34.586677 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:34.593241 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:34.603799 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c6b44-ee61-4e4c-9b55-2ca4aa0c252f None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:34.645395 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5354c8-1347-4b56-94d4-7f4ca0c6768f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:34.646015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5354c8-1347-4b56-94d4-7f4ca0c6768f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:34.646304 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5354c8-1347-4b56-94d4-7f4ca0c6768f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:34.646583 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5354c8-1347-4b56-94d4-7f4ca0c6768f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:34.675906 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d892ea-e24f-443e-a6fc-e53b350e8574 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:34.715552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553664b-6416-47a3-b6ec-7a98270c5cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:34.716598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553664b-6416-47a3-b6ec-7a98270c5cba None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:34.716958 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553664b-6416-47a3-b6ec-7a98270c5cba None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:34.717262 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553664b-6416-47a3-b6ec-7a98270c5cba None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:34.717937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553664b-6416-47a3-b6ec-7a98270c5cba None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:34.718247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553664b-6416-47a3-b6ec-7a98270c5cba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:34.719217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5354c8-1347-4b56-94d4-7f4ca0c6768f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:34.719646 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553664b-6416-47a3-b6ec-7a98270c5cba None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:34.720681 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5354c8-1347-4b56-94d4-7f4ca0c6768f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:34.729211 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 51/107] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 31 12:19:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:34.730874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884161a-f4ce-4d65-a1f8-cbe55267bec6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:34.731162 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884161a-f4ce-4d65-a1f8-cbe55267bec6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:34.731434 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884161a-f4ce-4d65-a1f8-cbe55267bec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:34.751772 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2884161a-f4ce-4d65-a1f8-cbe55267bec6 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:34.752976 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2884161a-f4ce-4d65-a1f8-cbe55267bec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:34.819116 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:34.827143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 52/108] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:34.837304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884161a-f4ce-4d65-a1f8-cbe55267bec6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:34.837386 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 57/109] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:19:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 12:19:34.837386 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e8180-89bf-445e-9c4e-d72ca14c97d8 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:34.837386 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e8180-89bf-445e-9c4e-d72ca14c97d8 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:34.837386 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e8180-89bf-445e-9c4e-d72ca14c97d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:34.851552 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-0b1e8180-89bf-445e-9c4e-d72ca14c97d8 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:34.852738 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0b1e8180-89bf-445e-9c4e-d72ca14c97d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:34.861878 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:34.920384 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 58/110] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:34.921408 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e8180-89bf-445e-9c4e-d72ca14c97d8 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:34.955819 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884161a-f4ce-4d65-a1f8-cbe55267bec6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:34.998751 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94d035-282e-4cc3-81e0-7dc09853a4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:35.000047 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94d035-282e-4cc3-81e0-7dc09853a4cc None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:35.000784 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94d035-282e-4cc3-81e0-7dc09853a4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:35.001260 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94d035-282e-4cc3-81e0-7dc09853a4cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:35.014956 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94d035-282e-4cc3-81e0-7dc09853a4cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:35.021551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-1a94d035-282e-4cc3-81e0-7dc09853a4cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 12:19:35.021551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:35.021551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:35.021551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:35.021551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:35.021551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:35.021551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:35.021551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:35.021551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:35.021551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:35.021551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:35.021551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:35.021551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:35.021551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:35.021551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:35.021551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:35.022420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:35.022420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:35.022420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:35.022420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:35.022420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:35.022420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:35.022420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:35.022420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:35.022420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:35.022420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:35.022420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:35.022420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:35.022420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:35.022420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:35.022420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:35.022420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:35.025973 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:35.025973 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:35.025973 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:35.025973 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:35.025973 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:35.025973 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:35.025973 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:35.025973 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:35.025973 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:35.025973 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:35.025973 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 12:19:35.025973 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:19:35.025973 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 53/111] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 31 12:19:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:19:35.025973 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94d035-282e-4cc3-81e0-7dc09853a4cc None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:35.053836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e8180-89bf-445e-9c4e-d72ca14c97d8 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:35.076323 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:35.099412 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3a25c-7fe0-495c-8b91-f7d92c936b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:35.100180 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3a25c-7fe0-495c-8b91-f7d92c936b6b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:35.100569 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3a25c-7fe0-495c-8b91-f7d92c936b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:35.100978 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3a25c-7fe0-495c-8b91-f7d92c936b6b None admin] PATH_INFO: `/v3/users/1ac8a34c1c5541d29cb91cfa44b9e4eb` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:35.102237 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3a25c-7fe0-495c-8b91-f7d92c936b6b None admin] RBAC: Authorizing `identity:get_user(user_id=1ac8a34c1c5541d29cb91cfa44b9e4eb)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:35.103775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3a25c-7fe0-495c-8b91-f7d92c936b6b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:35.106292 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 59/112] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:34 2022] GET /identity/v3/users/1ac8a34c1c5541d29cb91cfa44b9e4eb => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:35.111207 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3a25c-7fe0-495c-8b91-f7d92c936b6b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:35.133766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:35.155052 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94d035-282e-4cc3-81e0-7dc09853a4cc None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:35.191811 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b1faf-e44f-46f0-a72d-61ba9f699cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:35.192441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b1faf-e44f-46f0-a72d-61ba9f699cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:35.192721 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b1faf-e44f-46f0-a72d-61ba9f699cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:35.192999 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b1faf-e44f-46f0-a72d-61ba9f699cc5 None admin] PATH_INFO: `/v3/projects/a526fed604bd4419b5680a31eb366b07` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:35.194168 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b1faf-e44f-46f0-a72d-61ba9f699cc5 None admin] RBAC: Authorizing `identity:get_project(project_id=a526fed604bd4419b5680a31eb366b07)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:35.195609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b1faf-e44f-46f0-a72d-61ba9f699cc5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:35.197249 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 54/113] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:19:35 2022] GET /identity/v3/projects/a526fed604bd4419b5680a31eb366b07 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:35.198117 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b1faf-e44f-46f0-a72d-61ba9f699cc5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:35.212910 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3a25c-7fe0-495c-8b91-f7d92c936b6b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:35.246759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a44d92-1854-4297-9b64-925157588cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:35.247472 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a44d92-1854-4297-9b64-925157588cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:35.247637 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a44d92-1854-4297-9b64-925157588cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:35.247911 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a44d92-1854-4297-9b64-925157588cc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:35.248583 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a44d92-1854-4297-9b64-925157588cc5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:35.248945 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a44d92-1854-4297-9b64-925157588cc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:35.250280 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a44d92-1854-4297-9b64-925157588cc5 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:35.258023 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 60/114] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:19:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:35.258814 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a44d92-1854-4297-9b64-925157588cc5 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:35.296186 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b1faf-e44f-46f0-a72d-61ba9f699cc5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:35.308422 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:35.329769 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c72867-8d0e-4cdb-a85f-6350243b2c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:35.330392 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c72867-8d0e-4cdb-a85f-6350243b2c5b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:35.330674 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c72867-8d0e-4cdb-a85f-6350243b2c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:35.330948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c72867-8d0e-4cdb-a85f-6350243b2c5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:35.332052 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c72867-8d0e-4cdb-a85f-6350243b2c5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:35.333511 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c72867-8d0e-4cdb-a85f-6350243b2c5b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:35.335066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 55/115] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:19:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:35.335820 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c72867-8d0e-4cdb-a85f-6350243b2c5b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:35.354407 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:35.359916 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a44d92-1854-4297-9b64-925157588cc5 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:35.393397 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f4378-b738-49c0-9dea-971a3660b02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:35.394204 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f4378-b738-49c0-9dea-971a3660b02f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:35.394631 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f4378-b738-49c0-9dea-971a3660b02f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:35.394905 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f4378-b738-49c0-9dea-971a3660b02f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:35.434454 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c72867-8d0e-4cdb-a85f-6350243b2c5b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:35.460248 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f4378-b738-49c0-9dea-971a3660b02f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:35.461746 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f4378-b738-49c0-9dea-971a3660b02f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:35.467652 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193748aa-6479-4897-88ee-56c466ae29f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:35.468284 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193748aa-6479-4897-88ee-56c466ae29f1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:35.468567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193748aa-6479-4897-88ee-56c466ae29f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:35.468844 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193748aa-6479-4897-88ee-56c466ae29f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:35.479336 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193748aa-6479-4897-88ee-56c466ae29f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:35.484217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-193748aa-6479-4897-88ee-56c466ae29f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 12:19:35.484217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:35.484217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:35.484217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:35.484217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:35.484217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:35.484217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:35.484217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:35.484217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:35.484217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:35.484217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:35.484217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:35.484217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:35.484217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:35.484217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:35.484217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:35.485058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:35.485058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:35.485058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:35.485058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:35.485058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:35.485058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:35.485058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:35.485058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:35.485058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:35.485058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:35.485058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:35.485058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:35.485058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:35.485058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:35.485058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:35.485058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:35.485846 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:35.485846 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:35.485846 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:35.485846 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:35.485846 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:35.485846 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:35.485846 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:35.485846 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:35.485846 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:35.485846 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:35.485846 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 12:19:35.485846 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:19:35.485846 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 56/116] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:19:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:19:35.486471 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193748aa-6479-4897-88ee-56c466ae29f1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:35.514129 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:35.566746 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:35.566966 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 61/117] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:19:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 12:19:35.568012 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f4378-b738-49c0-9dea-971a3660b02f None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:35.591915 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193748aa-6479-4897-88ee-56c466ae29f1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:35.625218 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80066df4-0e0b-450f-888d-e86463859659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:35.625822 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80066df4-0e0b-450f-888d-e86463859659 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:35.626104 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80066df4-0e0b-450f-888d-e86463859659 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:35.626377 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80066df4-0e0b-450f-888d-e86463859659 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:35.627104 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80066df4-0e0b-450f-888d-e86463859659 None admin] RBAC: Adding query filter params (role.id=e1b3a811029244d2a7e2664cd3246eec, scope.project.id=a526fed604bd4419b5680a31eb366b07, user.id=c1e64987ec354c7fb596a7e6d0af67ef) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:35.627409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80066df4-0e0b-450f-888d-e86463859659 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:35.628840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80066df4-0e0b-450f-888d-e86463859659 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:35.634402 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 57/118] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:19:35 2022] GET /identity/v3/role_assignments?user.id=c1e64987ec354c7fb596a7e6d0af67ef&scope.project.id=a526fed604bd4419b5680a31eb366b07&role.id=e1b3a811029244d2a7e2664cd3246eec => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:35.635153 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80066df4-0e0b-450f-888d-e86463859659 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:35.668093 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f4378-b738-49c0-9dea-971a3660b02f None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:35.704947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4d582-043a-4951-9318-4968d1109da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:35.705625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4d582-043a-4951-9318-4968d1109da7 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:35.705906 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4d582-043a-4951-9318-4968d1109da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:35.706181 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4d582-043a-4951-9318-4968d1109da7 None admin] PATH_INFO: `/v3/users/1ac8a34c1c5541d29cb91cfa44b9e4eb` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:35.709942 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4d582-043a-4951-9318-4968d1109da7 None admin] RBAC: Authorizing `identity:get_user(user_id=1ac8a34c1c5541d29cb91cfa44b9e4eb)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:35.711438 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4d582-043a-4951-9318-4968d1109da7 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:35.713175 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 62/119] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:35 2022] GET /identity/v3/users/1ac8a34c1c5541d29cb91cfa44b9e4eb => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:35.713175 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4d582-043a-4951-9318-4968d1109da7 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:35.735234 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:35.766873 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80066df4-0e0b-450f-888d-e86463859659 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:35.801927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931627c8-48cd-4e97-a1e7-94ee7a176479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:35.802546 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931627c8-48cd-4e97-a1e7-94ee7a176479 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:35.802825 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931627c8-48cd-4e97-a1e7-94ee7a176479 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:35.803099 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931627c8-48cd-4e97-a1e7-94ee7a176479 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:35.803760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931627c8-48cd-4e97-a1e7-94ee7a176479 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:35.805239 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931627c8-48cd-4e97-a1e7-94ee7a176479 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:35.822957 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:35.828522 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4d582-043a-4951-9318-4968d1109da7 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:35.839155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 58/120] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 31 12:19:35 2022] POST /identity/v3/projects => generated 302 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:19:35.840019 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931627c8-48cd-4e97-a1e7-94ee7a176479 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:35.867477 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7b21c-78c2-4f24-84dd-e9c34d487abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:35.868116 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7b21c-78c2-4f24-84dd-e9c34d487abe None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:35.868453 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7b21c-78c2-4f24-84dd-e9c34d487abe None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:35.868745 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7b21c-78c2-4f24-84dd-e9c34d487abe None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:35.869650 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7b21c-78c2-4f24-84dd-e9c34d487abe None admin] RBAC: Adding query filter params (name=reader) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:35.870651 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7b21c-78c2-4f24-84dd-e9c34d487abe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:35.872768 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7b21c-78c2-4f24-84dd-e9c34d487abe None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:35.882970 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 63/121] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 31 12:19:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:35.883808 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7b21c-78c2-4f24-84dd-e9c34d487abe None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:35.962408 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931627c8-48cd-4e97-a1e7-94ee7a176479 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:35.974832 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:36.000209 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7b21c-78c2-4f24-84dd-e9c34d487abe None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:36.002487 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb6f45-5c61-483c-9687-137580ec3425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:36.003228 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb6f45-5c61-483c-9687-137580ec3425 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:36.003583 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb6f45-5c61-483c-9687-137580ec3425 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:36.003873 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb6f45-5c61-483c-9687-137580ec3425 None admin] PATH_INFO: `/v3/projects/49154018a6d1441086480dd3bba98995` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:36.005099 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb6f45-5c61-483c-9687-137580ec3425 None admin] RBAC: Authorizing `identity:get_project(project_id=49154018a6d1441086480dd3bba98995)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:36.006624 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb6f45-5c61-483c-9687-137580ec3425 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:36.008328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 59/122] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:19:35 2022] GET /identity/v3/projects/49154018a6d1441086480dd3bba98995 => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:36.009140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb6f45-5c61-483c-9687-137580ec3425 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:36.045290 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9403645-9366-4bb3-a55f-6e67688def01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:36.045836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9403645-9366-4bb3-a55f-6e67688def01 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:36.046118 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9403645-9366-4bb3-a55f-6e67688def01 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:36.046392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9403645-9366-4bb3-a55f-6e67688def01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:36.085627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:36.119714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9403645-9366-4bb3-a55f-6e67688def01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:36.121869 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9403645-9366-4bb3-a55f-6e67688def01 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:36.130965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb6f45-5c61-483c-9687-137580ec3425 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:36.170446 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573672e-90d7-4261-a00b-cbd84a2e67e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:36.171475 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573672e-90d7-4261-a00b-cbd84a2e67e0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:36.171762 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573672e-90d7-4261-a00b-cbd84a2e67e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:36.172042 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573672e-90d7-4261-a00b-cbd84a2e67e0 None admin] PATH_INFO: `/v3/users/980228ee52a54758964dfbba71e670d8` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:36.186369 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573672e-90d7-4261-a00b-cbd84a2e67e0 None admin] RBAC: Authorizing `identity:get_user(user_id=980228ee52a54758964dfbba71e670d8)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:36.187817 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573672e-90d7-4261-a00b-cbd84a2e67e0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:36.189514 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 60/123] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:36 2022] GET /identity/v3/users/980228ee52a54758964dfbba71e670d8 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:36.190273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573672e-90d7-4261-a00b-cbd84a2e67e0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:36.210914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:36.234465 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 64/124] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:19:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 12:19:36.235607 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9403645-9366-4bb3-a55f-6e67688def01 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:36.301266 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573672e-90d7-4261-a00b-cbd84a2e67e0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:36.322280 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:36.337204 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9403645-9366-4bb3-a55f-6e67688def01 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:36.338379 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147299f9-bb39-46ba-80a9-16bd47c4f159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:36.339159 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147299f9-bb39-46ba-80a9-16bd47c4f159 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:36.339993 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147299f9-bb39-46ba-80a9-16bd47c4f159 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:36.340385 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147299f9-bb39-46ba-80a9-16bd47c4f159 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:36.341136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147299f9-bb39-46ba-80a9-16bd47c4f159 None admin] RBAC: Adding query filter params (role.id=b7c6f84505634b978e58bb6f62bd88a0, scope.project.id=49154018a6d1441086480dd3bba98995, user.id=1ac8a34c1c5541d29cb91cfa44b9e4eb) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:36.341462 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147299f9-bb39-46ba-80a9-16bd47c4f159 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:36.342888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147299f9-bb39-46ba-80a9-16bd47c4f159 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:36.349408 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 61/125] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:19:36 2022] GET /identity/v3/role_assignments?user.id=1ac8a34c1c5541d29cb91cfa44b9e4eb&scope.project.id=49154018a6d1441086480dd3bba98995&role.id=b7c6f84505634b978e58bb6f62bd88a0 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:36.357399 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147299f9-bb39-46ba-80a9-16bd47c4f159 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:36.398233 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e8fed-3e05-4dbd-a6e9-57d78a50a86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:36.399011 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e8fed-3e05-4dbd-a6e9-57d78a50a86c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:36.399294 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e8fed-3e05-4dbd-a6e9-57d78a50a86c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:36.399570 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e8fed-3e05-4dbd-a6e9-57d78a50a86c None admin] PATH_INFO: `/v3/projects/a526fed604bd4419b5680a31eb366b07` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:36.401016 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e8fed-3e05-4dbd-a6e9-57d78a50a86c None admin] RBAC: Authorizing `identity:get_project(project_id=a526fed604bd4419b5680a31eb366b07)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:36.404025 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e8fed-3e05-4dbd-a6e9-57d78a50a86c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:36.406114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 65/126] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:19:36 2022] GET /identity/v3/projects/a526fed604bd4419b5680a31eb366b07 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:36.412969 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e8fed-3e05-4dbd-a6e9-57d78a50a86c None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:36.476903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147299f9-bb39-46ba-80a9-16bd47c4f159 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:36.484334 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:36.518598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217421c-4295-49f3-bdd6-fb49c99c3944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:36.519245 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217421c-4295-49f3-bdd6-fb49c99c3944 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:36.519528 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217421c-4295-49f3-bdd6-fb49c99c3944 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:36.519806 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217421c-4295-49f3-bdd6-fb49c99c3944 None admin] PATH_INFO: `/v3/projects/a526fed604bd4419b5680a31eb366b07` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:36.521184 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217421c-4295-49f3-bdd6-fb49c99c3944 None admin] RBAC: Authorizing `identity:get_project(project_id=a526fed604bd4419b5680a31eb366b07)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:36.522647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217421c-4295-49f3-bdd6-fb49c99c3944 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:36.524830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 62/127] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:19:36 2022] GET /identity/v3/projects/a526fed604bd4419b5680a31eb366b07 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:36.530832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217421c-4295-49f3-bdd6-fb49c99c3944 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:36.564731 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e8fed-3e05-4dbd-a6e9-57d78a50a86c None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:36.595485 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:36.611864 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22149834-ff32-4c9d-86df-29bbf48d259c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:36.612549 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22149834-ff32-4c9d-86df-29bbf48d259c None admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:36.612813 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22149834-ff32-4c9d-86df-29bbf48d259c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:36.613095 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22149834-ff32-4c9d-86df-29bbf48d259c None admin] PATH_INFO: `/v3/projects/a526fed604bd4419b5680a31eb366b07/users/980228ee52a54758964dfbba71e670d8/roles/f352dab941ec48a589c0f614999dbeb3` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:36.615325 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22149834-ff32-4c9d-86df-29bbf48d259c None admin] RBAC: Authorizing `identity:create_grant(project_id=a526fed604bd4419b5680a31eb366b07, user_id=980228ee52a54758964dfbba71e670d8, role_id=f352dab941ec48a589c0f614999dbeb3)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:36.616803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22149834-ff32-4c9d-86df-29bbf48d259c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:36.638737 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 66/128] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:19:36 2022] PUT /identity/v3/projects/a526fed604bd4419b5680a31eb366b07/users/980228ee52a54758964dfbba71e670d8/roles/f352dab941ec48a589c0f614999dbeb3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:19:36.658143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217421c-4295-49f3-bdd6-fb49c99c3944 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:36.696596 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc3a35-2d0e-4655-8b34-9136ebd5f731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:36.697259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc3a35-2d0e-4655-8b34-9136ebd5f731 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:36.697546 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc3a35-2d0e-4655-8b34-9136ebd5f731 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:36.697828 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc3a35-2d0e-4655-8b34-9136ebd5f731 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:36.698589 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc3a35-2d0e-4655-8b34-9136ebd5f731 None admin] RBAC: Adding query filter params (role.id=209186498dcb49a693401b009f73812e, scope.project.id=a526fed604bd4419b5680a31eb366b07, user.id=1ac8a34c1c5541d29cb91cfa44b9e4eb) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:36.699450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc3a35-2d0e-4655-8b34-9136ebd5f731 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:36.700959 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc3a35-2d0e-4655-8b34-9136ebd5f731 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:36.708035 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 63/129] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:19:36 2022] GET /identity/v3/role_assignments?user.id=1ac8a34c1c5541d29cb91cfa44b9e4eb&scope.project.id=a526fed604bd4419b5680a31eb366b07&role.id=209186498dcb49a693401b009f73812e => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:19:38.055598 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944b943-a570-4500-a56f-3770a318baea None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:38.056121 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944b943-a570-4500-a56f-3770a318baea None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:38.056259 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944b943-a570-4500-a56f-3770a318baea None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:38.057660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 67/130] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:38.062903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5619ba-f44d-4d16-807a-397a33266e3f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:38.063302 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5619ba-f44d-4d16-807a-397a33266e3f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:38.063470 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5619ba-f44d-4d16-807a-397a33266e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:38.081547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7b5619ba-f44d-4d16-807a-397a33266e3f None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:38.082750 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7b5619ba-f44d-4d16-807a-397a33266e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:38.149000 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 64/131] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:38.415992 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944b943-a570-4500-a56f-3770a318baea None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:38.515562 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944b943-a570-4500-a56f-3770a318baea None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:38.522708 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:38.550338 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ec425-0e1b-45d4-9eb4-c07c7e6029e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:38.550966 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ec425-0e1b-45d4-9eb4-c07c7e6029e8 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:38.551247 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ec425-0e1b-45d4-9eb4-c07c7e6029e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:38.551519 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ec425-0e1b-45d4-9eb4-c07c7e6029e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:38.552609 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ec425-0e1b-45d4-9eb4-c07c7e6029e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:38.554078 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ec425-0e1b-45d4-9eb4-c07c7e6029e8 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:38.555637 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 68/132] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:19:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:38.561711 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5619ba-f44d-4d16-807a-397a33266e3f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:38.606352 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:38.658689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5619ba-f44d-4d16-807a-397a33266e3f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:38.694956 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801fd00-7dec-49de-8dea-2f9a092e1d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:38.695482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801fd00-7dec-49de-8dea-2f9a092e1d52 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:38.695764 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801fd00-7dec-49de-8dea-2f9a092e1d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:38.696036 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801fd00-7dec-49de-8dea-2f9a092e1d52 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:38.696697 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801fd00-7dec-49de-8dea-2f9a092e1d52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:38.698174 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801fd00-7dec-49de-8dea-2f9a092e1d52 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:38.724150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 65/133] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 31 12:19:38 2022] POST /identity/v3/users => generated 283 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:19:38.776697 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f59255-abe8-4e78-b013-e32dd93a1653 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:38.777027 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f59255-abe8-4e78-b013-e32dd93a1653 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:38.777337 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f59255-abe8-4e78-b013-e32dd93a1653 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:38.778736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 69/134] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:38.784670 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac1ead-c3dc-4422-9e5f-bf163d8fe008 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:38.784963 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac1ead-c3dc-4422-9e5f-bf163d8fe008 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:38.785277 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac1ead-c3dc-4422-9e5f-bf163d8fe008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:38.804441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-eaac1ead-c3dc-4422-9e5f-bf163d8fe008 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:38.805686 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-eaac1ead-c3dc-4422-9e5f-bf163d8fe008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:38.876133 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 66/135] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:39.145060 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f59255-abe8-4e78-b013-e32dd93a1653 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:39.257510 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f59255-abe8-4e78-b013-e32dd93a1653 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:39.293058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff89e54-e097-45cc-8446-a4a93cbf4690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:39.293723 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff89e54-e097-45cc-8446-a4a93cbf4690 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:39.294004 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff89e54-e097-45cc-8446-a4a93cbf4690 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:39.294276 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff89e54-e097-45cc-8446-a4a93cbf4690 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:39.309221 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff89e54-e097-45cc-8446-a4a93cbf4690 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:39.314537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-1ff89e54-e097-45cc-8446-a4a93cbf4690 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 12:19:39.314537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:39.314537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:39.314537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:39.314537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:39.314537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:39.314537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:39.314537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:39.314537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:39.314537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:39.314537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:39.314537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:39.314537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:39.314537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:39.314537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:39.314537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:39.315368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:39.315368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:39.315368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:39.315368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:39.315368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:39.315368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:39.315368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:39.315368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:39.315368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:39.315368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:39.315368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:39.315368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:39.315368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:39.315368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:39.315368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:39.315368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:39.316149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:39.316149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:39.316149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:39.316149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:39.316149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:39.316149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:39.316149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:39.316149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:39.316149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:39.316149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:39.316149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 12:19:39.316149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:19:39.318710 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 70/136] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:19:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:19:39.324816 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac1ead-c3dc-4422-9e5f-bf163d8fe008 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:39.357725 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:39.439403 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac1ead-c3dc-4422-9e5f-bf163d8fe008 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:39.474594 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4202b5-d05c-49f4-bc2f-dad83b934403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:39.475677 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4202b5-d05c-49f4-bc2f-dad83b934403 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:39.476238 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4202b5-d05c-49f4-bc2f-dad83b934403 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:39.476708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4202b5-d05c-49f4-bc2f-dad83b934403 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:39.477605 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4202b5-d05c-49f4-bc2f-dad83b934403 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:39.478170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4202b5-d05c-49f4-bc2f-dad83b934403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:39.479868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4202b5-d05c-49f4-bc2f-dad83b934403 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:39.489045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 67/137] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 31 12:19:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:39.498144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff89e54-e097-45cc-8446-a4a93cbf4690 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:39.533872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:39.605766 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff89e54-e097-45cc-8446-a4a93cbf4690 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:39.641384 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a895c2-6f9a-4719-8297-1d4ef7384942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:39.642387 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a895c2-6f9a-4719-8297-1d4ef7384942 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:39.642890 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a895c2-6f9a-4719-8297-1d4ef7384942 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:39.643388 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a895c2-6f9a-4719-8297-1d4ef7384942 None admin] PATH_INFO: `/v3/users/980228ee52a54758964dfbba71e670d8` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:39.644723 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a895c2-6f9a-4719-8297-1d4ef7384942 None admin] RBAC: Authorizing `identity:get_user(user_id=980228ee52a54758964dfbba71e670d8)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:39.646376 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a895c2-6f9a-4719-8297-1d4ef7384942 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:39.648154 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 71/138] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:39 2022] GET /identity/v3/users/980228ee52a54758964dfbba71e670d8 => generated 289 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:39.654464 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4202b5-d05c-49f4-bc2f-dad83b934403 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:39.755487 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:39.764298 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4202b5-d05c-49f4-bc2f-dad83b934403 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:39.799543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8e9e0-aa1e-43ad-ae34-813b77466e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:39.800172 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8e9e0-aa1e-43ad-ae34-813b77466e8d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:39.800460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8e9e0-aa1e-43ad-ae34-813b77466e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:39.800744 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8e9e0-aa1e-43ad-ae34-813b77466e8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:39.873157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8e9e0-aa1e-43ad-ae34-813b77466e8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:39.874589 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8e9e0-aa1e-43ad-ae34-813b77466e8d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:39.968822 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:39.977137 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 68/139] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:19:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 12:19:39.984132 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a895c2-6f9a-4719-8297-1d4ef7384942 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:40.091220 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a895c2-6f9a-4719-8297-1d4ef7384942 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:40.092704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:40.128891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb3947-8cdf-49eb-bd63-dbf08ec647e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:40.129486 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb3947-8cdf-49eb-bd63-dbf08ec647e0 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:40.129935 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb3947-8cdf-49eb-bd63-dbf08ec647e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:40.130215 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb3947-8cdf-49eb-bd63-dbf08ec647e0 None admin] PATH_INFO: `/v3/projects/a526fed604bd4419b5680a31eb366b07` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:40.131351 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb3947-8cdf-49eb-bd63-dbf08ec647e0 None admin] RBAC: Authorizing `identity:get_project(project_id=a526fed604bd4419b5680a31eb366b07)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:40.132823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb3947-8cdf-49eb-bd63-dbf08ec647e0 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:40.134495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 72/140] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:19:39 2022] GET /identity/v3/projects/a526fed604bd4419b5680a31eb366b07 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:40.141008 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8e9e0-aa1e-43ad-ae34-813b77466e8d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:40.248034 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8e9e0-aa1e-43ad-ae34-813b77466e8d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:40.283036 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fa828-afe6-4dbe-9000-ef6abeef9221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:40.283656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fa828-afe6-4dbe-9000-ef6abeef9221 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:40.283943 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fa828-afe6-4dbe-9000-ef6abeef9221 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:40.284221 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fa828-afe6-4dbe-9000-ef6abeef9221 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:40.284952 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fa828-afe6-4dbe-9000-ef6abeef9221 None admin] RBAC: Adding query filter params (role.id=f352dab941ec48a589c0f614999dbeb3, scope.project.id=a526fed604bd4419b5680a31eb366b07, user.id=980228ee52a54758964dfbba71e670d8) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:40.285297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fa828-afe6-4dbe-9000-ef6abeef9221 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:40.286737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fa828-afe6-4dbe-9000-ef6abeef9221 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:40.292832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 69/141] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:19:40 2022] GET /identity/v3/role_assignments?user.id=980228ee52a54758964dfbba71e670d8&scope.project.id=a526fed604bd4419b5680a31eb366b07&role.id=f352dab941ec48a589c0f614999dbeb3 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:41.000392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f70d5-8c24-4108-a3fc-a655a7f48647 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:41.001032 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f70d5-8c24-4108-a3fc-a655a7f48647 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:41.001032 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f70d5-8c24-4108-a3fc-a655a7f48647 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:41.002700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 73/142] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:41.008720 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82200d-5fb1-4d26-8207-5d95b6db536d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:41.009281 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82200d-5fb1-4d26-8207-5d95b6db536d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:41.009281 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82200d-5fb1-4d26-8207-5d95b6db536d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:41.029496 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-cd82200d-5fb1-4d26-8207-5d95b6db536d None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:41.030704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cd82200d-5fb1-4d26-8207-5d95b6db536d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:41.096484 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:41.111962 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 70/143] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:41.121000 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d67e4-fafa-40dd-866e-0ed0c21d3888 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:41.121326 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d67e4-fafa-40dd-866e-0ed0c21d3888 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:41.121606 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d67e4-fafa-40dd-866e-0ed0c21d3888 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:41.123209 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 74/144] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:41.128428 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac7c0e-ad4f-4512-8e1e-78e692548e17 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:41.128728 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac7c0e-ad4f-4512-8e1e-78e692548e17 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:41.129012 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac7c0e-ad4f-4512-8e1e-78e692548e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:41.151286 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3dac7c0e-ad4f-4512-8e1e-78e692548e17 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:41.152483 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3dac7c0e-ad4f-4512-8e1e-78e692548e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:41.220474 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 71/145] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:41.316632 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2e259-0f46-4120-a842-02dcd9cafc6c None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:41.316918 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2e259-0f46-4120-a842-02dcd9cafc6c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:41.317119 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2e259-0f46-4120-a842-02dcd9cafc6c None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:41.318644 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 75/146] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:41.323658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cac520-5a37-4b5a-838c-99acdbf88294 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:41.323955 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cac520-5a37-4b5a-838c-99acdbf88294 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:41.324236 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cac520-5a37-4b5a-838c-99acdbf88294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:41.342020 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-42cac520-5a37-4b5a-838c-99acdbf88294 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:41.343198 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-42cac520-5a37-4b5a-838c-99acdbf88294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:41.387882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2e259-0f46-4120-a842-02dcd9cafc6c None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:41.410574 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 72/147] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:41.486306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cac520-5a37-4b5a-838c-99acdbf88294 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:41.493690 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2e259-0f46-4120-a842-02dcd9cafc6c None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:41.528448 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0381b5-aaca-4b4b-b2bd-c026d61c17df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:41.529080 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0381b5-aaca-4b4b-b2bd-c026d61c17df None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:41.529389 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0381b5-aaca-4b4b-b2bd-c026d61c17df None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:41.529662 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0381b5-aaca-4b4b-b2bd-c026d61c17df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:41.535122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:41.543507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0381b5-aaca-4b4b-b2bd-c026d61c17df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:41.548398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-6a0381b5-aaca-4b4b-b2bd-c026d61c17df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:19:41.548398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:41.548398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:41.548398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:41.548398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:41.548398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:41.548398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:41.548398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:41.548398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:41.548398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:41.548398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:41.548398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:41.548398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:41.548398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:41.548398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:41.548398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:41.549333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:41.549333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:41.549333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:41.549333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:41.549333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:41.549333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:41.549333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:41.549333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:41.549333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:41.549333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:41.549333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:41.549333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:41.549333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:41.549333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:41.549333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:41.549333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:41.550809 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:41.550809 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:41.550809 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:41.550809 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:41.550809 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:41.550809 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:41.550809 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:41.550809 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:41.550809 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:41.550809 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:41.550809 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:19:41.550809 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:19:41.550809 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 76/148] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 31 12:19:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:19:41.555161 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0381b5-aaca-4b4b-b2bd-c026d61c17df None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:41.585396 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:41.591685 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cac520-5a37-4b5a-838c-99acdbf88294 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:41.626722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567555a-a411-4dd6-97b2-996b5b2c030e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:41.627602 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567555a-a411-4dd6-97b2-996b5b2c030e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:41.628091 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567555a-a411-4dd6-97b2-996b5b2c030e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:41.628556 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567555a-a411-4dd6-97b2-996b5b2c030e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:41.639915 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567555a-a411-4dd6-97b2-996b5b2c030e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:41.645040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-2567555a-a411-4dd6-97b2-996b5b2c030e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 12:19:41.645040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:41.645040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:41.645040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:41.645040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:41.645040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:41.645040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:41.645040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:41.645040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:41.645040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:41.645040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:41.645040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:41.645040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:41.645040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:41.645040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:41.645040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:41.645960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:41.645960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:41.645960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:41.645960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:41.645960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:41.645960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:41.645960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:41.645960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:41.645960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:41.645960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:41.645960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:41.645960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:41.645960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:41.645960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:41.645960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:41.645960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:41.646738 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:41.646738 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:41.646738 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:41.646738 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:41.646738 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:41.646738 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:41.646738 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:41.646738 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:41.646738 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:41.646738 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:41.646738 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 12:19:41.646738 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:19:41.648591 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 73/149] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 31 12:19:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:19:41.654768 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567555a-a411-4dd6-97b2-996b5b2c030e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:41.660070 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0381b5-aaca-4b4b-b2bd-c026d61c17df None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:41.695416 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323f7bb-df9e-4189-ad5d-0b3f93da0979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:41.696024 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323f7bb-df9e-4189-ad5d-0b3f93da0979 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:41.696304 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323f7bb-df9e-4189-ad5d-0b3f93da0979 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:41.696577 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323f7bb-df9e-4189-ad5d-0b3f93da0979 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:41.697270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323f7bb-df9e-4189-ad5d-0b3f93da0979 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:41.697571 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323f7bb-df9e-4189-ad5d-0b3f93da0979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:41.698974 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323f7bb-df9e-4189-ad5d-0b3f93da0979 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:41.707049 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 77/150] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:19:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:19:41.707049 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323f7bb-df9e-4189-ad5d-0b3f93da0979 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:41.760165 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567555a-a411-4dd6-97b2-996b5b2c030e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:41.770025 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:41.795881 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a5663-47e8-4dda-a76f-ce62a892f484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:41.796482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a5663-47e8-4dda-a76f-ce62a892f484 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:41.796755 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a5663-47e8-4dda-a76f-ce62a892f484 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:41.797028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a5663-47e8-4dda-a76f-ce62a892f484 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:41.797762 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a5663-47e8-4dda-a76f-ce62a892f484 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:41.798061 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a5663-47e8-4dda-a76f-ce62a892f484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:41.798429 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:41.799469 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a5663-47e8-4dda-a76f-ce62a892f484 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:41.807063 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 74/151] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:19:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:19:41.807784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323f7bb-df9e-4189-ad5d-0b3f93da0979 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:41.812329 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a5663-47e8-4dda-a76f-ce62a892f484 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:41.840740 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ab100-da9a-4d9a-bd2b-b7a3d339c3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:41.841410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ab100-da9a-4d9a-bd2b-b7a3d339c3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:41.841670 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ab100-da9a-4d9a-bd2b-b7a3d339c3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:41.841938 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ab100-da9a-4d9a-bd2b-b7a3d339c3f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:41.843026 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ab100-da9a-4d9a-bd2b-b7a3d339c3f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:41.844438 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ab100-da9a-4d9a-bd2b-b7a3d339c3f2 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:41.846012 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 78/152] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:19:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:41.846012 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ab100-da9a-4d9a-bd2b-b7a3d339c3f2 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:41.907874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a5663-47e8-4dda-a76f-ce62a892f484 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:41.940479 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0a5ff-edb8-4cc3-867f-0b74db1e124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:41.941136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0a5ff-edb8-4cc3-867f-0b74db1e124f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:41.941416 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0a5ff-edb8-4cc3-867f-0b74db1e124f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:41.941693 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0a5ff-edb8-4cc3-867f-0b74db1e124f None admin] PATH_INFO: `/v3/users/2831c6ac26a24f1a8abde28817976946` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:41.942833 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ab100-da9a-4d9a-bd2b-b7a3d339c3f2 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:41.955047 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0a5ff-edb8-4cc3-867f-0b74db1e124f None admin] RBAC: Authorizing `identity:get_user(user_id=2831c6ac26a24f1a8abde28817976946)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:41.957062 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0a5ff-edb8-4cc3-867f-0b74db1e124f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:41.958746 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 75/153] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:41 2022] GET /identity/v3/users/2831c6ac26a24f1a8abde28817976946 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:41.958746 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0a5ff-edb8-4cc3-867f-0b74db1e124f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:41.980420 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8e491-a165-4ab3-8a01-00eaea692003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:41.981168 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8e491-a165-4ab3-8a01-00eaea692003 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:41.981457 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8e491-a165-4ab3-8a01-00eaea692003 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:41.981731 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8e491-a165-4ab3-8a01-00eaea692003 None admin] PATH_INFO: `/v3/users/2831c6ac26a24f1a8abde28817976946` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:41.982867 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8e491-a165-4ab3-8a01-00eaea692003 None admin] RBAC: Authorizing `identity:get_user(user_id=2831c6ac26a24f1a8abde28817976946)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:41.984291 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8e491-a165-4ab3-8a01-00eaea692003 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:41.985899 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 79/154] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:41 2022] GET /identity/v3/users/2831c6ac26a24f1a8abde28817976946 => generated 283 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:41.986321 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:41.986659 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8e491-a165-4ab3-8a01-00eaea692003 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:42.015666 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:42.061036 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0a5ff-edb8-4cc3-867f-0b74db1e124f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:42.088035 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8e491-a165-4ab3-8a01-00eaea692003 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:42.096388 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658cae9-95e4-42f9-a065-4a893e57ba80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:42.096944 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658cae9-95e4-42f9-a065-4a893e57ba80 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:42.097474 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658cae9-95e4-42f9-a065-4a893e57ba80 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:42.097603 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658cae9-95e4-42f9-a065-4a893e57ba80 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:42.098144 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658cae9-95e4-42f9-a065-4a893e57ba80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:42.099557 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658cae9-95e4-42f9-a065-4a893e57ba80 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:42.119611 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 76/155] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 31 12:19:41 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:19:42.119611 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658cae9-95e4-42f9-a065-4a893e57ba80 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:42.127017 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83622579-4417-4c5b-9eb5-c77a89433d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:42.127677 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83622579-4417-4c5b-9eb5-c77a89433d8f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:42.127956 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83622579-4417-4c5b-9eb5-c77a89433d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:42.128223 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83622579-4417-4c5b-9eb5-c77a89433d8f None admin] PATH_INFO: `/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:42.129463 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83622579-4417-4c5b-9eb5-c77a89433d8f None admin] RBAC: Authorizing `identity:get_project(project_id=acf5fd24975f479ea610ce5bcefe7dcc)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:42.131052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83622579-4417-4c5b-9eb5-c77a89433d8f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:42.132815 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 80/156] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:19:41 2022] GET /identity/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:42.140010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83622579-4417-4c5b-9eb5-c77a89433d8f None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:42.226406 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:42.245936 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658cae9-95e4-42f9-a065-4a893e57ba80 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:42.246945 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:42.254489 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83622579-4417-4c5b-9eb5-c77a89433d8f None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:42.284602 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34f79d-6695-46e9-bc8b-51b436196e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:42.285754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34f79d-6695-46e9-bc8b-51b436196e8d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:42.286677 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34f79d-6695-46e9-bc8b-51b436196e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:42.287411 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34f79d-6695-46e9-bc8b-51b436196e8d None admin] PATH_INFO: `/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:42.288715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34f79d-6695-46e9-bc8b-51b436196e8d None admin] RBAC: Authorizing `identity:get_project(project_id=acf5fd24975f479ea610ce5bcefe7dcc)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:42.292396 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34f79d-6695-46e9-bc8b-51b436196e8d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:42.292533 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abc80e-65c0-4536-9de1-79d8c3170f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:42.292652 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 77/157] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:19:42 2022] GET /identity/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:42.292732 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abc80e-65c0-4536-9de1-79d8c3170f52 None admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:42.292732 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abc80e-65c0-4536-9de1-79d8c3170f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:42.292990 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abc80e-65c0-4536-9de1-79d8c3170f52 None admin] PATH_INFO: `/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc/users/2831c6ac26a24f1a8abde28817976946/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:42.295198 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abc80e-65c0-4536-9de1-79d8c3170f52 None admin] RBAC: Authorizing `identity:create_grant(project_id=acf5fd24975f479ea610ce5bcefe7dcc, user_id=2831c6ac26a24f1a8abde28817976946, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:42.296682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abc80e-65c0-4536-9de1-79d8c3170f52 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:42.298287 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34f79d-6695-46e9-bc8b-51b436196e8d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:42.315476 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 81/158] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:19:42 2022] PUT /identity/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc/users/2831c6ac26a24f1a8abde28817976946/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:19:42.422432 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34f79d-6695-46e9-bc8b-51b436196e8d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:42.461534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe37095-99d3-4d36-90b1-9b8d52c072a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:42.462205 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe37095-99d3-4d36-90b1-9b8d52c072a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:42.462486 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe37095-99d3-4d36-90b1-9b8d52c072a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:42.462807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe37095-99d3-4d36-90b1-9b8d52c072a6 None admin] PATH_INFO: `/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc/users/2831c6ac26a24f1a8abde28817976946/roles/209186498dcb49a693401b009f73812e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:42.465665 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe37095-99d3-4d36-90b1-9b8d52c072a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=acf5fd24975f479ea610ce5bcefe7dcc, user_id=2831c6ac26a24f1a8abde28817976946, role_id=209186498dcb49a693401b009f73812e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:42.467155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe37095-99d3-4d36-90b1-9b8d52c072a6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:42.485341 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 78/159] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:19:42 2022] PUT /identity/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc/users/2831c6ac26a24f1a8abde28817976946/roles/209186498dcb49a693401b009f73812e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:19:44.478095 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c52f3-a522-4253-94df-33eab6d54375 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:44.478641 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c52f3-a522-4253-94df-33eab6d54375 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:44.478641 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c52f3-a522-4253-94df-33eab6d54375 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:44.480265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 82/160] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:44.485805 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9e33d-f14e-497f-9583-dcf6a375e1b9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:44.486206 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9e33d-f14e-497f-9583-dcf6a375e1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:44.486393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9e33d-f14e-497f-9583-dcf6a375e1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:44.502699 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831ac5a-11a5-46e4-8477-c78aa9cf6f54 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:44.502979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831ac5a-11a5-46e4-8477-c78aa9cf6f54 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:44.503254 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831ac5a-11a5-46e4-8477-c78aa9cf6f54 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:44.504623 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 83/161] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:19:44.510393 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271af59-20b9-45af-8a1f-3ad87ae193c3 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:44.511214 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271af59-20b9-45af-8a1f-3ad87ae193c3 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:44.511490 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271af59-20b9-45af-8a1f-3ad87ae193c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:44.512936 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-05d9e33d-f14e-497f-9583-dcf6a375e1b9 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:44.514472 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-05d9e33d-f14e-497f-9583-dcf6a375e1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:44.524416 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:44.533025 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-8271af59-20b9-45af-8a1f-3ad87ae193c3 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:44.534294 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8271af59-20b9-45af-8a1f-3ad87ae193c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:44.595903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 79/162] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:44.597460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20618eb3-1356-4e7d-b51a-c13a272480e2 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:44.597748 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20618eb3-1356-4e7d-b51a-c13a272480e2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:44.598019 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20618eb3-1356-4e7d-b51a-c13a272480e2 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:44.599260 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 80/163] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:44.607325 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6241e6a-85c0-42b8-95ce-5bf63ab7f1f4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:44.607605 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6241e6a-85c0-42b8-95ce-5bf63ab7f1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:44.607877 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6241e6a-85c0-42b8-95ce-5bf63ab7f1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:44.622173 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 84/164] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 12:19:44.631385 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1df90a-0263-4f52-9d2b-c1e5daf5a6bc None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:44.631669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1df90a-0263-4f52-9d2b-c1e5daf5a6bc None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:44.631948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1df90a-0263-4f52-9d2b-c1e5daf5a6bc None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:44.633405 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 85/165] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:19:44.633635 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b6241e6a-85c0-42b8-95ce-5bf63ab7f1f4 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:44.637451 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b6241e6a-85c0-42b8-95ce-5bf63ab7f1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:44.639442 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8545a0a-97fe-4ae3-b3e6-ad8bf22a4dd7 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:44.639823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8545a0a-97fe-4ae3-b3e6-ad8bf22a4dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:44.640213 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8545a0a-97fe-4ae3-b3e6-ad8bf22a4dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:44.658526 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d8545a0a-97fe-4ae3-b3e6-ad8bf22a4dd7 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:44.659929 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d8545a0a-97fe-4ae3-b3e6-ad8bf22a4dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:44.703614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 81/166] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:44.740434 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 86/167] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 12:19:44.865246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6241e6a-85c0-42b8-95ce-5bf63ab7f1f4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:44.898390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8545a0a-97fe-4ae3-b3e6-ad8bf22a4dd7 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:44.921954 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:44.973526 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:44.982686 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6241e6a-85c0-42b8-95ce-5bf63ab7f1f4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:45.017944 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b01782-7506-45d0-b30d-a211be2e8e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:45.018511 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b01782-7506-45d0-b30d-a211be2e8e2d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:45.018795 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b01782-7506-45d0-b30d-a211be2e8e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:45.019073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b01782-7506-45d0-b30d-a211be2e8e2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:45.028185 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8545a0a-97fe-4ae3-b3e6-ad8bf22a4dd7 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:45.029094 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b01782-7506-45d0-b30d-a211be2e8e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:45.033898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-39b01782-7506-45d0-b30d-a211be2e8e2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:19:45.033898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:45.033898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:45.033898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:45.033898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:45.033898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:45.033898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:45.033898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:45.033898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:45.033898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:45.033898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:45.033898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:45.033898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:45.033898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:45.033898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:45.033898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:45.034757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:45.034757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:45.034757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:45.034757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:45.034757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:45.034757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:45.034757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:45.034757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:45.034757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:45.034757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:45.034757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:45.034757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:45.034757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:45.034757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:45.034757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:45.034757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:45.035540 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:45.035540 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:45.035540 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:45.035540 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:45.035540 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:45.035540 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:45.035540 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:45.035540 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:45.035540 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:45.035540 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:45.035540 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:19:45.035540 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:19:45.035540 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 82/168] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:19:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:19:45.036274 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b01782-7506-45d0-b30d-a211be2e8e2d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:45.064412 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7924c-4404-4bf7-8a04-1c54e04b5e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:45.065048 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7924c-4404-4bf7-8a04-1c54e04b5e6a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:45.065357 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7924c-4404-4bf7-8a04-1c54e04b5e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:45.065627 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7924c-4404-4bf7-8a04-1c54e04b5e6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:45.066727 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7924c-4404-4bf7-8a04-1c54e04b5e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:45.068164 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7924c-4404-4bf7-8a04-1c54e04b5e6a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:45.069761 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 87/169] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:19:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:45.069761 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7924c-4404-4bf7-8a04-1c54e04b5e6a None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:45.141821 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b01782-7506-45d0-b30d-a211be2e8e2d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:45.152603 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:45.169887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7924c-4404-4bf7-8a04-1c54e04b5e6a None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:45.172260 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:45.177838 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c2871-0a12-480f-b1f2-04d7dce7c2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:45.178470 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c2871-0a12-480f-b1f2-04d7dce7c2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:45.178751 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c2871-0a12-480f-b1f2-04d7dce7c2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:45.179022 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c2871-0a12-480f-b1f2-04d7dce7c2b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:45.189356 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c2871-0a12-480f-b1f2-04d7dce7c2b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:45.194182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-297c2871-0a12-480f-b1f2-04d7dce7c2b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:19:45.194182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:45.194182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:45.194182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:45.194182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:45.194182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:45.194182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:45.194182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:45.194182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:45.194182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:45.194182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:45.194182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:45.194182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:45.194182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:45.194182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:45.194182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:45.195252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:45.195252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:45.195252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:45.195252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:45.195252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:45.195252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:45.195252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:45.195252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:45.195252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:45.195252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:45.195252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:45.195252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:45.195252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:45.195252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:45.195252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:45.195252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:45.196155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:45.196155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:45.196155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:45.196155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:45.196155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:45.196155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:45.196155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:45.196155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:45.196155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:45.196155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:45.196155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:19:45.196155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:19:45.196155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 83/170] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 31 12:19:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:19:45.200751 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c2871-0a12-480f-b1f2-04d7dce7c2b0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:45.203954 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28254e63-d952-4a5f-a9d6-14f22d0c669c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:45.204575 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28254e63-d952-4a5f-a9d6-14f22d0c669c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:45.204851 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28254e63-d952-4a5f-a9d6-14f22d0c669c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:45.205146 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28254e63-d952-4a5f-a9d6-14f22d0c669c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:45.215094 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28254e63-d952-4a5f-a9d6-14f22d0c669c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:45.219952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-28254e63-d952-4a5f-a9d6-14f22d0c669c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 12:19:45.219952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:45.219952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:45.219952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:45.219952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:45.219952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:45.219952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:45.219952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:45.219952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:45.219952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:45.219952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:45.219952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:45.219952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:45.219952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:45.219952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:45.219952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:45.220856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:45.220856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:45.220856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:45.220856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:45.220856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:45.220856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:45.220856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:45.220856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:45.220856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:45.220856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:45.220856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:45.220856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:45.220856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:45.220856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:45.220856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:45.220856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:45.221962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:45.221962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:45.221962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:45.221962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:45.221962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:45.221962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:45.221962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:45.221962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:45.221962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:45.221962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:45.221962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 12:19:45.221962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:19:45.221962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 88/171] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 31 12:19:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:19:45.221962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28254e63-d952-4a5f-a9d6-14f22d0c669c None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:45.301726 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c2871-0a12-480f-b1f2-04d7dce7c2b0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:45.320341 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28254e63-d952-4a5f-a9d6-14f22d0c669c None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:45.334881 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1597da-42cd-49c4-8ec2-f86ac7f263bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:45.335478 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1597da-42cd-49c4-8ec2-f86ac7f263bd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:45.335762 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1597da-42cd-49c4-8ec2-f86ac7f263bd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:45.336035 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1597da-42cd-49c4-8ec2-f86ac7f263bd None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:45.336697 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1597da-42cd-49c4-8ec2-f86ac7f263bd None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:45.337001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1597da-42cd-49c4-8ec2-f86ac7f263bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:45.338391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1597da-42cd-49c4-8ec2-f86ac7f263bd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:45.346677 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 84/172] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 31 12:19:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:45.350310 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1597da-42cd-49c4-8ec2-f86ac7f263bd None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:45.353249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc8687-8642-4000-a5bf-de70af309770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:45.353850 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc8687-8642-4000-a5bf-de70af309770 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:45.354129 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc8687-8642-4000-a5bf-de70af309770 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:45.354918 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc8687-8642-4000-a5bf-de70af309770 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:45.355566 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc8687-8642-4000-a5bf-de70af309770 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:45.356997 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc8687-8642-4000-a5bf-de70af309770 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:45.374015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:45.393134 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 89/173] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 31 12:19:45 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:19:45.393134 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc8687-8642-4000-a5bf-de70af309770 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:45.409305 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:45.465232 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1597da-42cd-49c4-8ec2-f86ac7f263bd None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:45.501599 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc8687-8642-4000-a5bf-de70af309770 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:45.503462 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2f010-85eb-42d8-a5e7-1ea3f193e5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:45.504172 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2f010-85eb-42d8-a5e7-1ea3f193e5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:45.504521 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2f010-85eb-42d8-a5e7-1ea3f193e5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:45.504890 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2f010-85eb-42d8-a5e7-1ea3f193e5b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:45.505693 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2f010-85eb-42d8-a5e7-1ea3f193e5b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:45.506000 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2f010-85eb-42d8-a5e7-1ea3f193e5b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:45.507420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2f010-85eb-42d8-a5e7-1ea3f193e5b7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:45.516770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 85/174] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:19:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:45.518898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2f010-85eb-42d8-a5e7-1ea3f193e5b7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:45.540208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc8f23-ec0b-48f6-b7a1-7f10eb194c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:45.540832 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc8f23-ec0b-48f6-b7a1-7f10eb194c65 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:45.541129 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc8f23-ec0b-48f6-b7a1-7f10eb194c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:45.541412 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc8f23-ec0b-48f6-b7a1-7f10eb194c65 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:45.542668 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc8f23-ec0b-48f6-b7a1-7f10eb194c65 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:45.543073 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc8f23-ec0b-48f6-b7a1-7f10eb194c65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:45.544371 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc8f23-ec0b-48f6-b7a1-7f10eb194c65 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:45.554509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 90/175] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:19:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:45.555135 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc8f23-ec0b-48f6-b7a1-7f10eb194c65 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:45.622632 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:45.649642 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2f010-85eb-42d8-a5e7-1ea3f193e5b7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:45.670369 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:45.670607 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc8f23-ec0b-48f6-b7a1-7f10eb194c65 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:45.701758 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097caf6-2031-4df3-8164-4f5284f7aec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:45.702425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097caf6-2031-4df3-8164-4f5284f7aec2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:45.702684 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097caf6-2031-4df3-8164-4f5284f7aec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:45.703282 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097caf6-2031-4df3-8164-4f5284f7aec2 None admin] PATH_INFO: `/v3/users/f9a2cad20d154206a3893543299878f9` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:45.719157 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef25df9-b769-43da-ad90-79319cce54d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:45.720177 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef25df9-b769-43da-ad90-79319cce54d8 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:45.720370 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef25df9-b769-43da-ad90-79319cce54d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:45.720604 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef25df9-b769-43da-ad90-79319cce54d8 None admin] PATH_INFO: `/v3/users/2831c6ac26a24f1a8abde28817976946` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:45.720699 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097caf6-2031-4df3-8164-4f5284f7aec2 None admin] RBAC: Authorizing `identity:get_user(user_id=f9a2cad20d154206a3893543299878f9)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:45.723743 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097caf6-2031-4df3-8164-4f5284f7aec2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:45.723871 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef25df9-b769-43da-ad90-79319cce54d8 None admin] RBAC: Authorizing `identity:get_user(user_id=2831c6ac26a24f1a8abde28817976946)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:45.724036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef25df9-b769-43da-ad90-79319cce54d8 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:45.724125 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 86/176] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:45 2022] GET /identity/v3/users/f9a2cad20d154206a3893543299878f9 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:45.724892 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097caf6-2031-4df3-8164-4f5284f7aec2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:45.726076 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 91/177] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:45 2022] GET /identity/v3/users/2831c6ac26a24f1a8abde28817976946 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:45.731559 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef25df9-b769-43da-ad90-79319cce54d8 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:45.848205 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097caf6-2031-4df3-8164-4f5284f7aec2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:45.849557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef25df9-b769-43da-ad90-79319cce54d8 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:45.879086 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:45.886973 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc70acf-bdd9-4797-836a-d0fef5101cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:45.887885 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc70acf-bdd9-4797-836a-d0fef5101cca None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:45.888432 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc70acf-bdd9-4797-836a-d0fef5101cca None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:45.888918 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc70acf-bdd9-4797-836a-d0fef5101cca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:45.891434 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6323d9b-dfd7-41d1-b3cf-d37ea8af8553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:45.892096 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6323d9b-dfd7-41d1-b3cf-d37ea8af8553 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:45.892614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6323d9b-dfd7-41d1-b3cf-d37ea8af8553 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:45.892895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6323d9b-dfd7-41d1-b3cf-d37ea8af8553 None admin] PATH_INFO: `/v3/users/2831c6ac26a24f1a8abde28817976946` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:45.894987 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6323d9b-dfd7-41d1-b3cf-d37ea8af8553 None admin] RBAC: Authorizing `identity:get_user(user_id=2831c6ac26a24f1a8abde28817976946)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:45.896428 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6323d9b-dfd7-41d1-b3cf-d37ea8af8553 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:45.898220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 87/178] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:45 2022] GET /identity/v3/users/2831c6ac26a24f1a8abde28817976946 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:45.898793 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6323d9b-dfd7-41d1-b3cf-d37ea8af8553 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:45.955526 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:45.969047 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc70acf-bdd9-4797-836a-d0fef5101cca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:45.970531 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc70acf-bdd9-4797-836a-d0fef5101cca None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:46.021746 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6323d9b-dfd7-41d1-b3cf-d37ea8af8553 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:46.072732 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946007e-0474-4f1e-a5f8-dc406d48cebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:46.074019 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946007e-0474-4f1e-a5f8-dc406d48cebe None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:46.074296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946007e-0474-4f1e-a5f8-dc406d48cebe None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:46.074661 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946007e-0474-4f1e-a5f8-dc406d48cebe None admin] PATH_INFO: `/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:46.076164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946007e-0474-4f1e-a5f8-dc406d48cebe None admin] RBAC: Authorizing `identity:get_project(project_id=acf5fd24975f479ea610ce5bcefe7dcc)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:46.077877 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946007e-0474-4f1e-a5f8-dc406d48cebe None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:46.079763 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 88/179] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:19:45 2022] GET /identity/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:46.080492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946007e-0474-4f1e-a5f8-dc406d48cebe None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:46.083121 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 92/180] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:19:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 31 12:19:46.085390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc70acf-bdd9-4797-836a-d0fef5101cca None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:46.116103 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:46.189475 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc70acf-bdd9-4797-836a-d0fef5101cca None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:46.209336 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946007e-0474-4f1e-a5f8-dc406d48cebe None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:46.222856 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:46.226181 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117bfd0-a326-49f0-a311-d0fcdac230a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:46.227113 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117bfd0-a326-49f0-a311-d0fcdac230a5 None admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:46.227780 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117bfd0-a326-49f0-a311-d0fcdac230a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:46.228447 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117bfd0-a326-49f0-a311-d0fcdac230a5 None admin] PATH_INFO: `/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc/users/f9a2cad20d154206a3893543299878f9/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:46.230611 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117bfd0-a326-49f0-a311-d0fcdac230a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=acf5fd24975f479ea610ce5bcefe7dcc, user_id=f9a2cad20d154206a3893543299878f9, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:46.232197 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117bfd0-a326-49f0-a311-d0fcdac230a5 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:46.248789 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 93/181] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:19:46 2022] PUT /identity/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc/users/f9a2cad20d154206a3893543299878f9/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:19:46.249901 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117bfd0-a326-49f0-a311-d0fcdac230a5 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:46.261433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac0417-689b-49f0-b806-6d4fb994ca8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:46.262374 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac0417-689b-49f0-b806-6d4fb994ca8b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:46.264897 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac0417-689b-49f0-b806-6d4fb994ca8b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:46.265405 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac0417-689b-49f0-b806-6d4fb994ca8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:46.382326 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac0417-689b-49f0-b806-6d4fb994ca8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:46.384419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac0417-689b-49f0-b806-6d4fb994ca8b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:46.468694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:46.483749 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117bfd0-a326-49f0-a311-d0fcdac230a5 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:46.505832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 89/182] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:19:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 12:19:46.512917 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac0417-689b-49f0-b806-6d4fb994ca8b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:46.524663 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e5aa2-5611-4823-b865-a6c8f00d87eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:46.525331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e5aa2-5611-4823-b865-a6c8f00d87eb None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:46.525586 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:46.525711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e5aa2-5611-4823-b865-a6c8f00d87eb None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:46.525866 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e5aa2-5611-4823-b865-a6c8f00d87eb None admin] PATH_INFO: `/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:46.527837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e5aa2-5611-4823-b865-a6c8f00d87eb None admin] RBAC: Authorizing `identity:get_project(project_id=acf5fd24975f479ea610ce5bcefe7dcc)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:46.529959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e5aa2-5611-4823-b865-a6c8f00d87eb None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:46.531607 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 94/183] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:19:46 2022] GET /identity/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:46.539317 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e5aa2-5611-4823-b865-a6c8f00d87eb None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:46.640091 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac0417-689b-49f0-b806-6d4fb994ca8b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:46.678761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2405b-fcf0-430a-bb0b-5908cbe2341f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:46.679392 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2405b-fcf0-430a-bb0b-5908cbe2341f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:46.679670 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2405b-fcf0-430a-bb0b-5908cbe2341f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:46.679937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2405b-fcf0-430a-bb0b-5908cbe2341f None admin] PATH_INFO: `/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:46.681054 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2405b-fcf0-430a-bb0b-5908cbe2341f None admin] RBAC: Authorizing `identity:get_project(project_id=acf5fd24975f479ea610ce5bcefe7dcc)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:46.683720 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2405b-fcf0-430a-bb0b-5908cbe2341f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:46.685489 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 90/184] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:19:46 2022] GET /identity/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:19:46.691272 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2405b-fcf0-430a-bb0b-5908cbe2341f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:46.774529 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:46.776793 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e5aa2-5611-4823-b865-a6c8f00d87eb None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:46.798887 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2405b-fcf0-430a-bb0b-5908cbe2341f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:46.836037 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed5733-7b20-43a4-858a-197a2f00f9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:46.836665 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed5733-7b20-43a4-858a-197a2f00f9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:46.836944 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed5733-7b20-43a4-858a-197a2f00f9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:46.837252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed5733-7b20-43a4-858a-197a2f00f9a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:46.837993 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed5733-7b20-43a4-858a-197a2f00f9a9 None admin] RBAC: Adding query filter params (role.id=209186498dcb49a693401b009f73812e, scope.project.id=acf5fd24975f479ea610ce5bcefe7dcc, user.id=2831c6ac26a24f1a8abde28817976946) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:46.838304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed5733-7b20-43a4-858a-197a2f00f9a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:46.840682 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed5733-7b20-43a4-858a-197a2f00f9a9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:46.847124 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 91/185] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:19:46 2022] GET /identity/v3/role_assignments?user.id=2831c6ac26a24f1a8abde28817976946&scope.project.id=acf5fd24975f479ea610ce5bcefe7dcc&role.id=209186498dcb49a693401b009f73812e => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:19:46.856379 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f70a1-1949-4c8f-9128-3073fe20b341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:46.857021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f70a1-1949-4c8f-9128-3073fe20b341 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:46.857435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f70a1-1949-4c8f-9128-3073fe20b341 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:46.857712 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f70a1-1949-4c8f-9128-3073fe20b341 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:46.858543 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f70a1-1949-4c8f-9128-3073fe20b341 None admin] RBAC: Adding query filter params (role.id=e1b3a811029244d2a7e2664cd3246eec, scope.project.id=acf5fd24975f479ea610ce5bcefe7dcc, user.id=2831c6ac26a24f1a8abde28817976946) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:46.858913 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f70a1-1949-4c8f-9128-3073fe20b341 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:46.860448 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f70a1-1949-4c8f-9128-3073fe20b341 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:46.867428 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 95/186] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:19:46 2022] GET /identity/v3/role_assignments?user.id=2831c6ac26a24f1a8abde28817976946&scope.project.id=acf5fd24975f479ea610ce5bcefe7dcc&role.id=e1b3a811029244d2a7e2664cd3246eec => generated 608 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:47.834701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43353a38-a6ff-4b82-9675-9a610539b82f None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:47.835220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43353a38-a6ff-4b82-9675-9a610539b82f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:47.835220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43353a38-a6ff-4b82-9675-9a610539b82f None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:47.836743 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 92/187] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:47.841768 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0366ab-bfa7-46e6-b2ca-f8ad7333bcd2 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:47.842258 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0366ab-bfa7-46e6-b2ca-f8ad7333bcd2 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:47.843191 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702efe2-196c-4e42-ae1e-2a907da83c52 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:47.843466 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702efe2-196c-4e42-ae1e-2a907da83c52 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:47.843627 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0366ab-bfa7-46e6-b2ca-f8ad7333bcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:47.843718 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702efe2-196c-4e42-ae1e-2a907da83c52 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:47.845077 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 93/188] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:19:47.849755 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf6ab9-3e4e-4aaf-9aa7-d0de1ba7c1d0 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:47.850042 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf6ab9-3e4e-4aaf-9aa7-d0de1ba7c1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:47.850314 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf6ab9-3e4e-4aaf-9aa7-d0de1ba7c1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:47.861483 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-6e0366ab-bfa7-46e6-b2ca-f8ad7333bcd2 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:47.862653 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6e0366ab-bfa7-46e6-b2ca-f8ad7333bcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:47.867812 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-cdaf6ab9-3e4e-4aaf-9aa7-d0de1ba7c1d0 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:47.868980 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cdaf6ab9-3e4e-4aaf-9aa7-d0de1ba7c1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:47.879784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:47.934731 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 96/189] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:47.938563 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 94/190] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 12:19:48.204853 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0366ab-bfa7-46e6-b2ca-f8ad7333bcd2 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:48.207434 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf6ab9-3e4e-4aaf-9aa7-d0de1ba7c1d0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:48.288759 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:48.308675 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0366ab-bfa7-46e6-b2ca-f8ad7333bcd2 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:48.321573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf6ab9-3e4e-4aaf-9aa7-d0de1ba7c1d0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:48.344583 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff819f-e3d0-42d2-9d8d-8d799a6a3853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:48.345339 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff819f-e3d0-42d2-9d8d-8d799a6a3853 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:48.345617 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff819f-e3d0-42d2-9d8d-8d799a6a3853 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:48.345891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff819f-e3d0-42d2-9d8d-8d799a6a3853 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:48.346975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff819f-e3d0-42d2-9d8d-8d799a6a3853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:48.348625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff819f-e3d0-42d2-9d8d-8d799a6a3853 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:48.350504 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 97/191] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:19:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:48.355583 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fe144-67a8-4e46-b618-8fe547794fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:48.355792 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff819f-e3d0-42d2-9d8d-8d799a6a3853 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:48.356280 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fe144-67a8-4e46-b618-8fe547794fdb None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:48.356568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fe144-67a8-4e46-b618-8fe547794fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:48.356845 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fe144-67a8-4e46-b618-8fe547794fdb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:48.367810 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fe144-67a8-4e46-b618-8fe547794fdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:48.373229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-170fe144-67a8-4e46-b618-8fe547794fdb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 12:19:48.373229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:48.373229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:48.373229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:48.373229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:48.373229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:48.373229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:48.373229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:48.373229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:48.373229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:48.373229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:48.373229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:48.373229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:48.373229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:48.373229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:48.373229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:48.374078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:48.374078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:48.374078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:48.374078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:48.374078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:48.374078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:48.374078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:48.374078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:48.374078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:48.374078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:48.374078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:48.374078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:48.374078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:48.374078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:48.374078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:48.374078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:48.374860 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:48.374860 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:48.374860 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:48.374860 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:48.374860 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:48.374860 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:48.374860 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:48.374860 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:48.374860 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:48.374860 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:48.374860 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 12:19:48.374860 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:19:48.374860 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 95/192] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:19:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:19:48.379858 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fe144-67a8-4e46-b618-8fe547794fdb None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:48.380314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:48.463383 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff819f-e3d0-42d2-9d8d-8d799a6a3853 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:48.483843 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fe144-67a8-4e46-b618-8fe547794fdb None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:48.499375 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882087d1-f534-467b-897d-25f9e4979af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:48.499979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882087d1-f534-467b-897d-25f9e4979af9 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:48.500255 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882087d1-f534-467b-897d-25f9e4979af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:48.500524 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882087d1-f534-467b-897d-25f9e4979af9 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:48.501197 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882087d1-f534-467b-897d-25f9e4979af9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:48.502622 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882087d1-f534-467b-897d-25f9e4979af9 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:48.516263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:48.522212 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87fdc7-1413-4329-af65-6188c4a01250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:48.522880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87fdc7-1413-4329-af65-6188c4a01250 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:48.523169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87fdc7-1413-4329-af65-6188c4a01250 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:48.523443 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87fdc7-1413-4329-af65-6188c4a01250 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:48.524146 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87fdc7-1413-4329-af65-6188c4a01250 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:48.524450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87fdc7-1413-4329-af65-6188c4a01250 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:48.525943 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87fdc7-1413-4329-af65-6188c4a01250 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:48.528476 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 98/193] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 31 12:19:48 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:19:48.545668 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 96/194] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 31 12:19:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:19:48.551609 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882087d1-f534-467b-897d-25f9e4979af9 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:48.639256 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:48.646665 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b04215-885c-4887-bc64-7dba9dd65056 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:48.646974 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b04215-885c-4887-bc64-7dba9dd65056 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:48.647250 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b04215-885c-4887-bc64-7dba9dd65056 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:48.648634 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 97/195] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:48.654553 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20441d01-182d-4107-b426-29ac0e45f252 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:48.654823 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20441d01-182d-4107-b426-29ac0e45f252 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:48.655097 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20441d01-182d-4107-b426-29ac0e45f252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:48.675047 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882087d1-f534-467b-897d-25f9e4979af9 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:48.676371 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-20441d01-182d-4107-b426-29ac0e45f252 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:48.677637 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-20441d01-182d-4107-b426-29ac0e45f252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:48.720846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a6415-167d-4683-81e5-fea208abfe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:48.721555 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a6415-167d-4683-81e5-fea208abfe09 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:48.721827 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a6415-167d-4683-81e5-fea208abfe09 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:48.722094 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a6415-167d-4683-81e5-fea208abfe09 None admin] PATH_INFO: `/v3/users/987810ff2859404c945b4a5b4bf3f3c7` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:48.737554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a6415-167d-4683-81e5-fea208abfe09 None admin] RBAC: Authorizing `identity:get_user(user_id=987810ff2859404c945b4a5b4bf3f3c7)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:48.739642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a6415-167d-4683-81e5-fea208abfe09 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:48.742331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 99/196] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:48 2022] GET /identity/v3/users/987810ff2859404c945b4a5b4bf3f3c7 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:48.747364 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a6415-167d-4683-81e5-fea208abfe09 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:48.757193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 98/197] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:48.855085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a6415-167d-4683-81e5-fea208abfe09 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:48.891543 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06af128-b42f-451e-8827-257f097f6367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:48.892463 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06af128-b42f-451e-8827-257f097f6367 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:48.892941 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06af128-b42f-451e-8827-257f097f6367 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:48.893406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06af128-b42f-451e-8827-257f097f6367 None admin] PATH_INFO: `/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:48.894692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06af128-b42f-451e-8827-257f097f6367 None admin] RBAC: Authorizing `identity:get_project(project_id=acf5fd24975f479ea610ce5bcefe7dcc)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:48.896311 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06af128-b42f-451e-8827-257f097f6367 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:48.898440 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 100/198] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:19:48 2022] GET /identity/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:48.904064 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20441d01-182d-4107-b426-29ac0e45f252 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:49.005614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20441d01-182d-4107-b426-29ac0e45f252 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:49.021166 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06af128-b42f-451e-8827-257f097f6367 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:49.029967 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:49.030649 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:49.044534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa13046-179f-4718-ab37-58e4c5033a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:49.045642 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa13046-179f-4718-ab37-58e4c5033a2f None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:49.045926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa13046-179f-4718-ab37-58e4c5033a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:49.046203 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa13046-179f-4718-ab37-58e4c5033a2f None admin] PATH_INFO: `/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc/users/987810ff2859404c945b4a5b4bf3f3c7/roles/f352dab941ec48a589c0f614999dbeb3` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:49.049262 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa13046-179f-4718-ab37-58e4c5033a2f None admin] RBAC: Authorizing `identity:create_grant(project_id=acf5fd24975f479ea610ce5bcefe7dcc, user_id=987810ff2859404c945b4a5b4bf3f3c7, role_id=f352dab941ec48a589c0f614999dbeb3)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:49.050855 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa13046-179f-4718-ab37-58e4c5033a2f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:49.067285 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 99/199] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:19:48 2022] PUT /identity/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc/users/987810ff2859404c945b4a5b4bf3f3c7/roles/f352dab941ec48a589c0f614999dbeb3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:19:49.147362 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06af128-b42f-451e-8827-257f097f6367 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:49.189037 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358346e-c558-46ef-93a1-97a857afe12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:49.189704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358346e-c558-46ef-93a1-97a857afe12e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:49.189988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358346e-c558-46ef-93a1-97a857afe12e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:49.190260 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358346e-c558-46ef-93a1-97a857afe12e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:49.207980 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358346e-c558-46ef-93a1-97a857afe12e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:49.213151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-0358346e-c558-46ef-93a1-97a857afe12e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:19:49.213151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:49.213151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:49.213151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:49.213151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:49.213151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:49.213151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:49.213151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:49.213151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:49.213151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:49.213151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:49.213151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:49.213151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:49.213151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:49.213151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:49.213151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:49.214620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:49.214620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:49.214620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:49.214620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:49.214620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:49.214620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:49.214620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:49.214620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:49.214620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:49.214620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:49.214620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:49.214620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:49.214620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:49.214620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:49.214620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:49.214620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:49.215400 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:49.215400 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:49.215400 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:49.215400 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:49.215400 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:49.215400 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:49.215400 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:49.215400 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:49.215400 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:49.215400 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:49.215400 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:19:49.215400 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:19:49.216756 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 101/200] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:19:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:19:49.223416 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa13046-179f-4718-ab37-58e4c5033a2f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:49.337290 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa13046-179f-4718-ab37-58e4c5033a2f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:49.375644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153dc24-e357-484f-9993-219acbd1306e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:49.376321 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153dc24-e357-484f-9993-219acbd1306e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:49.376604 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153dc24-e357-484f-9993-219acbd1306e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:49.376876 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153dc24-e357-484f-9993-219acbd1306e None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:49.377590 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153dc24-e357-484f-9993-219acbd1306e None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:49.377894 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153dc24-e357-484f-9993-219acbd1306e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:49.379265 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153dc24-e357-484f-9993-219acbd1306e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:49.388010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 100/201] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 31 12:19:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:49.394182 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358346e-c558-46ef-93a1-97a857afe12e None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:49.468388 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:49.512579 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358346e-c558-46ef-93a1-97a857afe12e None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:49.550925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea4eee-fc5b-40f5-8dde-74b2d5f8610c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:49.551565 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea4eee-fc5b-40f5-8dde-74b2d5f8610c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:49.551845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea4eee-fc5b-40f5-8dde-74b2d5f8610c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:49.552122 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea4eee-fc5b-40f5-8dde-74b2d5f8610c None admin] PATH_INFO: `/v3/users/f9a2cad20d154206a3893543299878f9` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:49.553288 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea4eee-fc5b-40f5-8dde-74b2d5f8610c None admin] RBAC: Authorizing `identity:get_user(user_id=f9a2cad20d154206a3893543299878f9)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:49.555195 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea4eee-fc5b-40f5-8dde-74b2d5f8610c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:49.557444 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 102/202] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:49 2022] GET /identity/v3/users/f9a2cad20d154206a3893543299878f9 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:49.563099 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153dc24-e357-484f-9993-219acbd1306e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:49.615251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:49.676875 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153dc24-e357-484f-9993-219acbd1306e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:49.712341 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7427f45-3c44-49c0-8f6e-33c68a84b04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:49.713398 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7427f45-3c44-49c0-8f6e-33c68a84b04c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:49.714415 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7427f45-3c44-49c0-8f6e-33c68a84b04c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:49.714904 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7427f45-3c44-49c0-8f6e-33c68a84b04c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:49.783649 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7427f45-3c44-49c0-8f6e-33c68a84b04c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:49.785467 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7427f45-3c44-49c0-8f6e-33c68a84b04c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:49.833472 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:49.893354 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 101/203] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:19:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 12:19:49.898208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea4eee-fc5b-40f5-8dde-74b2d5f8610c None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:50.001499 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea4eee-fc5b-40f5-8dde-74b2d5f8610c None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:50.031132 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:50.038333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a68778-e1ed-4c44-a669-c02826b0a115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:50.039307 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a68778-e1ed-4c44-a669-c02826b0a115 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:50.039796 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a68778-e1ed-4c44-a669-c02826b0a115 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:50.040264 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a68778-e1ed-4c44-a669-c02826b0a115 None admin] PATH_INFO: `/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:50.042215 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a68778-e1ed-4c44-a669-c02826b0a115 None admin] RBAC: Authorizing `identity:get_project(project_id=acf5fd24975f479ea610ce5bcefe7dcc)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:50.043851 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a68778-e1ed-4c44-a669-c02826b0a115 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:50.050650 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 103/204] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:19:49 2022] GET /identity/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:50.052224 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7427f45-3c44-49c0-8f6e-33c68a84b04c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:50.167815 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7427f45-3c44-49c0-8f6e-33c68a84b04c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:50.202070 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14143ae4-b947-4520-bde0-e16d53633c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:50.202668 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14143ae4-b947-4520-bde0-e16d53633c29 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:50.202945 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14143ae4-b947-4520-bde0-e16d53633c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:50.203216 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14143ae4-b947-4520-bde0-e16d53633c29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:50.203937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14143ae4-b947-4520-bde0-e16d53633c29 None admin] RBAC: Adding query filter params (role.id=b7c6f84505634b978e58bb6f62bd88a0, scope.project.id=acf5fd24975f479ea610ce5bcefe7dcc, user.id=f9a2cad20d154206a3893543299878f9) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:50.204240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14143ae4-b947-4520-bde0-e16d53633c29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:50.205700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14143ae4-b947-4520-bde0-e16d53633c29 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:50.211537 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 102/205] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:19:50 2022] GET /identity/v3/role_assignments?user.id=f9a2cad20d154206a3893543299878f9&scope.project.id=acf5fd24975f479ea610ce5bcefe7dcc&role.id=b7c6f84505634b978e58bb6f62bd88a0 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:50.920200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86aa26-2ed8-4ee6-ac8a-83c03fd148c1 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:50.920722 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86aa26-2ed8-4ee6-ac8a-83c03fd148c1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:50.920722 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86aa26-2ed8-4ee6-ac8a-83c03fd148c1 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:50.922422 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 104/206] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:50.927502 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5bd74-2edf-48d1-939f-76636e156cfd None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:50.927795 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5bd74-2edf-48d1-939f-76636e156cfd None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:50.928069 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5bd74-2edf-48d1-939f-76636e156cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:50.947124 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c0e5bd74-2edf-48d1-939f-76636e156cfd None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:50.948855 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c0e5bd74-2edf-48d1-939f-76636e156cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:50.952582 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:50.973532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9546c08-a2d3-4794-84f2-99240fc3625c None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:50.974037 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9546c08-a2d3-4794-84f2-99240fc3625c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:50.974312 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9546c08-a2d3-4794-84f2-99240fc3625c None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:50.975901 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 105/207] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:50.980865 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a445a43-57ce-435d-a5a8-e03825c85813 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:50.981184 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a445a43-57ce-435d-a5a8-e03825c85813 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:50.981465 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a445a43-57ce-435d-a5a8-e03825c85813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:50.999429 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-1a445a43-57ce-435d-a5a8-e03825c85813 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:51.000620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1a445a43-57ce-435d-a5a8-e03825c85813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:51.020677 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 103/208] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:51.075348 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 106/209] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 12:19:51.298264 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5bd74-2edf-48d1-939f-76636e156cfd None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:51.343391 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a445a43-57ce-435d-a5a8-e03825c85813 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:51.397933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5bd74-2edf-48d1-939f-76636e156cfd None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:51.430762 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e701d1-349e-4362-a92f-07d1b8852d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:51.431393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e701d1-349e-4362-a92f-07d1b8852d27 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:51.431679 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e701d1-349e-4362-a92f-07d1b8852d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:51.432458 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e701d1-349e-4362-a92f-07d1b8852d27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:51.439672 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:51.443015 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e701d1-349e-4362-a92f-07d1b8852d27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:51.444072 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a445a43-57ce-435d-a5a8-e03825c85813 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:51.448648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-d3e701d1-349e-4362-a92f-07d1b8852d27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:19:51.448648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:51.448648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:51.448648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:51.448648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:51.448648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:51.448648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:51.448648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:51.448648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:51.448648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:51.448648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:51.448648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:51.448648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:51.448648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:51.448648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:51.448648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:51.449573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:51.449573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:51.449573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:51.449573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:51.449573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:51.449573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:51.449573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:51.449573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:51.449573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:51.449573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:51.449573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:51.449573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:51.449573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:51.449573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:51.449573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:51.449573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:51.457921 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:51.457921 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:51.457921 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:51.457921 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:51.457921 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:51.457921 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:51.457921 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:51.457921 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:51.457921 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:51.457921 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:51.457921 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:19:51.457921 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:19:51.457921 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 104/210] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:19:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:19:51.457921 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e2b19-efac-4386-a2a8-6d00323fae2b None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:51.458821 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e2b19-efac-4386-a2a8-6d00323fae2b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:51.458821 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e2b19-efac-4386-a2a8-6d00323fae2b None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:51.458821 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 105/211] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:51.458821 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e2b19-efac-4386-a2a8-6d00323fae2b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:51.476512 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:51.485051 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc96d0-f591-43f1-8ca6-a3fed40dacda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:51.485732 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc96d0-f591-43f1-8ca6-a3fed40dacda None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:51.486015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc96d0-f591-43f1-8ca6-a3fed40dacda None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:51.486290 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc96d0-f591-43f1-8ca6-a3fed40dacda None admin] PATH_INFO: `/v3/domains/default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:51.487379 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc96d0-f591-43f1-8ca6-a3fed40dacda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:51.488813 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc96d0-f591-43f1-8ca6-a3fed40dacda None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:51.490421 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 107/212] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:19:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:19:51.491522 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e94ccc-8fb2-405b-a542-d3d282d4e16d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:51.491804 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e94ccc-8fb2-405b-a542-d3d282d4e16d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:51.492074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e94ccc-8fb2-405b-a542-d3d282d4e16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:51.509658 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f7e94ccc-8fb2-405b-a542-d3d282d4e16d None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:51.511403 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f7e94ccc-8fb2-405b-a542-d3d282d4e16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:51.555039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e2b19-efac-4386-a2a8-6d00323fae2b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:51.576048 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 108/213] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:51.578028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e94ccc-8fb2-405b-a542-d3d282d4e16d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:51.593704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a357435-0f6d-43f1-9ba1-d9253e07a53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:51.594325 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a357435-0f6d-43f1-9ba1-d9253e07a53a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:51.594606 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a357435-0f6d-43f1-9ba1-d9253e07a53a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:51.594880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a357435-0f6d-43f1-9ba1-d9253e07a53a None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:51.595549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a357435-0f6d-43f1-9ba1-d9253e07a53a None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:51.595857 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a357435-0f6d-43f1-9ba1-d9253e07a53a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:51.597244 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a357435-0f6d-43f1-9ba1-d9253e07a53a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:51.605970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 106/214] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 31 12:19:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:19:51.611435 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a357435-0f6d-43f1-9ba1-d9253e07a53a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:51.674131 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:51.687175 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e94ccc-8fb2-405b-a542-d3d282d4e16d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:51.715191 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:51.717634 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a357435-0f6d-43f1-9ba1-d9253e07a53a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:51.725718 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ce789-30f4-4a97-9197-a1ebc8bccd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:51.726904 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ce789-30f4-4a97-9197-a1ebc8bccd7b None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:51.727394 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ce789-30f4-4a97-9197-a1ebc8bccd7b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:51.728135 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ce789-30f4-4a97-9197-a1ebc8bccd7b None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:51.729494 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ce789-30f4-4a97-9197-a1ebc8bccd7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:51.731093 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ce789-30f4-4a97-9197-a1ebc8bccd7b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:51.753784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 109/215] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 31 12:19:51 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:19:51.761387 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e969023-9150-49a1-a610-9af98965fd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:51.761387 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e969023-9150-49a1-a610-9af98965fd06 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:51.761387 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e969023-9150-49a1-a610-9af98965fd06 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:51.761387 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e969023-9150-49a1-a610-9af98965fd06 None admin] PATH_INFO: `/v3/users/e945c8077a9b4b2a93b342f638b9aa68` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:51.771314 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e969023-9150-49a1-a610-9af98965fd06 None admin] RBAC: Authorizing `identity:get_user(user_id=e945c8077a9b4b2a93b342f638b9aa68)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:51.772803 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e969023-9150-49a1-a610-9af98965fd06 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:51.774920 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 107/216] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:51 2022] GET /identity/v3/users/e945c8077a9b4b2a93b342f638b9aa68 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:19:51.780758 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ce789-30f4-4a97-9197-a1ebc8bccd7b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:51.851840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e969023-9150-49a1-a610-9af98965fd06 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:51.890666 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ce789-30f4-4a97-9197-a1ebc8bccd7b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:51.927326 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff382a-95a7-4801-a69f-109aefc95065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:51.927945 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff382a-95a7-4801-a69f-109aefc95065 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:51.928214 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff382a-95a7-4801-a69f-109aefc95065 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:51.928478 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff382a-95a7-4801-a69f-109aefc95065 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:51.929238 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff382a-95a7-4801-a69f-109aefc95065 None admin] RBAC: Adding query filter params (role.id=b7c6f84505634b978e58bb6f62bd88a0, user.id=e945c8077a9b4b2a93b342f638b9aa68, scope.system=all) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:51.929703 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff382a-95a7-4801-a69f-109aefc95065 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:51.930981 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff382a-95a7-4801-a69f-109aefc95065 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:51.937140 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 110/217] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Oct 31 12:19:51 2022] GET /identity/v3/role_assignments?user.id=e945c8077a9b4b2a93b342f638b9aa68&scope.system=all&role.id=b7c6f84505634b978e58bb6f62bd88a0 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:51.965160 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e969023-9150-49a1-a610-9af98965fd06 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:51.989093 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:52.007976 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc474b-664a-4842-91fd-c6ebf0c63000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:52.008639 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc474b-664a-4842-91fd-c6ebf0c63000 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:52.008922 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc474b-664a-4842-91fd-c6ebf0c63000 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:52.009253 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc474b-664a-4842-91fd-c6ebf0c63000 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:52.021858 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc474b-664a-4842-91fd-c6ebf0c63000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:52.027001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-2ecc474b-664a-4842-91fd-c6ebf0c63000 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 12:19:52.027001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:52.027001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:52.027001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:52.027001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:52.027001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:52.027001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:52.027001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:52.027001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:52.027001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:52.027001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:52.027001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:52.027001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:52.027001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:52.027001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:52.027001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:52.027933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:52.027933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:52.027933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:52.027933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:52.027933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:52.027933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:52.027933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:52.027933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:52.027933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:52.027933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:52.027933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:52.027933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:52.027933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:52.027933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:52.027933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:52.027933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:52.028742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:52.028742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:52.028742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:52.028742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:52.028742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:52.028742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:52.028742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:52.028742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:52.028742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:52.028742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:52.028742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 12:19:52.028742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:19:52.028742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 108/218] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:19:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:19:52.035842 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff382a-95a7-4801-a69f-109aefc95065 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:52.098182 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:52.160999 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff382a-95a7-4801-a69f-109aefc95065 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:52.195157 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22eac9-2b8d-4854-8ca9-e8c5c177fdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:52.195776 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22eac9-2b8d-4854-8ca9-e8c5c177fdb6 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:52.196055 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22eac9-2b8d-4854-8ca9-e8c5c177fdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:52.196324 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22eac9-2b8d-4854-8ca9-e8c5c177fdb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:52.196985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22eac9-2b8d-4854-8ca9-e8c5c177fdb6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:52.197308 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22eac9-2b8d-4854-8ca9-e8c5c177fdb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:52.198705 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22eac9-2b8d-4854-8ca9-e8c5c177fdb6 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:52.216300 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 111/219] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 31 12:19:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:52.217805 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc474b-664a-4842-91fd-c6ebf0c63000 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:52.325521 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc474b-664a-4842-91fd-c6ebf0c63000 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:52.361378 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980fc98-604b-48e5-b1f9-eb9b9ac9c088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:52.362020 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980fc98-604b-48e5-b1f9-eb9b9ac9c088 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:52.362303 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980fc98-604b-48e5-b1f9-eb9b9ac9c088 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:52.362578 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980fc98-604b-48e5-b1f9-eb9b9ac9c088 None admin] PATH_INFO: `/v3/users/987810ff2859404c945b4a5b4bf3f3c7` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:52.363732 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980fc98-604b-48e5-b1f9-eb9b9ac9c088 None admin] RBAC: Authorizing `identity:get_user(user_id=987810ff2859404c945b4a5b4bf3f3c7)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:52.365283 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980fc98-604b-48e5-b1f9-eb9b9ac9c088 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:52.367243 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 109/220] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:52 2022] GET /identity/v3/users/987810ff2859404c945b4a5b4bf3f3c7 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:52.372596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22eac9-2b8d-4854-8ca9-e8c5c177fdb6 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:52.478567 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22eac9-2b8d-4854-8ca9-e8c5c177fdb6 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:52.487948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:52.516249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcbdce-ba53-41a9-a5b2-4e61d3fc2ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:52.516863 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcbdce-ba53-41a9-a5b2-4e61d3fc2ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:52.517170 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcbdce-ba53-41a9-a5b2-4e61d3fc2ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:52.517445 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcbdce-ba53-41a9-a5b2-4e61d3fc2ae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:52.586675 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbcbdce-ba53-41a9-a5b2-4e61d3fc2ae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:52.588189 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbcbdce-ba53-41a9-a5b2-4e61d3fc2ae0 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:52.696017 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 112/221] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:19:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 12:19:52.702340 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980fc98-604b-48e5-b1f9-eb9b9ac9c088 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:52.756903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:52.811246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980fc98-604b-48e5-b1f9-eb9b9ac9c088 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:52.847146 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2944e9-d0a7-4ef3-bd76-1028156568c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:52.847811 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2944e9-d0a7-4ef3-bd76-1028156568c3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:52.848093 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2944e9-d0a7-4ef3-bd76-1028156568c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:52.848370 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2944e9-d0a7-4ef3-bd76-1028156568c3 None admin] PATH_INFO: `/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:52.849757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2944e9-d0a7-4ef3-bd76-1028156568c3 None admin] RBAC: Authorizing `identity:get_project(project_id=acf5fd24975f479ea610ce5bcefe7dcc)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:52.851288 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2944e9-d0a7-4ef3-bd76-1028156568c3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:52.853377 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 110/222] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:19:52 2022] GET /identity/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:52.859361 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcbdce-ba53-41a9-a5b2-4e61d3fc2ae0 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:52.870963 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:52.967152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcbdce-ba53-41a9-a5b2-4e61d3fc2ae0 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:53.002158 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12298baa-c6e5-4f77-b2a8-f0ff76c0d8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:53.003011 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12298baa-c6e5-4f77-b2a8-f0ff76c0d8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:53.003532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12298baa-c6e5-4f77-b2a8-f0ff76c0d8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:53.003997 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12298baa-c6e5-4f77-b2a8-f0ff76c0d8d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:53.004953 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12298baa-c6e5-4f77-b2a8-f0ff76c0d8d1 None admin] RBAC: Adding query filter params (role.id=f352dab941ec48a589c0f614999dbeb3, scope.project.id=acf5fd24975f479ea610ce5bcefe7dcc, user.id=987810ff2859404c945b4a5b4bf3f3c7) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:53.005480 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12298baa-c6e5-4f77-b2a8-f0ff76c0d8d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:53.007157 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12298baa-c6e5-4f77-b2a8-f0ff76c0d8d1 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:53.013682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 113/223] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:19:52 2022] GET /identity/v3/role_assignments?user.id=987810ff2859404c945b4a5b4bf3f3c7&scope.project.id=acf5fd24975f479ea610ce5bcefe7dcc&role.id=f352dab941ec48a589c0f614999dbeb3 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:54.146561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661a024-10dd-4c52-bff1-29dcaca99f80 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:54.147091 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661a024-10dd-4c52-bff1-29dcaca99f80 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:54.147091 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661a024-10dd-4c52-bff1-29dcaca99f80 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:54.147954 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907a9da-7bec-408d-9cd7-3a1bf5988d9b None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:54.148326 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907a9da-7bec-408d-9cd7-3a1bf5988d9b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:54.148527 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 111/224] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:54.148785 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907a9da-7bec-408d-9cd7-3a1bf5988d9b None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:54.150232 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 114/225] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:19:54.155328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45394e67-28fc-436c-bc72-7c5cb1704bc8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:54.155619 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45394e67-28fc-436c-bc72-7c5cb1704bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:54.155881 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45394e67-28fc-436c-bc72-7c5cb1704bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:54.156231 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982070f-13ce-4d71-ba2f-aa0952984fbd None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:54.156515 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982070f-13ce-4d71-ba2f-aa0952984fbd None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:54.156786 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982070f-13ce-4d71-ba2f-aa0952984fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:54.176118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-45394e67-28fc-436c-bc72-7c5cb1704bc8 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:54.176753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-8982070f-13ce-4d71-ba2f-aa0952984fbd None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:54.177327 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-45394e67-28fc-436c-bc72-7c5cb1704bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:54.177941 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8982070f-13ce-4d71-ba2f-aa0952984fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:54.250151 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 112/226] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:54.258255 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a5b2e-de40-4081-83f1-f836aa591264 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:54.258547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a5b2e-de40-4081-83f1-f836aa591264 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:54.258824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a5b2e-de40-4081-83f1-f836aa591264 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:54.260643 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 113/227] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:19:54.264559 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 115/228] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:54.265837 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb38ded-20e1-47d6-b803-afeef66f416e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:54.266123 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb38ded-20e1-47d6-b803-afeef66f416e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:54.266398 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb38ded-20e1-47d6-b803-afeef66f416e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:54.284789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2cb38ded-20e1-47d6-b803-afeef66f416e None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:54.285997 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2cb38ded-20e1-47d6-b803-afeef66f416e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:54.328620 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:54.352897 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 114/229] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 12:19:54.515291 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982070f-13ce-4d71-ba2f-aa0952984fbd None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:54.518196 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:54.530794 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb38ded-20e1-47d6-b803-afeef66f416e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:54.621995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982070f-13ce-4d71-ba2f-aa0952984fbd None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:54.641043 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb38ded-20e1-47d6-b803-afeef66f416e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:54.657474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b687da9-5b87-4959-9217-d1867fc54f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:54.658106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b687da9-5b87-4959-9217-d1867fc54f2f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:54.658389 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b687da9-5b87-4959-9217-d1867fc54f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:54.658657 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b687da9-5b87-4959-9217-d1867fc54f2f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:54.668773 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b687da9-5b87-4959-9217-d1867fc54f2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:54.673490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b196833-be85-420c-8658-b3b806e7d849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:54.673665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-3b687da9-5b87-4959-9217-d1867fc54f2f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 12:19:54.673665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:54.673665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:54.673665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:54.673665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:54.673665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:54.673665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:54.673665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:54.673665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:54.673665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:54.673665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:54.673665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:54.673665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:54.673665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:54.673665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:54.673665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:54.674669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:54.674669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:54.674669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:54.674669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:54.674669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:54.674669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:54.674669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:54.674669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:54.674669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:54.674669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:54.674669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:54.674669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:54.674669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:54.674669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:54.674669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:54.674669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:54.675478 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:54.675478 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:54.675478 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:54.675478 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:54.675478 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:54.675478 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:54.675478 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:54.675478 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:54.675478 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:54.675478 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:54.675478 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 12:19:54.675478 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:19:54.676088 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b196833-be85-420c-8658-b3b806e7d849 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:54.676088 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b196833-be85-420c-8658-b3b806e7d849 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:54.676088 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b196833-be85-420c-8658-b3b806e7d849 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:54.676270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 116/230] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:19:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:19:54.676270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b687da9-5b87-4959-9217-d1867fc54f2f None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:54.689922 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b196833-be85-420c-8658-b3b806e7d849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:54.694715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-8b196833-be85-420c-8658-b3b806e7d849 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:19:54.694715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:54.694715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:54.694715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:54.694715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:54.694715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:54.694715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:54.694715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:54.694715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:54.694715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:54.694715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:54.694715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:54.694715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:54.694715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:54.694715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:54.694715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:54.695704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:54.695704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:54.695704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:54.695704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:54.695704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:54.695704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:54.695704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:54.695704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:54.695704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:54.695704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:54.695704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:54.695704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:54.695704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:54.695704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:54.695704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:54.695704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:54.696473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:54.696473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:54.696473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:54.696473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:54.696473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:54.696473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:54.696473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:54.696473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:54.696473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:54.696473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:54.696473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:19:54.696473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:19:54.696473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 115/231] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:19:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:19:54.697183 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b196833-be85-420c-8658-b3b806e7d849 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:54.732789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:54.737787 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:54.776070 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b687da9-5b87-4959-9217-d1867fc54f2f None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:54.797646 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b196833-be85-420c-8658-b3b806e7d849 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:54.809463 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c144b-7158-4719-860a-30688a7ca5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:54.810079 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c144b-7158-4719-860a-30688a7ca5ab None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:54.810354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c144b-7158-4719-860a-30688a7ca5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:54.810616 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c144b-7158-4719-860a-30688a7ca5ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:54.811707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c144b-7158-4719-860a-30688a7ca5ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:54.813165 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c144b-7158-4719-860a-30688a7ca5ab None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:54.814718 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 117/232] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:19:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:54.815551 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c144b-7158-4719-860a-30688a7ca5ab None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:54.834399 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceddef0-d57c-478c-b90a-ceedd3bd6ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:54.834999 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceddef0-d57c-478c-b90a-ceedd3bd6ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:54.835274 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceddef0-d57c-478c-b90a-ceedd3bd6ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:54.835545 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceddef0-d57c-478c-b90a-ceedd3bd6ee5 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:54.836197 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceddef0-d57c-478c-b90a-ceedd3bd6ee5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:54.836492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceddef0-d57c-478c-b90a-ceedd3bd6ee5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:54.837889 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceddef0-d57c-478c-b90a-ceedd3bd6ee5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:54.845866 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 116/233] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 31 12:19:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:54.851255 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceddef0-d57c-478c-b90a-ceedd3bd6ee5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:54.910929 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c144b-7158-4719-860a-30688a7ca5ab None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:54.939960 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:54.943958 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:54.946252 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753c322-919e-493f-943f-6249c54c291f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:54.946923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753c322-919e-493f-943f-6249c54c291f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:54.947206 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753c322-919e-493f-943f-6249c54c291f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:54.947474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753c322-919e-493f-943f-6249c54c291f None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:54.947829 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceddef0-d57c-478c-b90a-ceedd3bd6ee5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:54.948134 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753c322-919e-493f-943f-6249c54c291f None admin] RBAC: Adding query filter params (name=member) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:54.948433 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753c322-919e-493f-943f-6249c54c291f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:54.949816 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753c322-919e-493f-943f-6249c54c291f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:54.957682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 118/234] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 31 12:19:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:54.958475 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753c322-919e-493f-943f-6249c54c291f None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:54.981040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46763530-a5d8-493c-9d01-64c338b55756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:54.981677 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46763530-a5d8-493c-9d01-64c338b55756 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:54.981959 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46763530-a5d8-493c-9d01-64c338b55756 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:54.982233 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46763530-a5d8-493c-9d01-64c338b55756 None admin] PATH_INFO: `/v3/groups` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:54.982858 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46763530-a5d8-493c-9d01-64c338b55756 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:54.984270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46763530-a5d8-493c-9d01-64c338b55756 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:54.999906 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 117/235] 10.222.0.18 () {60 vars in 1134 bytes} [Mon Oct 31 12:19:54 2022] POST /identity/v3/groups => generated 229 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:19:55.000691 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46763530-a5d8-493c-9d01-64c338b55756 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:55.085069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753c322-919e-493f-943f-6249c54c291f None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:55.117434 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46763530-a5d8-493c-9d01-64c338b55756 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:55.124254 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ead14-66d8-45a4-b888-fb41fb3fd4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:55.124934 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ead14-66d8-45a4-b888-fb41fb3fd4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:55.125377 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ead14-66d8-45a4-b888-fb41fb3fd4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:55.125657 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ead14-66d8-45a4-b888-fb41fb3fd4f1 None admin] PATH_INFO: `/v3/users/2cf589b5d683428cb367fbddaa5ba6ab` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:55.143048 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ead14-66d8-45a4-b888-fb41fb3fd4f1 None admin] RBAC: Authorizing `identity:get_user(user_id=2cf589b5d683428cb367fbddaa5ba6ab)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:55.144573 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ead14-66d8-45a4-b888-fb41fb3fd4f1 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:55.151920 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 119/236] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:54 2022] GET /identity/v3/users/2cf589b5d683428cb367fbddaa5ba6ab => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:55.154086 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ead14-66d8-45a4-b888-fb41fb3fd4f1 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:55.159752 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a946cee-c4ed-4e00-b610-8f49e34ecd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:55.161170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a946cee-c4ed-4e00-b610-8f49e34ecd71 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:55.161902 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a946cee-c4ed-4e00-b610-8f49e34ecd71 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:55.162390 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a946cee-c4ed-4e00-b610-8f49e34ecd71 None admin] PATH_INFO: `/v3/users/e945c8077a9b4b2a93b342f638b9aa68` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:55.163767 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a946cee-c4ed-4e00-b610-8f49e34ecd71 None admin] RBAC: Authorizing `identity:get_user(user_id=e945c8077a9b4b2a93b342f638b9aa68)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:55.165434 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a946cee-c4ed-4e00-b610-8f49e34ecd71 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:55.167785 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 118/237] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:54 2022] GET /identity/v3/users/e945c8077a9b4b2a93b342f638b9aa68 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:55.174416 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a946cee-c4ed-4e00-b610-8f49e34ecd71 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:55.208281 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:55.209052 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:55.263056 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ead14-66d8-45a4-b888-fb41fb3fd4f1 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:55.284896 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a946cee-c4ed-4e00-b610-8f49e34ecd71 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:55.298789 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d9b1b-3c11-47ba-ba5a-c2862d6deb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:55.299559 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d9b1b-3c11-47ba-ba5a-c2862d6deb9b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:55.299839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d9b1b-3c11-47ba-ba5a-c2862d6deb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:55.300116 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d9b1b-3c11-47ba-ba5a-c2862d6deb9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:55.300842 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d9b1b-3c11-47ba-ba5a-c2862d6deb9b None admin] RBAC: Adding query filter params (role.id=f352dab941ec48a589c0f614999dbeb3, user.id=2cf589b5d683428cb367fbddaa5ba6ab, scope.system=all) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:55.301171 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d9b1b-3c11-47ba-ba5a-c2862d6deb9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:55.302611 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d9b1b-3c11-47ba-ba5a-c2862d6deb9b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:55.307644 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 120/238] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Oct 31 12:19:55 2022] GET /identity/v3/role_assignments?user.id=2cf589b5d683428cb367fbddaa5ba6ab&scope.system=all&role.id=f352dab941ec48a589c0f614999dbeb3 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:19:55.321582 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e26f8-6a02-4fed-b098-9ff411af8aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:55.322709 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e26f8-6a02-4fed-b098-9ff411af8aca None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:55.323213 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e26f8-6a02-4fed-b098-9ff411af8aca None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:55.323691 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e26f8-6a02-4fed-b098-9ff411af8aca None admin] PATH_INFO: `/v3/system/users/e945c8077a9b4b2a93b342f638b9aa68/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:55.325514 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e26f8-6a02-4fed-b098-9ff411af8aca None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e945c8077a9b4b2a93b342f638b9aa68, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:55.327162 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e26f8-6a02-4fed-b098-9ff411af8aca None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:55.339337 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 119/239] 10.222.0.18 () {58 vars in 1334 bytes} [Mon Oct 31 12:19:55 2022] PUT /identity/v3/system/users/e945c8077a9b4b2a93b342f638b9aa68/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:19:57.192185 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8e40c-a064-4247-9526-40fc5f0f9b62 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:57.192710 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8e40c-a064-4247-9526-40fc5f0f9b62 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:57.192710 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8e40c-a064-4247-9526-40fc5f0f9b62 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:57.194258 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 121/240] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:57.199717 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74249deb-71b0-4ac6-9850-c5b67f1b06e7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:57.200093 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74249deb-71b0-4ac6-9850-c5b67f1b06e7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:57.200287 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74249deb-71b0-4ac6-9850-c5b67f1b06e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:57.219031 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-74249deb-71b0-4ac6-9850-c5b67f1b06e7 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:57.220220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-74249deb-71b0-4ac6-9850-c5b67f1b06e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:57.288766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 120/241] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:57.441286 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301ca13-866f-4291-a7b3-31eeaebd6cf8 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:57.441650 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301ca13-866f-4291-a7b3-31eeaebd6cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:57.441840 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301ca13-866f-4291-a7b3-31eeaebd6cf8 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:57.443311 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 122/242] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:19:57.448895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4633a4-5d9b-418b-8918-6ab709a85857 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:57.449209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4633a4-5d9b-418b-8918-6ab709a85857 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:57.449487 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4633a4-5d9b-418b-8918-6ab709a85857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:57.467396 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4a4633a4-5d9b-418b-8918-6ab709a85857 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:57.468557 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4a4633a4-5d9b-418b-8918-6ab709a85857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:57.482368 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:57.492348 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c89a6-4292-40e7-9ffc-5af5588d410c None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:57.492638 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c89a6-4292-40e7-9ffc-5af5588d410c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:57.492909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c89a6-4292-40e7-9ffc-5af5588d410c None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:57.494933 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 123/243] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:19:57.499543 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21429d5e-3ff4-4f94-8e7a-50267ddc27de None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:57.499829 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21429d5e-3ff4-4f94-8e7a-50267ddc27de None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:57.500104 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21429d5e-3ff4-4f94-8e7a-50267ddc27de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:57.518308 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-21429d5e-3ff4-4f94-8e7a-50267ddc27de None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:19:57.519480 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-21429d5e-3ff4-4f94-8e7a-50267ddc27de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:19:57.539096 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 121/244] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:19:57.560007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4633a4-5d9b-418b-8918-6ab709a85857 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:57.594616 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 124/245] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 12:19:57.661022 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4633a4-5d9b-418b-8918-6ab709a85857 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:57.694938 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d8a50-c81c-42d2-b818-d5ca2bb3a10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:57.695498 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d8a50-c81c-42d2-b818-d5ca2bb3a10f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:57.695777 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d8a50-c81c-42d2-b818-d5ca2bb3a10f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:57.696048 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d8a50-c81c-42d2-b818-d5ca2bb3a10f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:57.697768 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d8a50-c81c-42d2-b818-d5ca2bb3a10f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:57.699210 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d8a50-c81c-42d2-b818-d5ca2bb3a10f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:57.700979 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 122/246] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:19:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:19:57.706306 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21429d5e-3ff4-4f94-8e7a-50267ddc27de None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:57.753346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:57.801378 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d8a50-c81c-42d2-b818-d5ca2bb3a10f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:57.811919 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21429d5e-3ff4-4f94-8e7a-50267ddc27de None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:57.821380 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:57.845650 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f21ae9-5b55-4856-835c-35b7ea3c8ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:57.846260 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f21ae9-5b55-4856-835c-35b7ea3c8ad3 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:57.846538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f21ae9-5b55-4856-835c-35b7ea3c8ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:57.846810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f21ae9-5b55-4856-835c-35b7ea3c8ad3 None admin] PATH_INFO: `/v3/groups` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:57.847437 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f21ae9-5b55-4856-835c-35b7ea3c8ad3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:57.848865 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f21ae9-5b55-4856-835c-35b7ea3c8ad3 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:57.866140 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 125/247] 10.222.0.18 () {60 vars in 1134 bytes} [Mon Oct 31 12:19:57 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:19:57.876202 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f21ae9-5b55-4856-835c-35b7ea3c8ad3 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:57.915217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d8a50-c81c-42d2-b818-d5ca2bb3a10f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:57.956125 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7f3bb-1d80-4410-8002-00be3c0a45b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:57.956681 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7f3bb-1d80-4410-8002-00be3c0a45b1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:57.956959 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7f3bb-1d80-4410-8002-00be3c0a45b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:57.957317 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7f3bb-1d80-4410-8002-00be3c0a45b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:57.968975 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7f3bb-1d80-4410-8002-00be3c0a45b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:57.974071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-ede7f3bb-1d80-4410-8002-00be3c0a45b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 12:19:57.974071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:57.974071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:57.974071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:57.974071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:57.974071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:57.974071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:57.974071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:57.974071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:57.974071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:57.974071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:57.974071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:57.974071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:57.974071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:57.974071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:57.974071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:57.974994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:57.974994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:57.974994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:57.974994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:57.974994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:57.974994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:57.974994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:57.974994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:57.974994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:57.974994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:57.974994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:57.974994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:57.974994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:57.974994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:57.974994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:57.974994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:57.975792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:57.975792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:57.975792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:57.975792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:57.975792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:57.975792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:57.975792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:57.975792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:57.975792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:57.975792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:57.975792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 12:19:57.975792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:19:57.975792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 123/248] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:19:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:19:57.981777 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7f3bb-1d80-4410-8002-00be3c0a45b1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:57.998002 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f21ae9-5b55-4856-835c-35b7ea3c8ad3 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:58.000769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:58.038669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed904d8a-0937-4535-acd8-fb9d56a64669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:58.039306 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed904d8a-0937-4535-acd8-fb9d56a64669 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:58.039586 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed904d8a-0937-4535-acd8-fb9d56a64669 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:58.039859 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed904d8a-0937-4535-acd8-fb9d56a64669 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:58.052222 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed904d8a-0937-4535-acd8-fb9d56a64669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:19:58.059208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-ed904d8a-0937-4535-acd8-fb9d56a64669 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:19:58.059208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:19:58.059208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:19:58.059208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:19:58.059208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:19:58.059208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:19:58.059208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:19:58.059208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:19:58.059208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:19:58.059208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:19:58.059208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:19:58.059208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:19:58.059208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:19:58.059208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:19:58.059208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:19:58.059208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:19:58.060114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:19:58.060114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:19:58.060114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:19:58.060114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:19:58.060114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:19:58.060114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:19:58.060114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:19:58.060114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:19:58.060114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:19:58.060114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:19:58.060114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:19:58.060114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:19:58.060114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:19:58.060114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:19:58.060114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:19:58.060114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:19:58.060895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:19:58.060895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:19:58.060895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:19:58.060895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:19:58.060895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:19:58.060895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:19:58.060895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:19:58.060895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:19:58.060895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:19:58.060895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:19:58.060895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:19:58.060895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:19:58.060895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 126/249] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:19:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:19:58.067070 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed904d8a-0937-4535-acd8-fb9d56a64669 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:58.080649 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:58.108588 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7f3bb-1d80-4410-8002-00be3c0a45b1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:58.148569 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfd56e-4fde-4fa2-ab9c-3de9ed64b140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:58.149268 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfd56e-4fde-4fa2-ab9c-3de9ed64b140 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:58.149548 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfd56e-4fde-4fa2-ab9c-3de9ed64b140 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:58.149819 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfd56e-4fde-4fa2-ab9c-3de9ed64b140 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:58.151033 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfd56e-4fde-4fa2-ab9c-3de9ed64b140 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:58.151332 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfd56e-4fde-4fa2-ab9c-3de9ed64b140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:58.153125 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfd56e-4fde-4fa2-ab9c-3de9ed64b140 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:58.162421 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 124/250] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 31 12:19:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:58.168527 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfd56e-4fde-4fa2-ab9c-3de9ed64b140 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:58.199085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed904d8a-0937-4535-acd8-fb9d56a64669 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:58.242984 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65592d-ac57-4ce1-a559-dcfa83f1eed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:58.243531 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65592d-ac57-4ce1-a559-dcfa83f1eed1 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:58.243817 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65592d-ac57-4ce1-a559-dcfa83f1eed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:58.244187 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65592d-ac57-4ce1-a559-dcfa83f1eed1 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:58.244988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65592d-ac57-4ce1-a559-dcfa83f1eed1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:58.245468 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65592d-ac57-4ce1-a559-dcfa83f1eed1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:58.246890 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65592d-ac57-4ce1-a559-dcfa83f1eed1 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:58.258099 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 127/251] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 31 12:19:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:58.264356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65592d-ac57-4ce1-a559-dcfa83f1eed1 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:58.292337 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfd56e-4fde-4fa2-ab9c-3de9ed64b140 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:58.303310 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:58.341524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095d573-2527-4be1-b880-0e00122ea00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:58.342664 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095d573-2527-4be1-b880-0e00122ea00d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:58.342957 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095d573-2527-4be1-b880-0e00122ea00d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:58.343460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095d573-2527-4be1-b880-0e00122ea00d None admin] PATH_INFO: `/v3/users/2cf589b5d683428cb367fbddaa5ba6ab` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:58.344702 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095d573-2527-4be1-b880-0e00122ea00d None admin] RBAC: Authorizing `identity:get_user(user_id=2cf589b5d683428cb367fbddaa5ba6ab)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:58.346931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095d573-2527-4be1-b880-0e00122ea00d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:58.348533 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 125/252] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:58 2022] GET /identity/v3/users/2cf589b5d683428cb367fbddaa5ba6ab => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:58.354774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095d573-2527-4be1-b880-0e00122ea00d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:58.367030 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:58.402233 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65592d-ac57-4ce1-a559-dcfa83f1eed1 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:58.453187 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698e5dd-bb9d-4123-9d30-ed28bbbcec22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:58.453872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698e5dd-bb9d-4123-9d30-ed28bbbcec22 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:58.454157 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698e5dd-bb9d-4123-9d30-ed28bbbcec22 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:58.454428 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698e5dd-bb9d-4123-9d30-ed28bbbcec22 None admin] PATH_INFO: `/v3/users/e945c8077a9b4b2a93b342f638b9aa68` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:58.455929 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698e5dd-bb9d-4123-9d30-ed28bbbcec22 None admin] RBAC: Authorizing `identity:get_user(user_id=e945c8077a9b4b2a93b342f638b9aa68)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:58.458096 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698e5dd-bb9d-4123-9d30-ed28bbbcec22 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:58.460115 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 128/253] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:19:58 2022] GET /identity/v3/users/e945c8077a9b4b2a93b342f638b9aa68 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:19:58.466805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698e5dd-bb9d-4123-9d30-ed28bbbcec22 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:19:58.481762 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095d573-2527-4be1-b880-0e00122ea00d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:58.517484 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53536812-ae1e-465e-ada1-408d38d17760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:58.518355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53536812-ae1e-465e-ada1-408d38d17760 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:58.518794 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53536812-ae1e-465e-ada1-408d38d17760 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:58.519206 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53536812-ae1e-465e-ada1-408d38d17760 None admin] PATH_INFO: `/v3/system/users/2cf589b5d683428cb367fbddaa5ba6ab/roles/f352dab941ec48a589c0f614999dbeb3` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:58.520756 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53536812-ae1e-465e-ada1-408d38d17760 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2cf589b5d683428cb367fbddaa5ba6ab, role_id=f352dab941ec48a589c0f614999dbeb3)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:58.522329 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53536812-ae1e-465e-ada1-408d38d17760 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:58.534329 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 126/254] 10.222.0.18 () {58 vars in 1334 bytes} [Mon Oct 31 12:19:58 2022] PUT /identity/v3/system/users/2cf589b5d683428cb367fbddaa5ba6ab/roles/f352dab941ec48a589c0f614999dbeb3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:19:58.573867 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:19:58.580989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698e5dd-bb9d-4123-9d30-ed28bbbcec22 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:19:58.620706 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979efa31-bd20-4068-a791-36e9a6784c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:19:58.621400 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979efa31-bd20-4068-a791-36e9a6784c1c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:19:58.621684 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979efa31-bd20-4068-a791-36e9a6784c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:19:58.621995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979efa31-bd20-4068-a791-36e9a6784c1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:19:58.622737 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979efa31-bd20-4068-a791-36e9a6784c1c None admin] RBAC: Adding query filter params (role.id=b7c6f84505634b978e58bb6f62bd88a0, user.id=e945c8077a9b4b2a93b342f638b9aa68, scope.system=all) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:19:58.623044 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979efa31-bd20-4068-a791-36e9a6784c1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:19:58.624556 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979efa31-bd20-4068-a791-36e9a6784c1c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:19:58.639178 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 129/255] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Oct 31 12:19:58 2022] GET /identity/v3/role_assignments?user.id=e945c8077a9b4b2a93b342f638b9aa68&scope.system=all&role.id=b7c6f84505634b978e58bb6f62bd88a0 => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:00.456729 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc545f2-9b11-45d0-949e-ed93c5b5dfe0 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:00.457866 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc545f2-9b11-45d0-949e-ed93c5b5dfe0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:00.458349 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc545f2-9b11-45d0-949e-ed93c5b5dfe0 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:00.460158 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 127/256] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:00.466306 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c80dc-5103-4e6e-bd27-a44ac70a1c07 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:00.466750 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c80dc-5103-4e6e-bd27-a44ac70a1c07 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:00.466926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c80dc-5103-4e6e-bd27-a44ac70a1c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:00.493016 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-4c8c80dc-5103-4e6e-bd27-a44ac70a1c07 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:00.494324 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4c8c80dc-5103-4e6e-bd27-a44ac70a1c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:00.566674 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1d9af-8f98-4a2b-9817-12ceb4326cce None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:00.567299 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1d9af-8f98-4a2b-9817-12ceb4326cce None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:00.567767 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1d9af-8f98-4a2b-9817-12ceb4326cce None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:00.569492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 128/257] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:20:00.580728 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc32e7-42d6-4188-93f2-ac2f9f8cab6f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:00.580894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 130/258] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 12:20:00.581416 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc32e7-42d6-4188-93f2-ac2f9f8cab6f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:00.581889 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc32e7-42d6-4188-93f2-ac2f9f8cab6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:00.609062 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2abc32e7-42d6-4188-93f2-ac2f9f8cab6f None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:00.610636 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2abc32e7-42d6-4188-93f2-ac2f9f8cab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:00.630493 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 129/259] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 31 12:20:01.079512 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c80dc-5103-4e6e-bd27-a44ac70a1c07 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:01.089738 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c80dc-5103-4e6e-bd27-a44ac70a1c07 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:01.096686 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff94d2-1bf6-48da-96c1-6115443f1c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:01.097707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff94d2-1bf6-48da-96c1-6115443f1c13 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:01.098184 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff94d2-1bf6-48da-96c1-6115443f1c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:01.098696 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff94d2-1bf6-48da-96c1-6115443f1c13 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:01.110306 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff94d2-1bf6-48da-96c1-6115443f1c13 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:01.115378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-d3ff94d2-1bf6-48da-96c1-6115443f1c13 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:20:01.115378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:01.115378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:01.115378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:01.115378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:01.115378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:01.115378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:01.115378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:01.115378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:01.115378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:01.115378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:01.115378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:01.115378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:01.115378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:01.115378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:01.115378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:01.116263 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:01.116263 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:01.116263 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:01.116263 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:01.116263 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:01.116263 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:01.116263 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:01.116263 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:01.116263 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:01.116263 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:01.116263 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:01.116263 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:01.116263 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:01.116263 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:01.116263 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:01.116263 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:01.117057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:01.117057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:01.117057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:01.117057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:01.117057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:01.117057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:01.117057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:01.117057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:01.117057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:01.117057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:01.117057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:20:01.117057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:01.120127 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 131/260] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Oct 31 12:20:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:01.126676 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc32e7-42d6-4188-93f2-ac2f9f8cab6f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:01.137083 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc32e7-42d6-4188-93f2-ac2f9f8cab6f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:01.138325 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff94d2-1bf6-48da-96c1-6115443f1c13 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:01.145457 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36965b6e-5e88-4621-9cf9-8f1e9082843c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:01.146086 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36965b6e-5e88-4621-9cf9-8f1e9082843c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:01.146371 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36965b6e-5e88-4621-9cf9-8f1e9082843c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:01.146649 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36965b6e-5e88-4621-9cf9-8f1e9082843c admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:01.147336 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36965b6e-5e88-4621-9cf9-8f1e9082843c admin admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:01.147663 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36965b6e-5e88-4621-9cf9-8f1e9082843c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:01.149456 dv-cinder-796170-6-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-36965b6e-5e88-4621-9cf9-8f1e9082843c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 12:20:01.149456 dv-cinder-796170-6-smb devstack@keystone.service[81458]: warnings.warn(msg) Oct 31 12:20:01.149456 dv-cinder-796170-6-smb devstack@keystone.service[81458]: Oct 31 12:20:01.150428 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36965b6e-5e88-4621-9cf9-8f1e9082843c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:01.153497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff94d2-1bf6-48da-96c1-6115443f1c13 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:01.158716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c022c49-6570-4f03-aff7-a630c6b6d2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:01.159656 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c022c49-6570-4f03-aff7-a630c6b6d2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:01.160166 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c022c49-6570-4f03-aff7-a630c6b6d2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:01.160627 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c022c49-6570-4f03-aff7-a630c6b6d2e2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:01.168596 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 130/261] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 31 12:20:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:01.175255 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36965b6e-5e88-4621-9cf9-8f1e9082843c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:01.176537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c022c49-6570-4f03-aff7-a630c6b6d2e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:01.182752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-8c022c49-6570-4f03-aff7-a630c6b6d2e2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 12:20:01.182752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:01.182752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:01.182752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:01.182752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:01.182752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:01.182752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:01.182752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:01.182752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:01.182752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:01.182752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:01.182752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:01.182752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:01.182752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:01.182752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:01.182752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:01.183640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:01.183640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:01.183640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:01.183640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:01.183640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:01.183640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:01.183640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:01.183640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:01.183640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:01.183640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:01.183640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:01.183640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:01.183640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:01.183640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:01.183640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:01.183640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:01.184423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:01.184423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:01.184423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:01.184423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:01.184423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:01.184423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:01.184423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:01.184423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:01.184423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:01.184423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:01.184423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 12:20:01.184423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:01.187269 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 132/262] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Oct 31 12:20:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:01.188860 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf4a6d-0a98-493e-baa8-e41e72af4404 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:01.189351 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf4a6d-0a98-493e-baa8-e41e72af4404 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:01.189761 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf4a6d-0a98-493e-baa8-e41e72af4404 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:01.190170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36965b6e-5e88-4621-9cf9-8f1e9082843c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:01.191429 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 133/263] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:01.197937 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb29df-f78e-4956-99b6-e9d63228aeac None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:01.198371 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb29df-f78e-4956-99b6-e9d63228aeac None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:01.198778 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb29df-f78e-4956-99b6-e9d63228aeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:01.200487 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5d199-2da6-4ff0-a71a-0b3ac99cdd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:01.201304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5d199-2da6-4ff0-a71a-0b3ac99cdd56 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:01.201691 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5d199-2da6-4ff0-a71a-0b3ac99cdd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:01.202071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5d199-2da6-4ff0-a71a-0b3ac99cdd56 admin admin] PATH_INFO: `/v3/groups/3dbe1aef145b41bc8d4ac358f4c4cf54` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:01.210355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5d199-2da6-4ff0-a71a-0b3ac99cdd56 admin admin] RBAC: Authorizing `identity:get_group(group_id=3dbe1aef145b41bc8d4ac358f4c4cf54)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:01.211355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-1fd5d199-2da6-4ff0-a71a-0b3ac99cdd56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 12:20:01.211355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: warnings.warn(msg) Oct 31 12:20:01.211355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: Oct 31 12:20:01.212221 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5d199-2da6-4ff0-a71a-0b3ac99cdd56 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:01.214524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 131/264] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Oct 31 12:20:01 2022] GET /identity/v3/groups/3dbe1aef145b41bc8d4ac358f4c4cf54 => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:01.215524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5d199-2da6-4ff0-a71a-0b3ac99cdd56 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:01.223038 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-aebb29df-f78e-4956-99b6-e9d63228aeac None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:01.225358 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-aebb29df-f78e-4956-99b6-e9d63228aeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:01.228390 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5d199-2da6-4ff0-a71a-0b3ac99cdd56 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:01.233395 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3f02a-ba44-4671-8eb4-9b33b37ddec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:01.234187 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3f02a-ba44-4671-8eb4-9b33b37ddec3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:01.234586 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3f02a-ba44-4671-8eb4-9b33b37ddec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:01.234971 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3f02a-ba44-4671-8eb4-9b33b37ddec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:01.235660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 134/265] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 12:20:01.235880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3f02a-ba44-4671-8eb4-9b33b37ddec3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:01.236301 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3f02a-ba44-4671-8eb4-9b33b37ddec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:01.237042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb29df-f78e-4956-99b6-e9d63228aeac None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:01.238230 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3f02a-ba44-4671-8eb4-9b33b37ddec3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:01.249381 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb29df-f78e-4956-99b6-e9d63228aeac None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:01.250355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 132/266] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Oct 31 12:20:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:01.254408 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc12c9-0b75-4f3d-90ab-0ab1fb6bd95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:01.255265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc12c9-0b75-4f3d-90ab-0ab1fb6bd95b admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:01.255718 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc12c9-0b75-4f3d-90ab-0ab1fb6bd95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:01.256162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc12c9-0b75-4f3d-90ab-0ab1fb6bd95b admin admin] PATH_INFO: `/v3/projects/a526fed604bd4419b5680a31eb366b07` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:01.256413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3f02a-ba44-4671-8eb4-9b33b37ddec3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:01.257865 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc12c9-0b75-4f3d-90ab-0ab1fb6bd95b admin admin] RBAC: Authorizing `identity:get_project(project_id=a526fed604bd4419b5680a31eb366b07)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:01.260837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc12c9-0b75-4f3d-90ab-0ab1fb6bd95b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:01.263230 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 135/267] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Oct 31 12:20:01 2022] GET /identity/v3/projects/a526fed604bd4419b5680a31eb366b07 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:01.268816 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc12c9-0b75-4f3d-90ab-0ab1fb6bd95b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:01.270249 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3f02a-ba44-4671-8eb4-9b33b37ddec3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:01.275249 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3870c7-a10e-45e5-983e-ebb775a693e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:01.276041 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3870c7-a10e-45e5-983e-ebb775a693e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:01.276438 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3870c7-a10e-45e5-983e-ebb775a693e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:01.277214 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3870c7-a10e-45e5-983e-ebb775a693e7 admin admin] PATH_INFO: `/v3/groups/3dbe1aef145b41bc8d4ac358f4c4cf54` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:01.278148 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3870c7-a10e-45e5-983e-ebb775a693e7 admin admin] RBAC: Authorizing `identity:get_group(group_id=3dbe1aef145b41bc8d4ac358f4c4cf54)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:01.280366 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3870c7-a10e-45e5-983e-ebb775a693e7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:01.281266 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc12c9-0b75-4f3d-90ab-0ab1fb6bd95b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:01.283751 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 133/268] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Oct 31 12:20:01 2022] GET /identity/v3/groups/3dbe1aef145b41bc8d4ac358f4c4cf54 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:01.288382 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b6eb8-d5b0-478e-8c0c-a36e5401e0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:01.289348 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b6eb8-d5b0-478e-8c0c-a36e5401e0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:01.289912 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b6eb8-d5b0-478e-8c0c-a36e5401e0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:01.290014 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3870c7-a10e-45e5-983e-ebb775a693e7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:01.290598 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b6eb8-d5b0-478e-8c0c-a36e5401e0fe admin admin] PATH_INFO: `/v3/projects/a526fed604bd4419b5680a31eb366b07/groups/3dbe1aef145b41bc8d4ac358f4c4cf54/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:01.293320 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b6eb8-d5b0-478e-8c0c-a36e5401e0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a526fed604bd4419b5680a31eb366b07, group_id=3dbe1aef145b41bc8d4ac358f4c4cf54, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:01.295868 dv-cinder-796170-6-smb devstack@keystone.service[81457]: WARNING py.warnings [None req-6e9b6eb8-d5b0-478e-8c0c-a36e5401e0fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 12:20:01.295868 dv-cinder-796170-6-smb devstack@keystone.service[81457]: warnings.warn(msg) Oct 31 12:20:01.295868 dv-cinder-796170-6-smb devstack@keystone.service[81457]: Oct 31 12:20:01.300731 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b6eb8-d5b0-478e-8c0c-a36e5401e0fe admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:01.303562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3870c7-a10e-45e5-983e-ebb775a693e7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:01.309197 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24e7ee-5520-42fc-bcfc-189e5898019d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:01.310205 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24e7ee-5520-42fc-bcfc-189e5898019d admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:01.310635 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24e7ee-5520-42fc-bcfc-189e5898019d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:01.311117 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24e7ee-5520-42fc-bcfc-189e5898019d admin admin] PATH_INFO: `/v3/projects/a526fed604bd4419b5680a31eb366b07` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:01.312698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24e7ee-5520-42fc-bcfc-189e5898019d admin admin] RBAC: Authorizing `identity:get_project(project_id=a526fed604bd4419b5680a31eb366b07)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:01.315191 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24e7ee-5520-42fc-bcfc-189e5898019d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:01.317955 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 134/269] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Oct 31 12:20:01 2022] GET /identity/v3/projects/a526fed604bd4419b5680a31eb366b07 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:01.328209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24e7ee-5520-42fc-bcfc-189e5898019d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:01.335904 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 136/270] 10.222.0.18 () {58 vars in 1463 bytes} [Mon Oct 31 12:20:01 2022] PUT /identity/v3/projects/a526fed604bd4419b5680a31eb366b07/groups/3dbe1aef145b41bc8d4ac358f4c4cf54/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:20:01.341827 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24e7ee-5520-42fc-bcfc-189e5898019d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:01.385553 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:01.420428 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3f0e6-6014-4d79-a738-3f4073b9cb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:01.421225 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3f0e6-6014-4d79-a738-3f4073b9cb63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:01.421550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3f0e6-6014-4d79-a738-3f4073b9cb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:01.421882 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3f0e6-6014-4d79-a738-3f4073b9cb63 admin admin] PATH_INFO: `/v3/projects/a526fed604bd4419b5680a31eb366b07/groups/3dbe1aef145b41bc8d4ac358f4c4cf54/roles/209186498dcb49a693401b009f73812e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:01.425325 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e3f0e6-6014-4d79-a738-3f4073b9cb63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a526fed604bd4419b5680a31eb366b07, group_id=3dbe1aef145b41bc8d4ac358f4c4cf54, role_id=209186498dcb49a693401b009f73812e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:01.426394 dv-cinder-796170-6-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-f2e3f0e6-6014-4d79-a738-3f4073b9cb63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 12:20:01.426394 dv-cinder-796170-6-smb devstack@keystone.service[81458]: warnings.warn(msg) Oct 31 12:20:01.426394 dv-cinder-796170-6-smb devstack@keystone.service[81458]: Oct 31 12:20:01.428662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e3f0e6-6014-4d79-a738-3f4073b9cb63 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:01.456406 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 135/271] 10.222.0.18 () {58 vars in 1463 bytes} [Mon Oct 31 12:20:01 2022] PUT /identity/v3/projects/a526fed604bd4419b5680a31eb366b07/groups/3dbe1aef145b41bc8d4ac358f4c4cf54/roles/209186498dcb49a693401b009f73812e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:20:01.499375 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff72c7f-bb89-47d4-b9a1-df8f0a5f4e4a None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:01.499944 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff72c7f-bb89-47d4-b9a1-df8f0a5f4e4a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:01.500023 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff72c7f-bb89-47d4-b9a1-df8f0a5f4e4a None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:01.501514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 137/272] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:01.507708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92b137-aa92-4c8e-8153-5e6018d9562d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:01.508223 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92b137-aa92-4c8e-8153-5e6018d9562d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:01.508312 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92b137-aa92-4c8e-8153-5e6018d9562d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:01.534486 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6b92b137-aa92-4c8e-8153-5e6018d9562d None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:01.535750 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6b92b137-aa92-4c8e-8153-5e6018d9562d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:01.639506 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 136/273] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:01.845321 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff72c7f-bb89-47d4-b9a1-df8f0a5f4e4a None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:01.913171 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:01.919907 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff72c7f-bb89-47d4-b9a1-df8f0a5f4e4a None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:01.925696 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee247c-d4d7-458a-b9ac-11903c8b4aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:01.926773 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee247c-d4d7-458a-b9ac-11903c8b4aae admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:01.927432 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee247c-d4d7-458a-b9ac-11903c8b4aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:01.927980 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee247c-d4d7-458a-b9ac-11903c8b4aae admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:01.940172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee247c-d4d7-458a-b9ac-11903c8b4aae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:01.946417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-5aee247c-d4d7-458a-b9ac-11903c8b4aae admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:20:01.946417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:01.946417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:01.946417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:01.946417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:01.946417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:01.946417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:01.946417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:01.946417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:01.946417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:01.946417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:01.946417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:01.946417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:01.946417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:01.946417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:01.946417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:01.947322 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:01.947322 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:01.947322 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:01.947322 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:01.947322 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:01.947322 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:01.947322 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:01.947322 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:01.947322 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:01.947322 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:01.947322 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:01.947322 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:01.947322 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:01.947322 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:01.947322 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:01.947322 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:01.948092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:01.948092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:01.948092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:01.948092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:01.948092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:01.948092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:01.948092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:01.948092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:01.948092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:01.948092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:01.948092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:20:01.948092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:01.948092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 138/274] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Oct 31 12:20:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:01.953653 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92b137-aa92-4c8e-8153-5e6018d9562d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:01.978730 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92b137-aa92-4c8e-8153-5e6018d9562d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:01.986593 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4bd99-0fc0-4bdd-a5fe-0bfa0c0c3297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:01.987211 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4bd99-0fc0-4bdd-a5fe-0bfa0c0c3297 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:01.987487 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4bd99-0fc0-4bdd-a5fe-0bfa0c0c3297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:01.987759 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4bd99-0fc0-4bdd-a5fe-0bfa0c0c3297 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:01.988436 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4bd99-0fc0-4bdd-a5fe-0bfa0c0c3297 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:01.988739 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4bd99-0fc0-4bdd-a5fe-0bfa0c0c3297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:01.990364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4bd99-0fc0-4bdd-a5fe-0bfa0c0c3297 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:02.004750 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 137/275] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 31 12:20:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:02.010419 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee247c-d4d7-458a-b9ac-11903c8b4aae admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:02.023425 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee247c-d4d7-458a-b9ac-11903c8b4aae admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:02.030790 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687aa5a-237c-448d-9f92-2e50d2098a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:02.031426 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687aa5a-237c-448d-9f92-2e50d2098a15 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:02.031758 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687aa5a-237c-448d-9f92-2e50d2098a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:02.032034 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687aa5a-237c-448d-9f92-2e50d2098a15 admin admin] PATH_INFO: `/v3/groups/3dbe1aef145b41bc8d4ac358f4c4cf54` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:02.034377 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687aa5a-237c-448d-9f92-2e50d2098a15 admin admin] RBAC: Authorizing `identity:get_group(group_id=3dbe1aef145b41bc8d4ac358f4c4cf54)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:02.035394 dv-cinder-796170-6-smb devstack@keystone.service[81457]: WARNING py.warnings [None req-7687aa5a-237c-448d-9f92-2e50d2098a15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 12:20:02.035394 dv-cinder-796170-6-smb devstack@keystone.service[81457]: warnings.warn(msg) Oct 31 12:20:02.035394 dv-cinder-796170-6-smb devstack@keystone.service[81457]: Oct 31 12:20:02.036919 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687aa5a-237c-448d-9f92-2e50d2098a15 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:02.038654 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 139/276] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Oct 31 12:20:02 2022] GET /identity/v3/groups/3dbe1aef145b41bc8d4ac358f4c4cf54 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:02.044811 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4bd99-0fc0-4bdd-a5fe-0bfa0c0c3297 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:02.058152 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4bd99-0fc0-4bdd-a5fe-0bfa0c0c3297 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:02.072619 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db9a3a-9978-4f39-ab99-568bef607eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:02.072619 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db9a3a-9978-4f39-ab99-568bef607eaa admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:02.072619 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db9a3a-9978-4f39-ab99-568bef607eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:02.072619 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db9a3a-9978-4f39-ab99-568bef607eaa admin admin] PATH_INFO: `/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:02.073901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db9a3a-9978-4f39-ab99-568bef607eaa admin admin] RBAC: Authorizing `identity:get_project(project_id=acf5fd24975f479ea610ce5bcefe7dcc)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:02.075980 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db9a3a-9978-4f39-ab99-568bef607eaa admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:02.078022 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 138/277] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Oct 31 12:20:02 2022] GET /identity/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:02.083733 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687aa5a-237c-448d-9f92-2e50d2098a15 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:02.098318 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687aa5a-237c-448d-9f92-2e50d2098a15 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:02.109580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88de4a2-46fd-494f-8380-dd59ec73c18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:02.110310 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88de4a2-46fd-494f-8380-dd59ec73c18a admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:02.110652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88de4a2-46fd-494f-8380-dd59ec73c18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:02.110928 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88de4a2-46fd-494f-8380-dd59ec73c18a admin admin] PATH_INFO: `/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc/groups/3dbe1aef145b41bc8d4ac358f4c4cf54/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:02.113911 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88de4a2-46fd-494f-8380-dd59ec73c18a admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf5fd24975f479ea610ce5bcefe7dcc, group_id=3dbe1aef145b41bc8d4ac358f4c4cf54, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:02.116763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88de4a2-46fd-494f-8380-dd59ec73c18a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:02.142672 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 140/278] 10.222.0.18 () {58 vars in 1463 bytes} [Mon Oct 31 12:20:02 2022] PUT /identity/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc/groups/3dbe1aef145b41bc8d4ac358f4c4cf54/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:20:02.198023 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db9a3a-9978-4f39-ab99-568bef607eaa admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:02.310042 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:02.333592 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db9a3a-9978-4f39-ab99-568bef607eaa admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:02.373537 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12102ac-3ce4-4e21-8f97-de35310ff7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:02.374546 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12102ac-3ce4-4e21-8f97-de35310ff7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:02.375044 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12102ac-3ce4-4e21-8f97-de35310ff7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:02.375506 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12102ac-3ce4-4e21-8f97-de35310ff7e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:02.386793 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12102ac-3ce4-4e21-8f97-de35310ff7e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:02.392607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-c12102ac-3ce4-4e21-8f97-de35310ff7e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 12:20:02.392607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:02.392607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:02.392607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:02.392607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:02.392607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:02.392607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:02.392607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:02.392607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:02.392607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:02.392607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:02.392607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:02.392607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:02.392607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:02.392607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:02.392607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:02.393532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:02.393532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:02.393532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:02.393532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:02.393532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:02.393532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:02.393532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:02.393532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:02.393532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:02.393532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:02.393532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:02.393532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:02.393532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:02.393532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:02.393532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:02.393532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:02.394347 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:02.394347 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:02.394347 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:02.394347 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:02.394347 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:02.394347 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:02.394347 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:02.394347 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:02.394347 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:02.394347 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:02.394347 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 12:20:02.394347 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:02.396936 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 139/279] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:20:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:02.403540 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88de4a2-46fd-494f-8380-dd59ec73c18a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:02.510287 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88de4a2-46fd-494f-8380-dd59ec73c18a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:02.549904 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e49f3-c905-4e44-959b-19b67b3f35aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:02.550889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e49f3-c905-4e44-959b-19b67b3f35aa None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:02.551374 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e49f3-c905-4e44-959b-19b67b3f35aa None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:02.551836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e49f3-c905-4e44-959b-19b67b3f35aa None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:02.552693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e49f3-c905-4e44-959b-19b67b3f35aa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:02.553212 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e49f3-c905-4e44-959b-19b67b3f35aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:02.554766 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e49f3-c905-4e44-959b-19b67b3f35aa None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:02.564985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 141/280] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 31 12:20:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:02.571182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12102ac-3ce4-4e21-8f97-de35310ff7e9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:02.688491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12102ac-3ce4-4e21-8f97-de35310ff7e9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:02.724505 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617c3c3-25bb-46c4-9e65-4e00c17cc7a3 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:02.725158 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617c3c3-25bb-46c4-9e65-4e00c17cc7a3 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:02.725642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617c3c3-25bb-46c4-9e65-4e00c17cc7a3 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:02.727189 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 142/281] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:20:02.732470 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e42c6c-569c-4531-a06a-d16b80f6ee8d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:02.732758 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e42c6c-569c-4531-a06a-d16b80f6ee8d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:02.733050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e42c6c-569c-4531-a06a-d16b80f6ee8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:02.737077 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eaf206-a475-4a2b-857c-e83732bc9577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:02.737969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaf206-a475-4a2b-857c-e83732bc9577 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:02.738460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaf206-a475-4a2b-857c-e83732bc9577 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:02.738926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaf206-a475-4a2b-857c-e83732bc9577 None admin] PATH_INFO: `/v3/users/2cf589b5d683428cb367fbddaa5ba6ab` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:02.740249 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eaf206-a475-4a2b-857c-e83732bc9577 None admin] RBAC: Authorizing `identity:get_user(user_id=2cf589b5d683428cb367fbddaa5ba6ab)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:02.742254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eaf206-a475-4a2b-857c-e83732bc9577 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:02.744850 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 140/282] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:20:02 2022] GET /identity/v3/users/2cf589b5d683428cb367fbddaa5ba6ab => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:02.751447 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eaf206-a475-4a2b-857c-e83732bc9577 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:02.770223 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-68e42c6c-569c-4531-a06a-d16b80f6ee8d None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:02.771366 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-68e42c6c-569c-4531-a06a-d16b80f6ee8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:02.774289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:02.855674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:02.914485 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eaf206-a475-4a2b-857c-e83732bc9577 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:02.918798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 143/283] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 12:20:02.964855 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffe85a-6bbc-4360-af94-9bfb10a07d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:02.965564 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffe85a-6bbc-4360-af94-9bfb10a07d2f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:02.965851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffe85a-6bbc-4360-af94-9bfb10a07d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:02.966130 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffe85a-6bbc-4360-af94-9bfb10a07d2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:02.966937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ffe85a-6bbc-4360-af94-9bfb10a07d2f None admin] RBAC: Adding query filter params (role.id=f352dab941ec48a589c0f614999dbeb3, user.id=2cf589b5d683428cb367fbddaa5ba6ab, scope.system=all) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:02.967251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ffe85a-6bbc-4360-af94-9bfb10a07d2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:02.968705 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ffe85a-6bbc-4360-af94-9bfb10a07d2f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:02.986331 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 141/284] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Oct 31 12:20:02 2022] GET /identity/v3/role_assignments?user.id=2cf589b5d683428cb367fbddaa5ba6ab&scope.system=all&role.id=f352dab941ec48a589c0f614999dbeb3 => generated 510 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:03.322564 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e42c6c-569c-4531-a06a-d16b80f6ee8d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:03.333243 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e42c6c-569c-4531-a06a-d16b80f6ee8d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:03.338203 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0114c4a-0697-4065-a449-223530dfeda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:03.338845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0114c4a-0697-4065-a449-223530dfeda0 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:03.339124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0114c4a-0697-4065-a449-223530dfeda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:03.339396 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0114c4a-0697-4065-a449-223530dfeda0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:03.355018 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0114c4a-0697-4065-a449-223530dfeda0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:03.360314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-a0114c4a-0697-4065-a449-223530dfeda0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 12:20:03.360314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:03.360314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:03.360314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:03.360314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:03.360314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:03.360314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:03.360314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:03.360314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:03.360314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:03.360314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:03.360314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:03.360314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:03.360314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:03.360314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:03.360314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:03.361217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:03.361217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:03.361217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:03.361217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:03.361217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:03.361217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:03.361217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:03.361217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:03.361217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:03.361217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:03.361217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:03.361217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:03.361217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:03.361217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:03.361217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:03.361217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:03.362018 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:03.362018 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:03.362018 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:03.362018 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:03.362018 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:03.362018 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:03.362018 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:03.362018 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:03.362018 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:03.362018 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:03.362018 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 12:20:03.362018 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:03.364244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 144/285] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Oct 31 12:20:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:03.370449 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffe85a-6bbc-4360-af94-9bfb10a07d2f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:03.381457 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffe85a-6bbc-4360-af94-9bfb10a07d2f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:03.387642 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed091564-2e45-4fc0-ad1b-6791d34c5ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:03.388507 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed091564-2e45-4fc0-ad1b-6791d34c5ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:03.388981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed091564-2e45-4fc0-ad1b-6791d34c5ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:03.389467 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed091564-2e45-4fc0-ad1b-6791d34c5ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:03.390351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed091564-2e45-4fc0-ad1b-6791d34c5ef2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:03.390862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed091564-2e45-4fc0-ad1b-6791d34c5ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:03.392651 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed091564-2e45-4fc0-ad1b-6791d34c5ef2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:03.403763 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 142/286] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Oct 31 12:20:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:03.408915 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0114c4a-0697-4065-a449-223530dfeda0 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:03.420887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0114c4a-0697-4065-a449-223530dfeda0 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:03.425780 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17273a-16ae-4670-9672-c3ddc073c2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:03.426701 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17273a-16ae-4670-9672-c3ddc073c2cd admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:03.427222 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17273a-16ae-4670-9672-c3ddc073c2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:03.427775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17273a-16ae-4670-9672-c3ddc073c2cd admin admin] PATH_INFO: `/v3/groups/3dbe1aef145b41bc8d4ac358f4c4cf54` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:03.429150 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17273a-16ae-4670-9672-c3ddc073c2cd admin admin] RBAC: Authorizing `identity:get_group(group_id=3dbe1aef145b41bc8d4ac358f4c4cf54)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:03.431448 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17273a-16ae-4670-9672-c3ddc073c2cd admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:03.433764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 145/287] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Oct 31 12:20:03 2022] GET /identity/v3/groups/3dbe1aef145b41bc8d4ac358f4c4cf54 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:03.439311 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed091564-2e45-4fc0-ad1b-6791d34c5ef2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:03.453593 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed091564-2e45-4fc0-ad1b-6791d34c5ef2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:03.458900 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcfd43-4ef5-41d3-837c-f2629a850c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:03.459992 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcfd43-4ef5-41d3-837c-f2629a850c3c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:03.460531 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcfd43-4ef5-41d3-837c-f2629a850c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:03.461049 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcfd43-4ef5-41d3-837c-f2629a850c3c admin admin] PATH_INFO: `/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:03.463209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcfd43-4ef5-41d3-837c-f2629a850c3c admin admin] RBAC: Authorizing `identity:get_project(project_id=acf5fd24975f479ea610ce5bcefe7dcc)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:03.465721 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcfd43-4ef5-41d3-837c-f2629a850c3c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:03.468200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 143/288] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Oct 31 12:20:03 2022] GET /identity/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:03.473614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17273a-16ae-4670-9672-c3ddc073c2cd admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:03.485705 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17273a-16ae-4670-9672-c3ddc073c2cd admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:03.490556 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6188e-465e-4b70-92e7-d4bd3c1c377b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:03.491491 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6188e-465e-4b70-92e7-d4bd3c1c377b admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:03.491984 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6188e-465e-4b70-92e7-d4bd3c1c377b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:03.492508 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6188e-465e-4b70-92e7-d4bd3c1c377b admin admin] PATH_INFO: `/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc/groups/3dbe1aef145b41bc8d4ac358f4c4cf54/roles/209186498dcb49a693401b009f73812e` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:03.494920 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6188e-465e-4b70-92e7-d4bd3c1c377b admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf5fd24975f479ea610ce5bcefe7dcc, group_id=3dbe1aef145b41bc8d4ac358f4c4cf54, role_id=209186498dcb49a693401b009f73812e)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:03.498100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6188e-465e-4b70-92e7-d4bd3c1c377b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:03.522511 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 146/289] 10.222.0.18 () {58 vars in 1463 bytes} [Mon Oct 31 12:20:03 2022] PUT /identity/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc/groups/3dbe1aef145b41bc8d4ac358f4c4cf54/roles/209186498dcb49a693401b009f73812e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:20:03.635010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1da154-49cd-44ff-ada0-1e6995f82740 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:03.636031 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1da154-49cd-44ff-ada0-1e6995f82740 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:03.636536 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1da154-49cd-44ff-ada0-1e6995f82740 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:03.638221 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 144/290] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:03.644230 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0e20d-8f46-4bc5-979e-fd24960e7d1e None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:03.644905 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0e20d-8f46-4bc5-979e-fd24960e7d1e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:03.645407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0e20d-8f46-4bc5-979e-fd24960e7d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:03.669076 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-bdb0e20d-8f46-4bc5-979e-fd24960e7d1e None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:03.670808 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-bdb0e20d-8f46-4bc5-979e-fd24960e7d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:03.750151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 147/291] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 12:20:04.159416 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1da154-49cd-44ff-ada0-1e6995f82740 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:04.175351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1da154-49cd-44ff-ada0-1e6995f82740 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:04.180025 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e61c75-836c-4749-abb0-25a034647ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:04.180948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e61c75-836c-4749-abb0-25a034647ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:04.181502 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e61c75-836c-4749-abb0-25a034647ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:04.181966 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e61c75-836c-4749-abb0-25a034647ec6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:04.195471 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e61c75-836c-4749-abb0-25a034647ec6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:04.202024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-10e61c75-836c-4749-abb0-25a034647ec6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:20:04.202024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:04.202024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:04.202024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:04.202024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:04.202024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:04.202024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:04.202024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:04.202024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:04.202024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:04.202024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:04.202024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:04.202024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:04.202024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:04.202024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:04.202024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:04.202926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:04.202926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:04.202926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:04.202926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:04.202926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:04.202926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:04.202926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:04.202926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:04.202926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:04.202926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:04.202926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:04.202926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:04.202926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:04.202926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:04.202926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:04.202926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:04.203719 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:04.203719 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:04.203719 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:04.203719 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:04.203719 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:04.203719 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:04.203719 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:04.203719 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:04.203719 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:04.203719 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:04.203719 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:20:04.203719 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:04.206397 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 145/292] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Oct 31 12:20:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:04.211894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0e20d-8f46-4bc5-979e-fd24960e7d1e None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:04.229314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0e20d-8f46-4bc5-979e-fd24960e7d1e None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:04.239598 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f5001-4aa1-459a-ba51-4c1ddd207f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:04.240217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f5001-4aa1-459a-ba51-4c1ddd207f7b admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:04.240495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f5001-4aa1-459a-ba51-4c1ddd207f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:04.240764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f5001-4aa1-459a-ba51-4c1ddd207f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:04.241461 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f5001-4aa1-459a-ba51-4c1ddd207f7b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:04.241761 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f5001-4aa1-459a-ba51-4c1ddd207f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:04.242770 dv-cinder-796170-6-smb devstack@keystone.service[81457]: WARNING py.warnings [None req-e84f5001-4aa1-459a-ba51-4c1ddd207f7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 12:20:04.242770 dv-cinder-796170-6-smb devstack@keystone.service[81457]: warnings.warn(msg) Oct 31 12:20:04.242770 dv-cinder-796170-6-smb devstack@keystone.service[81457]: Oct 31 12:20:04.243710 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f5001-4aa1-459a-ba51-4c1ddd207f7b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:04.257019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 148/293] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Oct 31 12:20:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:04.262470 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e61c75-836c-4749-abb0-25a034647ec6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:04.278934 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e61c75-836c-4749-abb0-25a034647ec6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:04.283801 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d992d-036e-4f86-9afd-77a331fdda40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:04.284692 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d992d-036e-4f86-9afd-77a331fdda40 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:04.285185 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d992d-036e-4f86-9afd-77a331fdda40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:04.285682 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d992d-036e-4f86-9afd-77a331fdda40 admin admin] PATH_INFO: `/v3/groups/5776741d31d046c2a517f90b7188e5c1` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:04.293492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d992d-036e-4f86-9afd-77a331fdda40 admin admin] RBAC: Authorizing `identity:get_group(group_id=5776741d31d046c2a517f90b7188e5c1)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:04.295413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d992d-036e-4f86-9afd-77a331fdda40 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:04.298193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 146/294] 10.222.0.18 () {56 vars in 1201 bytes} [Mon Oct 31 12:20:04 2022] GET /identity/v3/groups/5776741d31d046c2a517f90b7188e5c1 => generated 229 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:04.302630 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f5001-4aa1-459a-ba51-4c1ddd207f7b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:04.319106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f5001-4aa1-459a-ba51-4c1ddd207f7b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:04.330436 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c07be0-d914-4d91-a453-7e562112d790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:04.331021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c07be0-d914-4d91-a453-7e562112d790 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:04.331305 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c07be0-d914-4d91-a453-7e562112d790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:04.331578 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c07be0-d914-4d91-a453-7e562112d790 admin admin] PATH_INFO: `/v3/projects/771b2157d2a94a5f8b2df37d397dbb5d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:04.338351 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c07be0-d914-4d91-a453-7e562112d790 admin admin] RBAC: Authorizing `identity:get_project(project_id=771b2157d2a94a5f8b2df37d397dbb5d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:04.340181 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c07be0-d914-4d91-a453-7e562112d790 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:04.341877 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 149/295] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Oct 31 12:20:04 2022] GET /identity/v3/projects/771b2157d2a94a5f8b2df37d397dbb5d => generated 344 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:04.347603 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d992d-036e-4f86-9afd-77a331fdda40 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:04.362258 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d992d-036e-4f86-9afd-77a331fdda40 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:04.369249 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed95ac-52d3-4412-ac6d-efd725e9c906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:04.369913 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed95ac-52d3-4412-ac6d-efd725e9c906 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:04.370195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed95ac-52d3-4412-ac6d-efd725e9c906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:04.370466 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed95ac-52d3-4412-ac6d-efd725e9c906 admin admin] PATH_INFO: `/v3/projects/771b2157d2a94a5f8b2df37d397dbb5d/groups/5776741d31d046c2a517f90b7188e5c1/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:04.378433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed95ac-52d3-4412-ac6d-efd725e9c906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=771b2157d2a94a5f8b2df37d397dbb5d, group_id=5776741d31d046c2a517f90b7188e5c1, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:04.381091 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed95ac-52d3-4412-ac6d-efd725e9c906 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:04.407915 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 147/296] 10.222.0.18 () {58 vars in 1463 bytes} [Mon Oct 31 12:20:04 2022] PUT /identity/v3/projects/771b2157d2a94a5f8b2df37d397dbb5d/groups/5776741d31d046c2a517f90b7188e5c1/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:20:04.771983 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acccd5-2b80-4d2e-9b24-17901c09e63c None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:04.772491 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acccd5-2b80-4d2e-9b24-17901c09e63c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:04.772648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acccd5-2b80-4d2e-9b24-17901c09e63c None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:04.774501 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 150/297] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:04.780317 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d9cae-f807-4983-8d02-2fd7349687dc None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:04.780766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d9cae-f807-4983-8d02-2fd7349687dc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:04.780911 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d9cae-f807-4983-8d02-2fd7349687dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:04.802091 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-735d9cae-f807-4983-8d02-2fd7349687dc None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:04.803309 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-735d9cae-f807-4983-8d02-2fd7349687dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:04.825776 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:04.827501 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bcb00-b8cb-40be-a411-bd5e8b386ccc None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:04.827801 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bcb00-b8cb-40be-a411-bd5e8b386ccc None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:04.828128 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bcb00-b8cb-40be-a411-bd5e8b386ccc None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:04.829747 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 151/298] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:04.836191 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a254e8-5a4c-4553-aba8-4354d58df4f6 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:04.836472 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a254e8-5a4c-4553-aba8-4354d58df4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:04.836757 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a254e8-5a4c-4553-aba8-4354d58df4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:04.861651 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f4a254e8-5a4c-4553-aba8-4354d58df4f6 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:04.863147 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f4a254e8-5a4c-4553-aba8-4354d58df4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:04.899968 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 148/299] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:04.948632 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 152/300] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 12:20:05.341286 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69f98b-e2a2-4ede-80b2-266aba735f58 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:05.341578 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69f98b-e2a2-4ede-80b2-266aba735f58 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:05.341853 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69f98b-e2a2-4ede-80b2-266aba735f58 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:05.343459 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 149/301] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:05.348652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f84b01-1a34-4e53-bc61-41eb9da6a451 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:05.348936 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f84b01-1a34-4e53-bc61-41eb9da6a451 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:05.349233 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f84b01-1a34-4e53-bc61-41eb9da6a451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:05.371332 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d2f84b01-1a34-4e53-bc61-41eb9da6a451 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:05.372522 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d2f84b01-1a34-4e53-bc61-41eb9da6a451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:05.380272 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69f98b-e2a2-4ede-80b2-266aba735f58 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:05.391143 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:05.458921 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 153/302] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:05.459855 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f84b01-1a34-4e53-bc61-41eb9da6a451 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:05.499361 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69f98b-e2a2-4ede-80b2-266aba735f58 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:05.536529 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ba430-dfd8-46ff-b3d7-0941b898ba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:05.537544 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ba430-dfd8-46ff-b3d7-0941b898ba84 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:05.538053 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ba430-dfd8-46ff-b3d7-0941b898ba84 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:05.538528 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ba430-dfd8-46ff-b3d7-0941b898ba84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:05.550656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ba430-dfd8-46ff-b3d7-0941b898ba84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:05.556737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-8d0ba430-dfd8-46ff-b3d7-0941b898ba84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:20:05.556737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:05.556737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:05.556737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:05.556737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:05.556737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:05.556737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:05.556737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:05.556737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:05.556737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:05.556737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:05.556737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:05.556737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:05.556737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:05.556737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:05.556737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:05.557644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:05.557644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:05.557644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:05.557644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:05.557644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:05.557644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:05.557644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:05.557644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:05.557644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:05.557644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:05.557644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:05.557644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:05.557644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:05.557644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:05.557644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:05.557644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:05.558447 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:05.558447 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:05.558447 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:05.558447 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:05.558447 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:05.558447 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:05.558447 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:05.558447 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:05.558447 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:05.558447 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:05.558447 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:20:05.558447 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:05.561138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 150/303] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:20:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:05.567037 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ba430-dfd8-46ff-b3d7-0941b898ba84 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:05.587722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:05.661393 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f84b01-1a34-4e53-bc61-41eb9da6a451 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:05.682046 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ba430-dfd8-46ff-b3d7-0941b898ba84 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:05.719276 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccea338-fc77-48dc-8960-8220ec93bd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:05.720388 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccea338-fc77-48dc-8960-8220ec93bd5a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:05.721716 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccea338-fc77-48dc-8960-8220ec93bd5a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:05.722844 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccea338-fc77-48dc-8960-8220ec93bd5a None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:05.723719 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccea338-fc77-48dc-8960-8220ec93bd5a None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:05.724396 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccea338-fc77-48dc-8960-8220ec93bd5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:05.730388 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccea338-fc77-48dc-8960-8220ec93bd5a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:05.732434 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b67fe6-5977-479b-8e30-8ce34a5744bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:05.733713 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b67fe6-5977-479b-8e30-8ce34a5744bb None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:05.734218 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b67fe6-5977-479b-8e30-8ce34a5744bb None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:05.734689 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b67fe6-5977-479b-8e30-8ce34a5744bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:05.742826 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 151/304] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 31 12:20:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:05.754786 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b67fe6-5977-479b-8e30-8ce34a5744bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:05.755254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccea338-fc77-48dc-8960-8220ec93bd5a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:05.760971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-c9b67fe6-5977-479b-8e30-8ce34a5744bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 12:20:05.760971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:05.760971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:05.760971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:05.760971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:05.760971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:05.760971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:05.760971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:05.760971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:05.760971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:05.760971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:05.760971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:05.760971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:05.760971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:05.760971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:05.760971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:05.761972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:05.761972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:05.761972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:05.761972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:05.761972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:05.761972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:05.761972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:05.761972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:05.761972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:05.761972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:05.761972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:05.761972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:05.761972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:05.761972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:05.761972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:05.761972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:05.762776 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:05.762776 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:05.762776 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:05.762776 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:05.762776 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:05.762776 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:05.762776 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:05.762776 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:05.762776 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:05.762776 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:05.762776 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 12:20:05.762776 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:05.766067 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 154/305] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 31 12:20:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:05.779282 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b67fe6-5977-479b-8e30-8ce34a5744bb None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:05.799183 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:05.902927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:05.927735 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccea338-fc77-48dc-8960-8220ec93bd5a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:05.942956 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b67fe6-5977-479b-8e30-8ce34a5744bb None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:05.969575 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ae16e-2aa3-4367-bfeb-cb8acadce967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:05.970197 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ae16e-2aa3-4367-bfeb-cb8acadce967 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:05.970477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ae16e-2aa3-4367-bfeb-cb8acadce967 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:05.970749 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ae16e-2aa3-4367-bfeb-cb8acadce967 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:05.989784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16c561-656e-4f12-9cc1-f6d808f89c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:05.990976 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16c561-656e-4f12-9cc1-f6d808f89c2c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:05.991826 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16c561-656e-4f12-9cc1-f6d808f89c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:05.992336 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16c561-656e-4f12-9cc1-f6d808f89c2c None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:05.993244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16c561-656e-4f12-9cc1-f6d808f89c2c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:05.993891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16c561-656e-4f12-9cc1-f6d808f89c2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:05.996212 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16c561-656e-4f12-9cc1-f6d808f89c2c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:06.008291 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 155/306] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:06.009967 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16c561-656e-4f12-9cc1-f6d808f89c2c None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:06.055878 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ae16e-2aa3-4367-bfeb-cb8acadce967 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:06.057355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ae16e-2aa3-4367-bfeb-cb8acadce967 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:06.104629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:06.148481 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16c561-656e-4f12-9cc1-f6d808f89c2c None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:06.159030 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:06.186215 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988c501-b0b6-4267-8d4b-2d23b4fd0de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:06.186774 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988c501-b0b6-4267-8d4b-2d23b4fd0de4 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:06.187056 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988c501-b0b6-4267-8d4b-2d23b4fd0de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:06.187329 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988c501-b0b6-4267-8d4b-2d23b4fd0de4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:06.188596 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 152/307] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:20:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 31 12:20:06.193774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ae16e-2aa3-4367-bfeb-cb8acadce967 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:06.203310 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988c501-b0b6-4267-8d4b-2d23b4fd0de4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:06.208642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-b988c501-b0b6-4267-8d4b-2d23b4fd0de4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:20:06.208642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:06.208642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:06.208642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:06.208642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:06.208642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:06.208642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:06.208642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:06.208642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:06.208642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:06.208642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:06.208642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:06.208642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:06.208642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:06.208642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:06.208642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:06.213917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:06.213917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:06.213917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:06.213917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:06.213917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:06.213917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:06.213917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:06.213917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:06.213917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:06.213917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:06.213917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:06.213917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:06.213917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:06.213917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:06.213917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:06.213917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:06.214744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:06.214744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:06.214744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:06.214744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:06.214744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:06.214744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:06.214744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:06.214744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:06.214744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:06.214744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:06.214744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 12:20:06.214744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:06.214744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 156/308] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:20:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:06.214744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988c501-b0b6-4267-8d4b-2d23b4fd0de4 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:06.310555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ae16e-2aa3-4367-bfeb-cb8acadce967 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:06.328493 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988c501-b0b6-4267-8d4b-2d23b4fd0de4 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:06.348044 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75b366-f107-40ea-8f13-7be63e8520cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:06.348974 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75b366-f107-40ea-8f13-7be63e8520cd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:06.349485 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75b366-f107-40ea-8f13-7be63e8520cd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:06.349956 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75b366-f107-40ea-8f13-7be63e8520cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:06.362540 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:06.370689 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b1e76-9619-4aa2-b4e9-511afa9a547d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:06.371328 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b1e76-9619-4aa2-b4e9-511afa9a547d None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:06.371611 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b1e76-9619-4aa2-b4e9-511afa9a547d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:06.371887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b1e76-9619-4aa2-b4e9-511afa9a547d None admin] PATH_INFO: `/v3/projects/a526fed604bd4419b5680a31eb366b07` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:06.373019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b1e76-9619-4aa2-b4e9-511afa9a547d None admin] RBAC: Authorizing `identity:get_project(project_id=a526fed604bd4419b5680a31eb366b07)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:06.374502 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b1e76-9619-4aa2-b4e9-511afa9a547d None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:06.376148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 157/309] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:20:06 2022] GET /identity/v3/projects/a526fed604bd4419b5680a31eb366b07 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:06.377426 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b1e76-9619-4aa2-b4e9-511afa9a547d None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:06.410932 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:06.438167 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75b366-f107-40ea-8f13-7be63e8520cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:06.439943 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75b366-f107-40ea-8f13-7be63e8520cd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:06.517166 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b1e76-9619-4aa2-b4e9-511afa9a547d None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:06.547809 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 153/310] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:20:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 12:20:06.548985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75b366-f107-40ea-8f13-7be63e8520cd None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:06.576781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059974b3-4f2e-4ec7-b277-f68567c7f42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:06.577441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059974b3-4f2e-4ec7-b277-f68567c7f42b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:06.577718 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059974b3-4f2e-4ec7-b277-f68567c7f42b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:06.577984 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059974b3-4f2e-4ec7-b277-f68567c7f42b None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:06.578835 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059974b3-4f2e-4ec7-b277-f68567c7f42b None admin] RBAC: Adding query filter params (name=member) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:06.578942 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059974b3-4f2e-4ec7-b277-f68567c7f42b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:06.580306 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059974b3-4f2e-4ec7-b277-f68567c7f42b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:06.592520 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 158/311] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 31 12:20:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:06.597148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4453b-8115-4f95-9f84-b1cb18a57056 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:06.597148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4453b-8115-4f95-9f84-b1cb18a57056 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:06.597148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4453b-8115-4f95-9f84-b1cb18a57056 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:06.597516 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 159/312] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:06.598199 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4453b-8115-4f95-9f84-b1cb18a57056 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:06.656717 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:06.675675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75b366-f107-40ea-8f13-7be63e8520cd None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:06.686047 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:06.718434 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262c6de-da49-4b80-b966-2e3232414e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:06.719016 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262c6de-da49-4b80-b966-2e3232414e83 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:06.719446 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262c6de-da49-4b80-b966-2e3232414e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:06.719726 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262c6de-da49-4b80-b966-2e3232414e83 None admin] PATH_INFO: `/v3/groups/3dbe1aef145b41bc8d4ac358f4c4cf54` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:06.720907 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262c6de-da49-4b80-b966-2e3232414e83 None admin] RBAC: Authorizing `identity:get_group(group_id=3dbe1aef145b41bc8d4ac358f4c4cf54)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:06.724535 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262c6de-da49-4b80-b966-2e3232414e83 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:06.726466 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 154/313] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Oct 31 12:20:06 2022] GET /identity/v3/groups/3dbe1aef145b41bc8d4ac358f4c4cf54 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:06.727462 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262c6de-da49-4b80-b966-2e3232414e83 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:06.738421 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4453b-8115-4f95-9f84-b1cb18a57056 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:06.782885 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cac647-7452-4c31-b20e-58142fc9a10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:06.783513 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cac647-7452-4c31-b20e-58142fc9a10c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:06.784565 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cac647-7452-4c31-b20e-58142fc9a10c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:06.784844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cac647-7452-4c31-b20e-58142fc9a10c None admin] PATH_INFO: `/v3/projects/a526fed604bd4419b5680a31eb366b07` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:06.786293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cac647-7452-4c31-b20e-58142fc9a10c None admin] RBAC: Authorizing `identity:get_project(project_id=a526fed604bd4419b5680a31eb366b07)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:06.787744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cac647-7452-4c31-b20e-58142fc9a10c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:06.793143 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 160/314] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:20:06 2022] GET /identity/v3/projects/a526fed604bd4419b5680a31eb366b07 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:06.793143 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f3c18-1c67-42eb-bca1-bf8bee0fc2e9 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:06.793143 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f3c18-1c67-42eb-bca1-bf8bee0fc2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:06.793143 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f3c18-1c67-42eb-bca1-bf8bee0fc2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:06.810843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d70f3c18-1c67-42eb-bca1-bf8bee0fc2e9 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:06.812031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d70f3c18-1c67-42eb-bca1-bf8bee0fc2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:06.857744 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262c6de-da49-4b80-b966-2e3232414e83 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:06.905869 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6b8ea-5150-4e7c-82f2-b9e75447c8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:06.906481 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6b8ea-5150-4e7c-82f2-b9e75447c8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:06.906777 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6b8ea-5150-4e7c-82f2-b9e75447c8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:06.906876 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 161/315] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:06.907055 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6b8ea-5150-4e7c-82f2-b9e75447c8a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:06.908132 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f3c18-1c67-42eb-bca1-bf8bee0fc2e9 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:06.931955 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:06.987546 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:07.002184 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6b8ea-5150-4e7c-82f2-b9e75447c8a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:07.003693 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6b8ea-5150-4e7c-82f2-b9e75447c8a0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:07.049840 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f3c18-1c67-42eb-bca1-bf8bee0fc2e9 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:07.097296 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e226a-51da-4c6a-bdb2-69448dcfe6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:07.097914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e226a-51da-4c6a-bdb2-69448dcfe6bb None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:07.098196 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e226a-51da-4c6a-bdb2-69448dcfe6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:07.098470 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e226a-51da-4c6a-bdb2-69448dcfe6bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:07.099202 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e226a-51da-4c6a-bdb2-69448dcfe6bb None admin] RBAC: Adding query filter params (group.id=3dbe1aef145b41bc8d4ac358f4c4cf54, role.id=b7c6f84505634b978e58bb6f62bd88a0, scope.project.id=a526fed604bd4419b5680a31eb366b07) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:07.099512 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e226a-51da-4c6a-bdb2-69448dcfe6bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:07.101032 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e226a-51da-4c6a-bdb2-69448dcfe6bb None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:07.110016 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 162/316] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Oct 31 12:20:06 2022] GET /identity/v3/role_assignments?group.id=3dbe1aef145b41bc8d4ac358f4c4cf54&scope.project.id=a526fed604bd4419b5680a31eb366b07&role.id=b7c6f84505634b978e58bb6f62bd88a0 => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:07.111133 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e226a-51da-4c6a-bdb2-69448dcfe6bb None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:07.132795 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 155/317] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:20:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 12:20:07.140983 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3703d-801b-42c0-ad66-eb61ed32da21 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:07.141309 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3703d-801b-42c0-ad66-eb61ed32da21 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:07.141615 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3703d-801b-42c0-ad66-eb61ed32da21 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:07.143338 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 156/318] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:07.144117 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3703d-801b-42c0-ad66-eb61ed32da21 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:07.207662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:07.273859 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e226a-51da-4c6a-bdb2-69448dcfe6bb None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:07.282618 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3703d-801b-42c0-ad66-eb61ed32da21 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:07.298921 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:07.314225 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fbb64-13a6-4a42-96ed-0629949fb616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:07.314225 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fbb64-13a6-4a42-96ed-0629949fb616 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:07.314535 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fbb64-13a6-4a42-96ed-0629949fb616 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:07.314603 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fbb64-13a6-4a42-96ed-0629949fb616 None admin] PATH_INFO: `/v3/groups/3dbe1aef145b41bc8d4ac358f4c4cf54` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:07.317201 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517fbb64-13a6-4a42-96ed-0629949fb616 None admin] RBAC: Authorizing `identity:get_group(group_id=3dbe1aef145b41bc8d4ac358f4c4cf54)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:07.318688 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517fbb64-13a6-4a42-96ed-0629949fb616 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:07.320652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 163/319] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Oct 31 12:20:07 2022] GET /identity/v3/groups/3dbe1aef145b41bc8d4ac358f4c4cf54 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:07.322472 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361f248-fa14-42b9-9a64-da506bba273f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:07.322759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361f248-fa14-42b9-9a64-da506bba273f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:07.323029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361f248-fa14-42b9-9a64-da506bba273f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:07.328416 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953eb218-ab99-47d7-9354-ce8266f30433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:07.329065 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953eb218-ab99-47d7-9354-ce8266f30433 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:07.329402 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953eb218-ab99-47d7-9354-ce8266f30433 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:07.329670 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953eb218-ab99-47d7-9354-ce8266f30433 None admin] PATH_INFO: `/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:07.331474 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953eb218-ab99-47d7-9354-ce8266f30433 None admin] RBAC: Authorizing `identity:get_project(project_id=acf5fd24975f479ea610ce5bcefe7dcc)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:07.332928 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953eb218-ab99-47d7-9354-ce8266f30433 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:07.334640 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 157/320] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:20:07 2022] GET /identity/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:07.335402 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953eb218-ab99-47d7-9354-ce8266f30433 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:07.347784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-b361f248-fa14-42b9-9a64-da506bba273f None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:07.349037 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b361f248-fa14-42b9-9a64-da506bba273f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:07.432714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 164/321] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:07.432714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361f248-fa14-42b9-9a64-da506bba273f None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:07.464239 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953eb218-ab99-47d7-9354-ce8266f30433 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:07.482278 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:07.515295 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdc251-535e-4dab-8bfc-a625ea55c860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:07.515938 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdc251-535e-4dab-8bfc-a625ea55c860 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:07.516216 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdc251-535e-4dab-8bfc-a625ea55c860 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:07.516485 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdc251-535e-4dab-8bfc-a625ea55c860 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:07.534427 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bdc251-535e-4dab-8bfc-a625ea55c860 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:07.539862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-02bdc251-535e-4dab-8bfc-a625ea55c860 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 12:20:07.539862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:07.539862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:07.539862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:07.539862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:07.539862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:07.539862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:07.539862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:07.539862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:07.539862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:07.539862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:07.539862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:07.539862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:07.539862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:07.539862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:07.539862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:07.541414 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:07.541414 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:07.541414 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:07.541414 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:07.541414 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:07.541414 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:07.541414 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:07.541414 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:07.541414 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:07.541414 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:07.541414 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:07.541414 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:07.541414 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:07.541414 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:07.541414 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:07.541414 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:07.542198 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:07.542198 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:07.542198 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:07.542198 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:07.542198 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:07.542198 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:07.542198 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:07.542198 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:07.542198 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:07.542198 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:07.542198 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 12:20:07.542198 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:07.542198 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 158/322] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 31 12:20:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:07.543316 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdc251-535e-4dab-8bfc-a625ea55c860 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:07.562566 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361f248-fa14-42b9-9a64-da506bba273f None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:07.591161 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:07.615735 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565dfda-6c53-4321-b358-b7272949129b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:07.616346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565dfda-6c53-4321-b358-b7272949129b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:07.616627 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565dfda-6c53-4321-b358-b7272949129b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:07.616900 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565dfda-6c53-4321-b358-b7272949129b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:07.617711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565dfda-6c53-4321-b358-b7272949129b None admin] RBAC: Adding query filter params (group.id=3dbe1aef145b41bc8d4ac358f4c4cf54, role.id=209186498dcb49a693401b009f73812e, scope.project.id=a526fed604bd4419b5680a31eb366b07) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:07.618020 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565dfda-6c53-4321-b358-b7272949129b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:07.623610 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565dfda-6c53-4321-b358-b7272949129b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:07.629171 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 165/323] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Oct 31 12:20:07 2022] GET /identity/v3/role_assignments?group.id=3dbe1aef145b41bc8d4ac358f4c4cf54&scope.project.id=a526fed604bd4419b5680a31eb366b07&role.id=209186498dcb49a693401b009f73812e => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:07.630061 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565dfda-6c53-4321-b358-b7272949129b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:07.679552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdc251-535e-4dab-8bfc-a625ea55c860 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:07.734046 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f9efd-37c7-4d74-92c3-1f545463a1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:07.734765 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f9efd-37c7-4d74-92c3-1f545463a1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:07.734975 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f9efd-37c7-4d74-92c3-1f545463a1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:07.735257 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f9efd-37c7-4d74-92c3-1f545463a1a7 None admin] PATH_INFO: `/v3/groups/3dbe1aef145b41bc8d4ac358f4c4cf54` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:07.736436 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f9efd-37c7-4d74-92c3-1f545463a1a7 None admin] RBAC: Authorizing `identity:get_group(group_id=3dbe1aef145b41bc8d4ac358f4c4cf54)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:07.737950 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f9efd-37c7-4d74-92c3-1f545463a1a7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:07.739619 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 159/324] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Oct 31 12:20:07 2022] GET /identity/v3/groups/3dbe1aef145b41bc8d4ac358f4c4cf54 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:07.740523 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f9efd-37c7-4d74-92c3-1f545463a1a7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:07.761677 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565dfda-6c53-4321-b358-b7272949129b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:07.799248 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:07.814950 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89772400-be6a-458e-9e8e-0ef4c0186b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:07.815526 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89772400-be6a-458e-9e8e-0ef4c0186b0a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:07.816206 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89772400-be6a-458e-9e8e-0ef4c0186b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:07.816206 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89772400-be6a-458e-9e8e-0ef4c0186b0a None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:07.816932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89772400-be6a-458e-9e8e-0ef4c0186b0a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:07.817280 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89772400-be6a-458e-9e8e-0ef4c0186b0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:07.818764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89772400-be6a-458e-9e8e-0ef4c0186b0a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:07.835756 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 166/325] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:07.835756 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89772400-be6a-458e-9e8e-0ef4c0186b0a None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:07.880821 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f9efd-37c7-4d74-92c3-1f545463a1a7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:07.895478 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:07.930121 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642b141-8308-426e-a8be-a0c4d8fef4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:07.931635 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642b141-8308-426e-a8be-a0c4d8fef4ed None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:07.931936 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642b141-8308-426e-a8be-a0c4d8fef4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:07.932739 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642b141-8308-426e-a8be-a0c4d8fef4ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:07.944829 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642b141-8308-426e-a8be-a0c4d8fef4ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:07.950073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-b642b141-8308-426e-a8be-a0c4d8fef4ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:20:07.950073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:07.950073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:07.950073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:07.950073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:07.950073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:07.950073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:07.950073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:07.950073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:07.950073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:07.950073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:07.950073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:07.950073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:07.950073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:07.950073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:07.950073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:07.952032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:07.952032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:07.952032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:07.952032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:07.952032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:07.952032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:07.952032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:07.952032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:07.952032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:07.952032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:07.952032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:07.952032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:07.952032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:07.952032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:07.952032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:07.952032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:07.952832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:07.952832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:07.952832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:07.952832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:07.952832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:07.952832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:07.952832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:07.952832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:07.952832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:07.952832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:07.952832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:20:07.952832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:07.952832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 160/326] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 31 12:20:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:07.952832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642b141-8308-426e-a8be-a0c4d8fef4ed None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:07.970106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89772400-be6a-458e-9e8e-0ef4c0186b0a None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:08.012806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41866f62-a124-4a05-979c-4ac6a5440cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:08.012806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41866f62-a124-4a05-979c-4ac6a5440cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:08.013062 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41866f62-a124-4a05-979c-4ac6a5440cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:08.013475 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41866f62-a124-4a05-979c-4ac6a5440cc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:08.014213 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41866f62-a124-4a05-979c-4ac6a5440cc0 None admin] RBAC: Adding query filter params (group.id=3dbe1aef145b41bc8d4ac358f4c4cf54, role.id=b7c6f84505634b978e58bb6f62bd88a0, scope.project.id=acf5fd24975f479ea610ce5bcefe7dcc) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:08.014684 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41866f62-a124-4a05-979c-4ac6a5440cc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:08.016952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41866f62-a124-4a05-979c-4ac6a5440cc0 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:08.025152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 167/327] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Oct 31 12:20:07 2022] GET /identity/v3/role_assignments?group.id=3dbe1aef145b41bc8d4ac358f4c4cf54&scope.project.id=acf5fd24975f479ea610ce5bcefe7dcc&role.id=b7c6f84505634b978e58bb6f62bd88a0 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:08.026028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41866f62-a124-4a05-979c-4ac6a5440cc0 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:08.084098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642b141-8308-426e-a8be-a0c4d8fef4ed None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:08.086179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:08.131113 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5e8bb-c2c2-4786-9a52-69539c5bbe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:08.131998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5e8bb-c2c2-4786-9a52-69539c5bbe48 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:08.132452 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5e8bb-c2c2-4786-9a52-69539c5bbe48 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:08.132868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5e8bb-c2c2-4786-9a52-69539c5bbe48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:08.174621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41866f62-a124-4a05-979c-4ac6a5440cc0 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:08.187910 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:08.227710 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05ef98-3e7b-475f-a477-b6c41a1dfab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:08.228332 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05ef98-3e7b-475f-a477-b6c41a1dfab1 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:08.228614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05ef98-3e7b-475f-a477-b6c41a1dfab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:08.229651 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05ef98-3e7b-475f-a477-b6c41a1dfab1 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:08.229651 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05ef98-3e7b-475f-a477-b6c41a1dfab1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:08.229877 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05ef98-3e7b-475f-a477-b6c41a1dfab1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:08.231252 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05ef98-3e7b-475f-a477-b6c41a1dfab1 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:08.241994 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 168/328] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:20:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:08.245039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5e8bb-c2c2-4786-9a52-69539c5bbe48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:08.246572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5e8bb-c2c2-4786-9a52-69539c5bbe48 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:08.249229 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05ef98-3e7b-475f-a477-b6c41a1dfab1 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:08.364538 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 161/329] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:20:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 12:20:08.368174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05ef98-3e7b-475f-a477-b6c41a1dfab1 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:08.370631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5e8bb-c2c2-4786-9a52-69539c5bbe48 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:08.373655 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:08.405471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01059f-dd9c-4fca-bbcc-df8a1070a368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:08.406110 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01059f-dd9c-4fca-bbcc-df8a1070a368 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:08.406827 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01059f-dd9c-4fca-bbcc-df8a1070a368 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:08.406827 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01059f-dd9c-4fca-bbcc-df8a1070a368 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:08.452951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:08.488031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01059f-dd9c-4fca-bbcc-df8a1070a368 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:08.489431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01059f-dd9c-4fca-bbcc-df8a1070a368 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:08.496089 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5e8bb-c2c2-4786-9a52-69539c5bbe48 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:08.534465 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70d12e-78ae-4e39-87cc-cecae22d96c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:08.535096 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70d12e-78ae-4e39-87cc-cecae22d96c0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:08.535380 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70d12e-78ae-4e39-87cc-cecae22d96c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:08.535648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70d12e-78ae-4e39-87cc-cecae22d96c0 None admin] PATH_INFO: `/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:08.537017 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70d12e-78ae-4e39-87cc-cecae22d96c0 None admin] RBAC: Authorizing `identity:get_project(project_id=acf5fd24975f479ea610ce5bcefe7dcc)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:08.538512 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70d12e-78ae-4e39-87cc-cecae22d96c0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:08.540161 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 162/330] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:20:08 2022] GET /identity/v3/projects/acf5fd24975f479ea610ce5bcefe7dcc => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:08.545511 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70d12e-78ae-4e39-87cc-cecae22d96c0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:08.596213 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 169/331] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:20:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 31 12:20:08.601603 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01059f-dd9c-4fca-bbcc-df8a1070a368 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:08.612216 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:08.643365 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70d12e-78ae-4e39-87cc-cecae22d96c0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:08.671180 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:08.677226 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15e2be-d7c0-440e-b7b4-f8c35c59d57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:08.677854 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15e2be-d7c0-440e-b7b4-f8c35c59d57c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:08.678138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15e2be-d7c0-440e-b7b4-f8c35c59d57c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:08.678413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15e2be-d7c0-440e-b7b4-f8c35c59d57c None admin] PATH_INFO: `/v3/groups/3dbe1aef145b41bc8d4ac358f4c4cf54` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:08.679518 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15e2be-d7c0-440e-b7b4-f8c35c59d57c None admin] RBAC: Authorizing `identity:get_group(group_id=3dbe1aef145b41bc8d4ac358f4c4cf54)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:08.681441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15e2be-d7c0-440e-b7b4-f8c35c59d57c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:08.683008 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 163/332] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Oct 31 12:20:08 2022] GET /identity/v3/groups/3dbe1aef145b41bc8d4ac358f4c4cf54 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:08.688663 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15e2be-d7c0-440e-b7b4-f8c35c59d57c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:08.701523 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01059f-dd9c-4fca-bbcc-df8a1070a368 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:08.734898 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb6beb-866b-4eb2-92fb-c200a02b8a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:08.735528 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb6beb-866b-4eb2-92fb-c200a02b8a52 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:08.735809 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb6beb-866b-4eb2-92fb-c200a02b8a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:08.736084 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb6beb-866b-4eb2-92fb-c200a02b8a52 None admin] PATH_INFO: `/v3/projects/771b2157d2a94a5f8b2df37d397dbb5d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:08.737254 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb6beb-866b-4eb2-92fb-c200a02b8a52 None admin] RBAC: Authorizing `identity:get_project(project_id=771b2157d2a94a5f8b2df37d397dbb5d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:08.738723 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb6beb-866b-4eb2-92fb-c200a02b8a52 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:08.740339 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 170/333] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:20:08 2022] GET /identity/v3/projects/771b2157d2a94a5f8b2df37d397dbb5d => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:08.746523 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb6beb-866b-4eb2-92fb-c200a02b8a52 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:08.790907 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15e2be-d7c0-440e-b7b4-f8c35c59d57c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:08.824425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902146d-843f-47bc-9491-9305abf348ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:08.825023 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902146d-843f-47bc-9491-9305abf348ff None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:08.825335 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902146d-843f-47bc-9491-9305abf348ff None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:08.825614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902146d-843f-47bc-9491-9305abf348ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:08.826342 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902146d-843f-47bc-9491-9305abf348ff None admin] RBAC: Adding query filter params (group.id=3dbe1aef145b41bc8d4ac358f4c4cf54, role.id=209186498dcb49a693401b009f73812e, scope.project.id=acf5fd24975f479ea610ce5bcefe7dcc) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:08.826652 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902146d-843f-47bc-9491-9305abf348ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:08.828073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902146d-843f-47bc-9491-9305abf348ff None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:08.833851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 164/334] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Oct 31 12:20:08 2022] GET /identity/v3/role_assignments?group.id=3dbe1aef145b41bc8d4ac358f4c4cf54&scope.project.id=acf5fd24975f479ea610ce5bcefe7dcc&role.id=209186498dcb49a693401b009f73812e => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:08.847404 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb6beb-866b-4eb2-92fb-c200a02b8a52 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:08.883558 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d572a9-04b0-43ac-819a-3b268bf419ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:08.884775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d572a9-04b0-43ac-819a-3b268bf419ff None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:08.885055 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d572a9-04b0-43ac-819a-3b268bf419ff None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:08.885358 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d572a9-04b0-43ac-819a-3b268bf419ff None admin] PATH_INFO: `/v3/groups/5776741d31d046c2a517f90b7188e5c1` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:08.886545 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d572a9-04b0-43ac-819a-3b268bf419ff None admin] RBAC: Authorizing `identity:get_group(group_id=5776741d31d046c2a517f90b7188e5c1)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:08.888014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d572a9-04b0-43ac-819a-3b268bf419ff None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:08.889723 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 171/335] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Oct 31 12:20:08 2022] GET /identity/v3/groups/5776741d31d046c2a517f90b7188e5c1 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:08.896089 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902146d-843f-47bc-9491-9305abf348ff None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:08.899083 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:09.001000 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902146d-843f-47bc-9491-9305abf348ff None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:09.035294 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce275f-32ac-4dc5-84cc-8309c35cdc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:09.036149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce275f-32ac-4dc5-84cc-8309c35cdc85 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:09.036429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce275f-32ac-4dc5-84cc-8309c35cdc85 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:09.036699 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce275f-32ac-4dc5-84cc-8309c35cdc85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:09.037444 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce275f-32ac-4dc5-84cc-8309c35cdc85 None admin] RBAC: Adding query filter params (group.id=5776741d31d046c2a517f90b7188e5c1, role.id=e1b3a811029244d2a7e2664cd3246eec, scope.project.id=771b2157d2a94a5f8b2df37d397dbb5d) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:09.037748 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce275f-32ac-4dc5-84cc-8309c35cdc85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:09.039181 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce275f-32ac-4dc5-84cc-8309c35cdc85 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:09.045376 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 165/336] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Oct 31 12:20:08 2022] GET /identity/v3/role_assignments?group.id=5776741d31d046c2a517f90b7188e5c1&scope.project.id=771b2157d2a94a5f8b2df37d397dbb5d&role.id=e1b3a811029244d2a7e2664cd3246eec => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:11.741741 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12247b93-5534-40a5-b6aa-9a4f84d3923b None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:11.742849 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12247b93-5534-40a5-b6aa-9a4f84d3923b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:11.743577 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12247b93-5534-40a5-b6aa-9a4f84d3923b None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:11.745628 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 172/337] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:11.752403 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56ec3f-fbe3-482a-9ed1-b869e1ae3953 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:11.753435 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56ec3f-fbe3-482a-9ed1-b869e1ae3953 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:11.753980 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56ec3f-fbe3-482a-9ed1-b869e1ae3953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:11.774111 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3b56ec3f-fbe3-482a-9ed1-b869e1ae3953 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:11.776129 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3b56ec3f-fbe3-482a-9ed1-b869e1ae3953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:11.849576 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:11.850679 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd8673-c900-450e-a807-3eedadb04150 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:11.851393 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd8673-c900-450e-a807-3eedadb04150 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:11.851876 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd8673-c900-450e-a807-3eedadb04150 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:11.854741 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 173/338] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:11.860007 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e41439-8e32-4480-863c-21e937354506 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:11.860692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e41439-8e32-4480-863c-21e937354506 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:11.861296 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e41439-8e32-4480-863c-21e937354506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:11.862424 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 166/339] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:11.893536 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-80e41439-8e32-4480-863c-21e937354506 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:11.894749 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-80e41439-8e32-4480-863c-21e937354506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:11.905421 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:11.997344 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 174/340] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:12.178598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56ec3f-fbe3-482a-9ed1-b869e1ae3953 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:12.190151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b7446-e662-40f9-b6ca-6890e130aad3 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:12.190756 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b7446-e662-40f9-b6ca-6890e130aad3 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:12.191247 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b7446-e662-40f9-b6ca-6890e130aad3 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:12.193064 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 175/341] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:20:12.198799 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30b885-7748-4492-8a45-80f3efdee372 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:12.199331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30b885-7748-4492-8a45-80f3efdee372 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:12.199802 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30b885-7748-4492-8a45-80f3efdee372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:12.232794 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ad30b885-7748-4492-8a45-80f3efdee372 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:12.234003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ad30b885-7748-4492-8a45-80f3efdee372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:12.338872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56ec3f-fbe3-482a-9ed1-b869e1ae3953 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:12.347564 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 176/342] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:12.348410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30b885-7748-4492-8a45-80f3efdee372 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:12.383007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fb58e-04d7-486a-a6a3-5d2ba1a036d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:12.384195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fb58e-04d7-486a-a6a3-5d2ba1a036d8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:12.384507 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fb58e-04d7-486a-a6a3-5d2ba1a036d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:12.384777 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fb58e-04d7-486a-a6a3-5d2ba1a036d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:12.415143 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:12.416163 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90fb58e-04d7-486a-a6a3-5d2ba1a036d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:12.417853 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90fb58e-04d7-486a-a6a3-5d2ba1a036d8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:12.434561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-c90fb58e-04d7-486a-a6a3-5d2ba1a036d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:12.434561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:12.434561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:12.434561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:12.434561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:12.434561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:12.434561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:12.434561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:12.434561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:12.434561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:12.434561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:12.434561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:12.434561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:12.434561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:12.434561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:12.434561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:12.435565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:12.435565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:12.435565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:12.435565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:12.435565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:12.435565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:12.435565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:12.435565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:12.435565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:12.435565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:12.435565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:12.435565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:12.435565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:12.435565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:12.435565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:12.435565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:12.435565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:12.436454 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:12.436454 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:12.436454 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:12.436454 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 167/343] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:12.442885 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fb58e-04d7-486a-a6a3-5d2ba1a036d8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:12.459958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30b885-7748-4492-8a45-80f3efdee372 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:12.497695 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb8dbf-88ab-4c08-ad9d-f439cd6230f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:12.498345 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb8dbf-88ab-4c08-ad9d-f439cd6230f2 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:12.498666 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb8dbf-88ab-4c08-ad9d-f439cd6230f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:12.498938 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb8dbf-88ab-4c08-ad9d-f439cd6230f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:12.526885 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb8dbf-88ab-4c08-ad9d-f439cd6230f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:12.528352 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb8dbf-88ab-4c08-ad9d-f439cd6230f2 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:12.537475 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:12.556845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-81bb8dbf-88ab-4c08-ad9d-f439cd6230f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:12.556845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:12.556845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:12.556845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:12.556845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:12.556845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:12.556845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:12.556845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:12.556845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:12.556845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:12.556845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:12.556845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:12.556845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:12.556845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:12.556845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:12.556845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:12.559100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:12.559100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:12.559100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:12.559100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:12.559100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:12.559100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:12.559100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:12.559100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:12.559100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:12.559100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:12.559100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:12.559100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:12.559100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:12.559100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:12.559100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:12.559100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:12.559100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:12.561197 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:12.561197 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:12.561197 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:12.571872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 177/344] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:12.574133 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb8dbf-88ab-4c08-ad9d-f439cd6230f2 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:12.626894 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fb58e-04d7-486a-a6a3-5d2ba1a036d8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:12.663334 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6eecd-33f1-4e52-b2fa-402170cf549f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:12.664052 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6eecd-33f1-4e52-b2fa-402170cf549f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:12.664338 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6eecd-33f1-4e52-b2fa-402170cf549f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:12.664605 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6eecd-33f1-4e52-b2fa-402170cf549f None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:12.665384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6eecd-33f1-4e52-b2fa-402170cf549f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:12.665682 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6eecd-33f1-4e52-b2fa-402170cf549f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:12.667145 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6eecd-33f1-4e52-b2fa-402170cf549f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:12.680077 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 168/345] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:12.681984 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8dbbc-ad0c-43e4-b001-ee72ca06ea77 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:12.682267 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8dbbc-ad0c-43e4-b001-ee72ca06ea77 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:12.682534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8dbbc-ad0c-43e4-b001-ee72ca06ea77 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:12.683748 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 169/346] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:12.687828 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8dbbc-ad0c-43e4-b001-ee72ca06ea77 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:12.721807 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb8dbf-88ab-4c08-ad9d-f439cd6230f2 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:12.747076 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:12.762174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bf2bc-8eaf-4a93-a331-6d278d33db7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:12.763537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bf2bc-8eaf-4a93-a331-6d278d33db7b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:12.763821 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bf2bc-8eaf-4a93-a331-6d278d33db7b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:12.764095 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bf2bc-8eaf-4a93-a331-6d278d33db7b None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:12.764738 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bf2bc-8eaf-4a93-a331-6d278d33db7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:12.765038 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bf2bc-8eaf-4a93-a331-6d278d33db7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:12.766429 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bf2bc-8eaf-4a93-a331-6d278d33db7b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:12.781283 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 178/347] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:12.787476 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3099c3-43e1-4ab7-9686-583c11370370 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:12.787777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3099c3-43e1-4ab7-9686-583c11370370 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:12.788056 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3099c3-43e1-4ab7-9686-583c11370370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:12.796313 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8dbbc-ad0c-43e4-b001-ee72ca06ea77 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:12.808406 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:12.812702 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3e3099c3-43e1-4ab7-9686-583c11370370 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:12.814459 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3e3099c3-43e1-4ab7-9686-583c11370370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:12.834683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28725e74-a320-4678-b88e-bbb503bcf72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:12.835292 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28725e74-a320-4678-b88e-bbb503bcf72c None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:12.835570 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28725e74-a320-4678-b88e-bbb503bcf72c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:12.835841 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28725e74-a320-4678-b88e-bbb503bcf72c None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:12.836483 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28725e74-a320-4678-b88e-bbb503bcf72c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:12.837954 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28725e74-a320-4678-b88e-bbb503bcf72c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:12.861053 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 170/348] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 31 12:20:12 2022] POST /identity/v3/users => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:20:12.861894 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28725e74-a320-4678-b88e-bbb503bcf72c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:12.914597 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 179/349] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:12.914597 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3099c3-43e1-4ab7-9686-583c11370370 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:13.048828 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28725e74-a320-4678-b88e-bbb503bcf72c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:13.096705 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb9b1a-0c3a-4245-b890-0fb629c976be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:13.097381 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb9b1a-0c3a-4245-b890-0fb629c976be None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:13.097658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb9b1a-0c3a-4245-b890-0fb629c976be None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:13.097931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb9b1a-0c3a-4245-b890-0fb629c976be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:13.111716 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb9b1a-0c3a-4245-b890-0fb629c976be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:13.113211 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb9b1a-0c3a-4245-b890-0fb629c976be None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:13.113391 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3099c3-43e1-4ab7-9686-583c11370370 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:13.124825 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:13.130807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-b2eb9b1a-0c3a-4245-b890-0fb629c976be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:13.130807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:13.130807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:13.130807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:13.130807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:13.130807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:13.130807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:13.130807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:13.130807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:13.130807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:13.130807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:13.130807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:13.130807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:13.130807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:13.130807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:13.130807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:13.131703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:13.131703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:13.131703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:13.131703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:13.131703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:13.131703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:13.131703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:13.131703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:13.131703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:13.131703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:13.131703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:13.131703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:13.131703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:13.131703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:13.131703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:13.131703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:13.131703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:13.132556 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:13.132556 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:13.132556 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:13.132556 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 171/350] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:13.134577 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15725195-8880-4e11-87ba-555b9f7eae51 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:13.134577 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15725195-8880-4e11-87ba-555b9f7eae51 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:13.134577 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15725195-8880-4e11-87ba-555b9f7eae51 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:13.135642 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 172/351] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:13.140520 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15725195-8880-4e11-87ba-555b9f7eae51 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:13.166648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:13.169152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a42386-ef84-4e48-89f8-8c5b177a87f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:13.169802 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a42386-ef84-4e48-89f8-8c5b177a87f9 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:13.170170 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a42386-ef84-4e48-89f8-8c5b177a87f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:13.170532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a42386-ef84-4e48-89f8-8c5b177a87f9 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:13.171304 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a42386-ef84-4e48-89f8-8c5b177a87f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:13.173750 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a42386-ef84-4e48-89f8-8c5b177a87f9 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:13.202190 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 180/352] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 31 12:20:12 2022] POST /identity/v3/users => generated 248 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:20:13.204408 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6fe2b-8de8-4805-b2b1-f5b832610651 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:13.204769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6fe2b-8de8-4805-b2b1-f5b832610651 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:13.205138 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6fe2b-8de8-4805-b2b1-f5b832610651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:13.229474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-30d6fe2b-8de8-4805-b2b1-f5b832610651 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:13.230854 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-30d6fe2b-8de8-4805-b2b1-f5b832610651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:13.268037 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15725195-8880-4e11-87ba-555b9f7eae51 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:13.307107 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 181/353] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:13.308192 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6fe2b-8de8-4805-b2b1-f5b832610651 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:13.308905 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7519e6-023f-4de9-849a-17d3255424be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:13.309815 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7519e6-023f-4de9-849a-17d3255424be None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:13.310296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7519e6-023f-4de9-849a-17d3255424be None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:13.310948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7519e6-023f-4de9-849a-17d3255424be None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:13.311961 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7519e6-023f-4de9-849a-17d3255424be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:13.312485 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7519e6-023f-4de9-849a-17d3255424be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:13.314248 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7519e6-023f-4de9-849a-17d3255424be None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:13.328904 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 173/354] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:13.338271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7519e6-023f-4de9-849a-17d3255424be None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:13.417634 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:13.423820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6fe2b-8de8-4805-b2b1-f5b832610651 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:13.469341 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c6688-c70a-47c1-afbc-674f174a6c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:13.470017 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c6688-c70a-47c1-afbc-674f174a6c35 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:13.470299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c6688-c70a-47c1-afbc-674f174a6c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:13.470578 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c6688-c70a-47c1-afbc-674f174a6c35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:13.483421 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c6688-c70a-47c1-afbc-674f174a6c35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:13.484873 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c6688-c70a-47c1-afbc-674f174a6c35 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:13.484982 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:13.508431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-e58c6688-c70a-47c1-afbc-674f174a6c35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:13.508431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:13.508431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:13.508431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:13.508431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:13.508431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:13.508431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:13.508431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:13.508431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:13.508431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:13.508431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:13.508431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:13.508431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:13.508431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:13.508431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:13.508431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:13.509926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:13.509926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:13.509926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:13.509926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:13.509926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:13.509926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:13.509926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:13.509926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:13.509926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:13.509926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:13.509926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:13.509926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:13.509926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:13.509926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:13.509926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:13.509926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:13.509926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:13.511270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:13.511270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:13.511270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:13.513297 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 182/355] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:13.516582 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c6688-c70a-47c1-afbc-674f174a6c35 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:13.533393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7519e6-023f-4de9-849a-17d3255424be None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:13.594969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfddfb-703d-45f7-8059-cbad7272e621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:13.595576 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfddfb-703d-45f7-8059-cbad7272e621 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:13.595852 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfddfb-703d-45f7-8059-cbad7272e621 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:13.596120 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfddfb-703d-45f7-8059-cbad7272e621 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:13.596779 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfddfb-703d-45f7-8059-cbad7272e621 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:13.598216 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfddfb-703d-45f7-8059-cbad7272e621 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:13.638485 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 174/356] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 31 12:20:13 2022] POST /identity/v3/users => generated 248 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:20:13.666515 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfddfb-703d-45f7-8059-cbad7272e621 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:13.678983 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c6688-c70a-47c1-afbc-674f174a6c35 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:13.735224 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae5a60-bfc0-4675-84f2-b069b81667de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:13.736273 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae5a60-bfc0-4675-84f2-b069b81667de None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:13.738118 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae5a60-bfc0-4675-84f2-b069b81667de None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:13.739190 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae5a60-bfc0-4675-84f2-b069b81667de None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:13.740654 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae5a60-bfc0-4675-84f2-b069b81667de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:13.741834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae5a60-bfc0-4675-84f2-b069b81667de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:13.748421 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae5a60-bfc0-4675-84f2-b069b81667de None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:13.778605 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 183/357] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:13.784618 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae5a60-bfc0-4675-84f2-b069b81667de None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:13.807016 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:13.863604 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfddfb-703d-45f7-8059-cbad7272e621 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:13.900220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:13.907988 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c045f88-24f8-40c8-841e-25d67e7699bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:13.908964 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c045f88-24f8-40c8-841e-25d67e7699bf None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:13.909586 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c045f88-24f8-40c8-841e-25d67e7699bf None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:13.910149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c045f88-24f8-40c8-841e-25d67e7699bf None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:13.911277 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c045f88-24f8-40c8-841e-25d67e7699bf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:13.912838 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c045f88-24f8-40c8-841e-25d67e7699bf None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:13.924217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.sql.core [None req-4c045f88-24f8-40c8-841e-25d67e7699bf None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 31 12:20:13.924217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 31 12:20:13.924217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [parameters: {'id': 'ad5992c36af844bcafca3e366c7219a7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 31 12:20:13.924217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81458) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 12:20:13.930138 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae5a60-bfc0-4675-84f2-b069b81667de None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:13.933609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-4c045f88-24f8-40c8-841e-25d67e7699bf None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 31 12:20:13.933609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:13.933609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 12:20:13.933609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 12:20:13.933609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 12:20:13.933609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 12:20:13.933609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 12:20:13.933609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 12:20:13.933609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 12:20:13.933609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application conn.query(q) Oct 31 12:20:13.933609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 12:20:13.933609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 12:20:13.933609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 12:20:13.933609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result.read() Oct 31 12:20:13.933609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 12:20:13.934525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 12:20:13.934525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 12:20:13.934525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 12:20:13.934525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 12:20:13.934525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 12:20:13.934525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 12:20:13.934525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 12:20:13.934525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 31 12:20:13.934525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:13.934525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 12:20:13.934525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:13.934525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:13.934525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 12:20:13.934525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 12:20:13.934525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 31 12:20:13.934525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return ref.to_dict() Oct 31 12:20:13.934525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 12:20:13.934525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application next(self.gen) Oct 31 12:20:13.935683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 12:20:13.935683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application yield resource Oct 31 12:20:13.935683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 12:20:13.935683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application next(self.gen) Oct 31 12:20:13.935683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 12:20:13.935683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 12:20:13.935683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 12:20:13.935683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 12:20:13.935683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 12:20:13.935683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise self.value Oct 31 12:20:13.935683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 12:20:13.935683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 12:20:13.935683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 12:20:13.935683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application session.commit() Oct 31 12:20:13.935683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 12:20:13.935683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 12:20:13.935683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 12:20:13.936754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 12:20:13.936754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 12:20:13.936754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.session.flush() Oct 31 12:20:13.936754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 12:20:13.936754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 12:20:13.936754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 12:20:13.936754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 12:20:13.936754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 12:20:13.936754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application compat.raise_( Oct 31 12:20:13.936754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 12:20:13.936754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception Oct 31 12:20:13.936754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 12:20:13.936754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 12:20:13.936754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 12:20:13.936754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 12:20:13.936754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 12:20:13.936754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 12:20:13.937903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 12:20:13.937903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 12:20:13.937903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 12:20:13.937903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 12:20:13.937903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 12:20:13.937903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 12:20:13.937903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 12:20:13.937903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 12:20:13.937903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 12:20:13.937903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 12:20:13.937903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 12:20:13.937903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 12:20:13.937903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 12:20:13.937903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 12:20:13.937903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 12:20:13.937903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception Oct 31 12:20:13.938901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 12:20:13.938901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 12:20:13.938901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 12:20:13.938901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 12:20:13.938901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 12:20:13.938901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 12:20:13.938901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 12:20:13.938901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application conn.query(q) Oct 31 12:20:13.938901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 12:20:13.938901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 12:20:13.938901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 12:20:13.938901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result.read() Oct 31 12:20:13.938901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 12:20:13.938901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 12:20:13.938901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 12:20:13.938901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 12:20:13.940078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 12:20:13.940078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 12:20:13.940078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 12:20:13.940078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 12:20:13.940078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 31 12:20:13.940078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 31 12:20:13.940078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [parameters: {'id': 'ad5992c36af844bcafca3e366c7219a7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 31 12:20:13.940078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 12:20:13.940078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:13.940078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:20:13.940078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:13.940078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:13.940078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:13.940078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:13.940078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:13.940078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:13.941066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:13.941066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:13.941066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:13.941066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:13.941066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:13.941066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:13.941066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 31 12:20:13.941066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 31 12:20:13.941066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:13.941066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:13.941066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 31 12:20:13.941066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 31 12:20:13.941066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 12:20:13.941066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 12:20:13.941066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 31 12:20:13.941066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:13.943844 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 175/358] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Oct 31 12:20:13 2022] POST /identity/v3/roles => generated 144 bytes in 278 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:13.949858 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c045f88-24f8-40c8-841e-25d67e7699bf None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:13.982827 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d9ec7-98e2-4ed0-bd18-d2118c091925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:13.983690 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d9ec7-98e2-4ed0-bd18-d2118c091925 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:13.984064 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d9ec7-98e2-4ed0-bd18-d2118c091925 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:13.984468 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d9ec7-98e2-4ed0-bd18-d2118c091925 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:13.985279 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d9ec7-98e2-4ed0-bd18-d2118c091925 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:13.986901 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d9ec7-98e2-4ed0-bd18-d2118c091925 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:14.013432 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 184/359] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 31 12:20:13 2022] POST /identity/v3/users => generated 249 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:20:14.070818 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c045f88-24f8-40c8-841e-25d67e7699bf None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:14.110899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa876fa-ccd5-435d-b867-d4eb63ee7cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:14.111616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa876fa-ccd5-435d-b867-d4eb63ee7cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:14.111906 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa876fa-ccd5-435d-b867-d4eb63ee7cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:14.112184 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa876fa-ccd5-435d-b867-d4eb63ee7cb6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:14.125017 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa876fa-ccd5-435d-b867-d4eb63ee7cb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:14.130549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-bfa876fa-ccd5-435d-b867-d4eb63ee7cb6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 12:20:14.130549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:14.130549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:14.130549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:14.130549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:14.130549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:14.130549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:14.130549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:14.130549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:14.130549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:14.130549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:14.130549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:14.130549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:14.130549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:14.130549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:14.130549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:14.131490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:14.131490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:14.131490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:14.131490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:14.131490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:14.131490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:14.131490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:14.131490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:14.131490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:14.131490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:14.131490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:14.131490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:14.131490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:14.131490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:14.131490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:14.131490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:14.132698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:14.132698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:14.132698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:14.132698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:14.132698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:14.132698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:14.132698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:14.132698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:14.132698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:14.132698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:14.132698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 12:20:14.132698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:14.132698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 176/360] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 31 12:20:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:20:14.138243 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d9ec7-98e2-4ed0-bd18-d2118c091925 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:14.221436 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:14.264336 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d9ec7-98e2-4ed0-bd18-d2118c091925 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:14.300666 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08619a-4a4b-46c8-9f2c-20475112e0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:14.301312 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08619a-4a4b-46c8-9f2c-20475112e0fb None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:14.301597 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08619a-4a4b-46c8-9f2c-20475112e0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:14.301870 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08619a-4a4b-46c8-9f2c-20475112e0fb None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:14.302613 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08619a-4a4b-46c8-9f2c-20475112e0fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:14.302921 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08619a-4a4b-46c8-9f2c-20475112e0fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:14.304289 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08619a-4a4b-46c8-9f2c-20475112e0fb None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:14.313463 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 185/361] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:15.407484 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f0270-0ecb-45ab-a67f-01b7469f7aa3 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:15.408488 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f0270-0ecb-45ab-a67f-01b7469f7aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:15.408964 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f0270-0ecb-45ab-a67f-01b7469f7aa3 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:15.411050 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 177/362] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:15.416520 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca137a-602a-4116-a8af-52d4b8b62b13 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:15.417347 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca137a-602a-4116-a8af-52d4b8b62b13 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:15.417833 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca137a-602a-4116-a8af-52d4b8b62b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:15.444634 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-11ca137a-602a-4116-a8af-52d4b8b62b13 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:15.446307 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-11ca137a-602a-4116-a8af-52d4b8b62b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:15.537963 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 186/363] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:15.982197 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f0270-0ecb-45ab-a67f-01b7469f7aa3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:16.001436 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a722537-9d4c-4f5f-9a85-cc1552254cab None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:16.001763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a722537-9d4c-4f5f-9a85-cc1552254cab None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:16.001992 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a722537-9d4c-4f5f-9a85-cc1552254cab None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:16.003548 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 187/364] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:16.008828 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd69bd-a701-4e04-b96d-8b278774ffcc None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:16.009101 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd69bd-a701-4e04-b96d-8b278774ffcc None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:16.009409 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd69bd-a701-4e04-b96d-8b278774ffcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:16.029969 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-85cd69bd-a701-4e04-b96d-8b278774ffcc None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:16.031248 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-85cd69bd-a701-4e04-b96d-8b278774ffcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:16.058319 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:16.141417 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f0270-0ecb-45ab-a67f-01b7469f7aa3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:16.169490 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:16.192077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 188/365] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 12:20:16.208573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb35f0b-37e2-4ab7-804c-7f6896c7c6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:16.209241 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb35f0b-37e2-4ab7-804c-7f6896c7c6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:16.209527 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb35f0b-37e2-4ab7-804c-7f6896c7c6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:16.209803 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb35f0b-37e2-4ab7-804c-7f6896c7c6f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:16.225846 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb35f0b-37e2-4ab7-804c-7f6896c7c6f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:16.231209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-4eb35f0b-37e2-4ab7-804c-7f6896c7c6f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:16.231209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:16.231209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:16.231209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:16.231209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:16.231209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:16.231209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:16.231209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:16.231209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:16.231209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:16.231209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:16.231209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:16.231209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:16.231209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:16.231209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:16.231209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:16.232357 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:16.232357 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:16.232357 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:16.232357 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:16.232357 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:16.232357 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:16.232357 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:16.232357 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:16.232357 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:16.232357 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:16.232357 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:16.232357 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:16.232357 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:16.232357 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:16.232357 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:16.232357 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:16.233355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:16.233355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:16.233355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:16.233355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:16.233355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:16.233355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:16.233355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:16.233355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:16.233355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:16.233355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:16.233355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:16.233355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:16.233355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 178/366] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 31 12:20:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:16.240037 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd69bd-a701-4e04-b96d-8b278774ffcc None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:16.322639 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5634a0-8bbe-4192-bca9-74ded5aa570f None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:16.323088 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5634a0-8bbe-4192-bca9-74ded5aa570f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:16.323460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5634a0-8bbe-4192-bca9-74ded5aa570f None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:16.329660 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 179/367] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:16.331230 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd92622-af09-437e-be45-bdd35bdfb826 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:16.331509 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd92622-af09-437e-be45-bdd35bdfb826 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:16.331778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd92622-af09-437e-be45-bdd35bdfb826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:16.368353 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5fd92622-af09-437e-be45-bdd35bdfb826 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:16.369573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5fd92622-af09-437e-be45-bdd35bdfb826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:16.381000 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd69bd-a701-4e04-b96d-8b278774ffcc None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:16.467404 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 180/368] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 12:20:16.470990 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860caf0-2f43-40a7-bd24-eb5815fdb8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:16.471753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860caf0-2f43-40a7-bd24-eb5815fdb8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:16.472139 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860caf0-2f43-40a7-bd24-eb5815fdb8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:16.472518 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860caf0-2f43-40a7-bd24-eb5815fdb8e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:16.473349 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860caf0-2f43-40a7-bd24-eb5815fdb8e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:16.473759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860caf0-2f43-40a7-bd24-eb5815fdb8e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:16.475221 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860caf0-2f43-40a7-bd24-eb5815fdb8e1 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:16.485145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 189/369] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 31 12:20:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:16.490445 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd92622-af09-437e-be45-bdd35bdfb826 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:16.505934 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860caf0-2f43-40a7-bd24-eb5815fdb8e1 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:16.541159 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:16.598504 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd92622-af09-437e-be45-bdd35bdfb826 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:16.635392 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c775d3-823c-4c21-8e8a-9314b6f007a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:16.636126 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c775d3-823c-4c21-8e8a-9314b6f007a7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:16.636904 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c775d3-823c-4c21-8e8a-9314b6f007a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:16.637456 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c775d3-823c-4c21-8e8a-9314b6f007a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:16.648573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c775d3-823c-4c21-8e8a-9314b6f007a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:16.650292 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c775d3-823c-4c21-8e8a-9314b6f007a7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:16.665479 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:16.666441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-59c775d3-823c-4c21-8e8a-9314b6f007a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:16.666441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:16.666441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:16.666441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:16.666441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:16.666441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:16.666441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:16.666441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:16.666441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:16.666441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:16.666441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:16.666441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:16.666441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:16.666441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:16.666441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:16.666441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:16.667324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:16.667324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:16.667324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:16.667324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:16.667324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:16.667324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:16.667324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:16.667324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:16.667324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:16.667324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:16.667324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:16.667324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:16.667324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:16.667324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:16.667324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:16.667324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:16.667324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:16.668555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:16.668555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:16.668555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:16.668555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 181/370] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:20:16.674872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c775d3-823c-4c21-8e8a-9314b6f007a7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:16.786613 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860caf0-2f43-40a7-bd24-eb5815fdb8e1 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:16.835513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:16.841629 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c775d3-823c-4c21-8e8a-9314b6f007a7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:16.843919 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18778c7b-1c18-4eab-9e1e-0feef28e8c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:16.844843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18778c7b-1c18-4eab-9e1e-0feef28e8c66 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:16.845409 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18778c7b-1c18-4eab-9e1e-0feef28e8c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:16.845927 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18778c7b-1c18-4eab-9e1e-0feef28e8c66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:16.860557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18778c7b-1c18-4eab-9e1e-0feef28e8c66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:16.869988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-18778c7b-1c18-4eab-9e1e-0feef28e8c66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:16.869988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:16.869988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:16.869988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:16.869988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:16.869988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:16.869988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:16.869988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:16.869988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:16.869988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:16.869988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:16.869988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:16.869988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:16.869988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:16.869988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:16.869988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:16.870985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:16.870985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:16.870985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:16.870985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:16.870985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:16.870985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:16.870985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:16.870985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:16.870985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:16.870985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:16.870985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:16.870985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:16.870985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:16.870985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:16.870985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:16.870985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:16.871790 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:16.871790 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:16.871790 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:16.871790 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:16.871790 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:16.871790 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:16.871790 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:16.871790 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:16.871790 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:16.871790 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:16.871790 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:16.871790 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:16.872540 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 190/371] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 31 12:20:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:20:16.876968 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18778c7b-1c18-4eab-9e1e-0feef28e8c66 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:16.883807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca399d4-635f-4112-b229-6e93284f53ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:16.884420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca399d4-635f-4112-b229-6e93284f53ac None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:16.884698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca399d4-635f-4112-b229-6e93284f53ac None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:16.884972 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca399d4-635f-4112-b229-6e93284f53ac None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:16.885660 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca399d4-635f-4112-b229-6e93284f53ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:16.885985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca399d4-635f-4112-b229-6e93284f53ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:16.887887 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca399d4-635f-4112-b229-6e93284f53ac None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:16.903150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 182/372] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:16.904117 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca399d4-635f-4112-b229-6e93284f53ac None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:16.999030 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18778c7b-1c18-4eab-9e1e-0feef28e8c66 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:17.011720 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:17.020256 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca399d4-635f-4112-b229-6e93284f53ac None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:17.042967 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce47e8b-46cb-4758-add8-d171199022f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:17.043709 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce47e8b-46cb-4758-add8-d171199022f4 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:17.044149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce47e8b-46cb-4758-add8-d171199022f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:17.044590 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce47e8b-46cb-4758-add8-d171199022f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:17.057379 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b9f39-a6af-4d0a-9127-8dadbb3f23fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:17.057725 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce47e8b-46cb-4758-add8-d171199022f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:17.057977 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b9f39-a6af-4d0a-9127-8dadbb3f23fe None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:17.058251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b9f39-a6af-4d0a-9127-8dadbb3f23fe None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:17.058517 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b9f39-a6af-4d0a-9127-8dadbb3f23fe None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:17.059176 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b9f39-a6af-4d0a-9127-8dadbb3f23fe None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:17.059475 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b9f39-a6af-4d0a-9127-8dadbb3f23fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:17.061394 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b9f39-a6af-4d0a-9127-8dadbb3f23fe None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:17.066301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-3ce47e8b-46cb-4758-add8-d171199022f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:17.066301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:17.066301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:17.066301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:17.066301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:17.066301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:17.066301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:17.066301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:17.066301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:17.066301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:17.066301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:17.066301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:17.066301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:17.066301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:17.066301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:17.066301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:17.067208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:17.067208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:17.067208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:17.067208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:17.067208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:17.067208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:17.067208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:17.067208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:17.067208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:17.067208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:17.067208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:17.067208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:17.067208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:17.067208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:17.067208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:17.067208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:17.067995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:17.067995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:17.067995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:17.067995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:17.067995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:17.067995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:17.067995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:17.067995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:17.067995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:17.067995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:17.067995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:17.067995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:17.067995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 191/373] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 31 12:20:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:17.069818 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf9f16-2698-4383-8198-82b7d60a968d None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:17.070240 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf9f16-2698-4383-8198-82b7d60a968d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:17.070675 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf9f16-2698-4383-8198-82b7d60a968d None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:17.079527 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 183/374] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 31 12:20:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:17.079527 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b9f39-a6af-4d0a-9127-8dadbb3f23fe None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:17.079749 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 192/375] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:17.080529 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf9f16-2698-4383-8198-82b7d60a968d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:17.103877 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:17.181053 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b9f39-a6af-4d0a-9127-8dadbb3f23fe None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:17.184106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf9f16-2698-4383-8198-82b7d60a968d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:17.214163 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f350f-0b8b-4f64-b3a3-e68233947d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:17.214775 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f350f-0b8b-4f64-b3a3-e68233947d79 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:17.215055 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f350f-0b8b-4f64-b3a3-e68233947d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:17.215318 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f350f-0b8b-4f64-b3a3-e68233947d79 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:17.217170 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae07d4-cd85-49d8-90e4-f0d0f04d3af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:17.217814 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae07d4-cd85-49d8-90e4-f0d0f04d3af1 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:17.218087 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae07d4-cd85-49d8-90e4-f0d0f04d3af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:17.218356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae07d4-cd85-49d8-90e4-f0d0f04d3af1 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:17.219011 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae07d4-cd85-49d8-90e4-f0d0f04d3af1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:17.219311 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae07d4-cd85-49d8-90e4-f0d0f04d3af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:17.220678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae07d4-cd85-49d8-90e4-f0d0f04d3af1 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:17.222597 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f350f-0b8b-4f64-b3a3-e68233947d79 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:17.223985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f350f-0b8b-4f64-b3a3-e68233947d79 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:17.228763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 193/376] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 31 12:20:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:17.229995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f444d4-1014-407c-8c99-569ca2bb9713 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:17.230276 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f444d4-1014-407c-8c99-569ca2bb9713 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:17.230546 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f444d4-1014-407c-8c99-569ca2bb9713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:17.236413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-526f350f-0b8b-4f64-b3a3-e68233947d79 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 12:20:17.236413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:17.236413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:17.236413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:17.236413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:17.236413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:17.236413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:17.236413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:17.236413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:17.236413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:17.236413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:17.236413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:17.236413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:20:17.236413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:20:17.236413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:20:17.236413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:20:17.237358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:17.237358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:17.237358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:20:17.237358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:17.237358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:20:17.237358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:17.237358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:17.237358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:17.237358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:17.237358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:17.237358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:17.237358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:17.237358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:17.237358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:17.237358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:17.237358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:17.237358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:17.237358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:17.241625 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:17.241625 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:17.241625 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:20:17.241625 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:20:17.241625 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:20:17.241625 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:20:17.241625 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:20:17.241625 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:20:17.241625 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 12:20:17.241625 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:17.241625 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 184/377] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Oct 31 12:20:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:17.241625 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f350f-0b8b-4f64-b3a3-e68233947d79 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:17.247864 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e1f444d4-1014-407c-8c99-569ca2bb9713 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:17.249069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e1f444d4-1014-407c-8c99-569ca2bb9713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:17.272248 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:17.325456 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 194/378] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:17.325456 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af45a8-706e-4de7-aebd-0d96fbf12c13 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:17.325456 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af45a8-706e-4de7-aebd-0d96fbf12c13 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:17.325456 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af45a8-706e-4de7-aebd-0d96fbf12c13 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:17.325456 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 195/379] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:17.325861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:17.325935 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af45a8-706e-4de7-aebd-0d96fbf12c13 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:17.340170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f350f-0b8b-4f64-b3a3-e68233947d79 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:17.374995 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fe4a1-5c71-465a-856f-744b269f1bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:17.375609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fe4a1-5c71-465a-856f-744b269f1bce None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:17.376030 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fe4a1-5c71-465a-856f-744b269f1bce None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:17.376141 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fe4a1-5c71-465a-856f-744b269f1bce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:17.387107 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fe4a1-5c71-465a-856f-744b269f1bce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:17.388540 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fe4a1-5c71-465a-856f-744b269f1bce None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:17.403254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-167fe4a1-5c71-465a-856f-744b269f1bce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:17.403254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:17.403254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:17.403254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:17.403254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:17.403254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:17.403254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:17.403254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:17.403254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:17.403254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:17.403254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:17.403254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:17.403254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:17.403254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:17.403254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:17.403254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:17.404170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:17.404170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:17.404170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:17.404170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:17.404170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:17.404170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:17.404170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:17.404170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:17.404170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:17.404170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:17.404170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:17.404170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:17.404170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:17.404170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:17.404170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:17.404170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:17.404170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:17.405007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:17.405007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:17.405007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:17.405007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 185/380] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:17.405266 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fe4a1-5c71-465a-856f-744b269f1bce None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:17.441797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af45a8-706e-4de7-aebd-0d96fbf12c13 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:17.479255 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585edf2-cdf2-4588-a00b-978776206fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:17.480377 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585edf2-cdf2-4588-a00b-978776206fbb None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:17.480664 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585edf2-cdf2-4588-a00b-978776206fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:17.480937 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585edf2-cdf2-4588-a00b-978776206fbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:17.491642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585edf2-cdf2-4588-a00b-978776206fbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:17.493182 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585edf2-cdf2-4588-a00b-978776206fbb None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:17.504567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fe4a1-5c71-465a-856f-744b269f1bce None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:17.510112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-a585edf2-cdf2-4588-a00b-978776206fbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:17.510112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:17.510112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:17.510112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:17.510112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:17.510112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:17.510112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:17.510112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:17.510112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:17.510112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:17.510112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:17.510112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:17.510112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:17.510112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:17.510112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:17.510112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:17.510964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:17.510964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:17.510964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:17.510964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:17.510964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:17.510964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:17.510964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:17.510964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:17.510964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:17.510964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:17.510964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:17.510964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:17.510964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:17.510964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:17.510964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:17.510964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:17.510964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:17.512443 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:17.512443 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:17.512443 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:17.512443 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 196/381] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:17.512443 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3775c7-62da-4c65-92f5-c6cf37487e3b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:17.512723 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3775c7-62da-4c65-92f5-c6cf37487e3b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:17.512794 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3775c7-62da-4c65-92f5-c6cf37487e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:17.531534 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-6c3775c7-62da-4c65-92f5-c6cf37487e3b None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:17.532727 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6c3775c7-62da-4c65-92f5-c6cf37487e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:17.537234 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:17.542299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:17.543274 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5c7a3-2bee-44c4-acf1-b06dd0e57123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:17.543870 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5c7a3-2bee-44c4-acf1-b06dd0e57123 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:17.544163 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5c7a3-2bee-44c4-acf1-b06dd0e57123 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:17.544413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5c7a3-2bee-44c4-acf1-b06dd0e57123 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:17.545164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5c7a3-2bee-44c4-acf1-b06dd0e57123 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:17.545520 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5c7a3-2bee-44c4-acf1-b06dd0e57123 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:17.546949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5c7a3-2bee-44c4-acf1-b06dd0e57123 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:17.584232 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 186/382] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Oct 31 12:20:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:17.584972 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5c7a3-2bee-44c4-acf1-b06dd0e57123 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:17.607571 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 197/383] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:17.608404 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3775c7-62da-4c65-92f5-c6cf37487e3b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:17.698479 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5c7a3-2bee-44c4-acf1-b06dd0e57123 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:17.715612 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3775c7-62da-4c65-92f5-c6cf37487e3b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:17.733360 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d64433-d3b8-4455-a90f-fcb4ced0aee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:17.733971 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d64433-d3b8-4455-a90f-fcb4ced0aee7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:17.734250 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d64433-d3b8-4455-a90f-fcb4ced0aee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:17.734518 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d64433-d3b8-4455-a90f-fcb4ced0aee7 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:17.735151 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d64433-d3b8-4455-a90f-fcb4ced0aee7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:17.735451 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d64433-d3b8-4455-a90f-fcb4ced0aee7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:17.736816 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d64433-d3b8-4455-a90f-fcb4ced0aee7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:17.753396 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 187/384] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:17.753573 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d49a6f-951a-4c00-9689-10b71b39b3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:17.753693 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d64433-d3b8-4455-a90f-fcb4ced0aee7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:17.753767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d49a6f-951a-4c00-9689-10b71b39b3ab None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:17.753767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d49a6f-951a-4c00-9689-10b71b39b3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:17.753767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d49a6f-951a-4c00-9689-10b71b39b3ab None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:17.753767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d49a6f-951a-4c00-9689-10b71b39b3ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:17.753767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d49a6f-951a-4c00-9689-10b71b39b3ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:17.753767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d49a6f-951a-4c00-9689-10b71b39b3ab None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:17.769447 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 198/385] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:17.769447 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d49a6f-951a-4c00-9689-10b71b39b3ab None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:17.772658 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:17.810522 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:17.862526 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d64433-d3b8-4455-a90f-fcb4ced0aee7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:17.872718 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d49a6f-951a-4c00-9689-10b71b39b3ab None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:17.897591 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25566ac6-08a4-496f-9114-5d45fee91d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:17.898210 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25566ac6-08a4-496f-9114-5d45fee91d98 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:17.898491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25566ac6-08a4-496f-9114-5d45fee91d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:17.898757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25566ac6-08a4-496f-9114-5d45fee91d98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:17.906843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf3e2a-88d3-4caa-9303-99aeda6730e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:17.907465 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf3e2a-88d3-4caa-9303-99aeda6730e8 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:17.907739 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf3e2a-88d3-4caa-9303-99aeda6730e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:17.908006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf3e2a-88d3-4caa-9303-99aeda6730e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:17.908418 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25566ac6-08a4-496f-9114-5d45fee91d98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:17.913824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-25566ac6-08a4-496f-9114-5d45fee91d98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:17.913824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:17.913824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:17.913824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:17.913824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:17.913824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:17.913824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:17.913824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:17.913824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:17.913824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:17.913824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:17.913824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:17.913824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:17.913824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:17.913824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:17.913824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:17.914753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:17.914753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:17.914753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:17.914753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:17.914753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:17.914753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:17.914753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:17.914753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:17.914753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:17.914753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:17.914753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:17.914753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:17.914753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:17.914753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:17.914753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:17.914753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:17.917809 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:17.917809 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:17.917809 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:17.917809 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:17.917809 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:17.917809 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:17.917809 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:17.917809 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:17.917809 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:17.917809 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:17.917809 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:17.917809 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:17.917809 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 188/386] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 31 12:20:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:17.917809 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25566ac6-08a4-496f-9114-5d45fee91d98 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:17.919882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf3e2a-88d3-4caa-9303-99aeda6730e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:17.921384 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf3e2a-88d3-4caa-9303-99aeda6730e8 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:17.935691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-0ddf3e2a-88d3-4caa-9303-99aeda6730e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:17.935691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:17.935691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:17.935691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:17.935691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:17.935691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:17.935691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:17.935691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:17.935691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:17.935691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:17.935691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:17.935691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:17.935691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:17.935691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:17.935691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:17.935691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:17.936844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:17.936844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:17.936844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:17.936844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:17.936844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:17.936844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:17.936844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:17.936844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:17.936844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:17.936844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:17.936844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:17.936844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:17.936844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:17.936844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:17.936844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:17.936844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:17.936844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:17.937718 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:17.937718 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:17.937718 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:17.937718 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 199/387] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:17.937718 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf3e2a-88d3-4caa-9303-99aeda6730e8 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:17.991921 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:18.013589 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25566ac6-08a4-496f-9114-5d45fee91d98 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:18.023504 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:18.036292 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf3e2a-88d3-4caa-9303-99aeda6730e8 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:18.047026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0eaee6-bb15-49e5-a9ce-8c2fd5f7deae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:18.047644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eaee6-bb15-49e5-a9ce-8c2fd5f7deae None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:18.047922 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eaee6-bb15-49e5-a9ce-8c2fd5f7deae None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:18.048190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eaee6-bb15-49e5-a9ce-8c2fd5f7deae None admin] PATH_INFO: `/v3/users/glance` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:18.056031 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0eaee6-bb15-49e5-a9ce-8c2fd5f7deae None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:18.057487 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0eaee6-bb15-49e5-a9ce-8c2fd5f7deae None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:18.068737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-6a0eaee6-bb15-49e5-a9ce-8c2fd5f7deae None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 31 12:20:18.068737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:18.068737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:18.068737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:18.068737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:18.068737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:18.068737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:18.068737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:18.068737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:18.068737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:18.068737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:18.068737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:18.068737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:20:18.068737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:20:18.068737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:20:18.068737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:20:18.069673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:18.069673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:18.069673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:20:18.069673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:18.069673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:20:18.069673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:18.069673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:18.069673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:18.069673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:18.069673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:18.069673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:18.069673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:18.069673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:18.069673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:18.069673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:18.069673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:18.069673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:18.069673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:18.070562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:18.070562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:18.070562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:20:18.070562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:20:18.070562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:20:18.070562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:20:18.070562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:20:18.070562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:20:18.070562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 31 12:20:18.070562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:18.070562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 189/388] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:20:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:18.071256 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0eaee6-bb15-49e5-a9ce-8c2fd5f7deae None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:18.073428 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff5332-9333-4fbd-bb06-44b711685763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:18.074057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff5332-9333-4fbd-bb06-44b711685763 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:18.074486 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff5332-9333-4fbd-bb06-44b711685763 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:18.074599 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff5332-9333-4fbd-bb06-44b711685763 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:18.082288 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff5332-9333-4fbd-bb06-44b711685763 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:18.083747 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff5332-9333-4fbd-bb06-44b711685763 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:18.096145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-ddff5332-9333-4fbd-bb06-44b711685763 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 12:20:18.096145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:18.096145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:18.096145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:18.096145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:18.096145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:18.096145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:18.096145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:18.096145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:18.096145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:18.096145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:18.096145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:18.096145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:20:18.096145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:20:18.096145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:20:18.096145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:20:18.097033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:18.097033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:18.097033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:20:18.097033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:18.097033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:20:18.097033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:18.097033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:18.097033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:18.097033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:18.097033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:18.097033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:18.097033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:18.097033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:18.097033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:18.097033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:18.097033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:18.097033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:18.097033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:18.097962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:18.097962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:18.097962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:20:18.097962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:20:18.097962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:20:18.097962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:20:18.097962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:20:18.097962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:20:18.097962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 12:20:18.097962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:18.097962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 200/389] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:20:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:18.098512 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff5332-9333-4fbd-bb06-44b711685763 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:18.173004 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0eaee6-bb15-49e5-a9ce-8c2fd5f7deae None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:18.199125 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff5332-9333-4fbd-bb06-44b711685763 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:18.206196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a69e5-fcf1-4532-977d-a269403e6331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:18.206821 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a69e5-fcf1-4532-977d-a269403e6331 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:18.207123 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a69e5-fcf1-4532-977d-a269403e6331 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:18.207398 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a69e5-fcf1-4532-977d-a269403e6331 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:18.212658 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:18.217811 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a69e5-fcf1-4532-977d-a269403e6331 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:18.219252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a69e5-fcf1-4532-977d-a269403e6331 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:18.233307 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f9a21-d91f-4e44-9c59-fe77b07148ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:18.233904 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f9a21-d91f-4e44-9c59-fe77b07148ba None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:18.233998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-2c3a69e5-fcf1-4532-977d-a269403e6331 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:18.233998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:18.233998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:18.233998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:18.233998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:18.233998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:18.233998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:18.233998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:18.233998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:18.233998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:18.233998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:18.233998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:18.233998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:18.233998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:18.233998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:18.233998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:18.234899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:18.234899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:18.234899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:18.234899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:18.234899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:18.234899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:18.234899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:18.234899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:18.234899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:18.234899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:18.234899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:18.234899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:18.234899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:18.234899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:18.234899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:18.234899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:18.234899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:18.235736 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:18.235736 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:18.235736 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:18.235908 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f9a21-d91f-4e44-9c59-fe77b07148ba None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:18.235908 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f9a21-d91f-4e44-9c59-fe77b07148ba None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:18.235908 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f9a21-d91f-4e44-9c59-fe77b07148ba None admin] RBAC: Adding query filter params (name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:18.236083 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 190/390] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:18.236156 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f9a21-d91f-4e44-9c59-fe77b07148ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:18.236222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a69e5-fcf1-4532-977d-a269403e6331 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:18.236864 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f9a21-d91f-4e44-9c59-fe77b07148ba None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:18.245932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 201/391] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 31 12:20:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:18.246749 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f9a21-d91f-4e44-9c59-fe77b07148ba None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:18.266445 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:18.341202 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a69e5-fcf1-4532-977d-a269403e6331 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:18.344340 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f9a21-d91f-4e44-9c59-fe77b07148ba None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:18.374362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee889ec4-fe2e-4e74-a607-9c2a3f281bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:18.374967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee889ec4-fe2e-4e74-a607-9c2a3f281bbf None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:18.375252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee889ec4-fe2e-4e74-a607-9c2a3f281bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:18.375527 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee889ec4-fe2e-4e74-a607-9c2a3f281bbf None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:18.376175 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee889ec4-fe2e-4e74-a607-9c2a3f281bbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:18.376483 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee889ec4-fe2e-4e74-a607-9c2a3f281bbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:18.376902 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f861d0b-5843-4e58-b4b2-82e8de18244e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:18.377525 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f861d0b-5843-4e58-b4b2-82e8de18244e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:18.377804 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f861d0b-5843-4e58-b4b2-82e8de18244e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:18.377889 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee889ec4-fe2e-4e74-a607-9c2a3f281bbf None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:18.378070 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f861d0b-5843-4e58-b4b2-82e8de18244e None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:18.378780 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f861d0b-5843-4e58-b4b2-82e8de18244e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:18.379078 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f861d0b-5843-4e58-b4b2-82e8de18244e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:18.380463 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f861d0b-5843-4e58-b4b2-82e8de18244e None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:18.390244 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 191/392] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:18.391024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee889ec4-fe2e-4e74-a607-9c2a3f281bbf None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:18.417626 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 202/393] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Oct 31 12:20:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:18.418545 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f861d0b-5843-4e58-b4b2-82e8de18244e None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:18.450677 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:18.476777 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:18.495494 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee889ec4-fe2e-4e74-a607-9c2a3f281bbf None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:18.515985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f861d0b-5843-4e58-b4b2-82e8de18244e None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:18.528311 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24529607-5af0-4a4b-86f8-a137d49f99c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:18.528910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24529607-5af0-4a4b-86f8-a137d49f99c6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:18.529228 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24529607-5af0-4a4b-86f8-a137d49f99c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:18.529499 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24529607-5af0-4a4b-86f8-a137d49f99c6 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:18.530223 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24529607-5af0-4a4b-86f8-a137d49f99c6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:18.530523 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24529607-5af0-4a4b-86f8-a137d49f99c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:18.531945 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24529607-5af0-4a4b-86f8-a137d49f99c6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:18.549058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 192/394] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Oct 31 12:20:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:18.549396 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95424ec9-654e-4228-a229-bea4a441ef8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:18.549871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24529607-5af0-4a4b-86f8-a137d49f99c6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:18.549973 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95424ec9-654e-4228-a229-bea4a441ef8f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:18.550289 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95424ec9-654e-4228-a229-bea4a441ef8f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:18.550519 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95424ec9-654e-4228-a229-bea4a441ef8f None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:18.551234 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95424ec9-654e-4228-a229-bea4a441ef8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:18.551535 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95424ec9-654e-4228-a229-bea4a441ef8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:18.552884 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95424ec9-654e-4228-a229-bea4a441ef8f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:18.568644 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 203/395] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:18.568644 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95424ec9-654e-4228-a229-bea4a441ef8f None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:18.651161 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24529607-5af0-4a4b-86f8-a137d49f99c6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:18.657835 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:18.667110 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95424ec9-654e-4228-a229-bea4a441ef8f None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:18.686385 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7922d4-3b93-4b87-abc9-752d047b69c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:18.687015 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7922d4-3b93-4b87-abc9-752d047b69c4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:18.687291 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7922d4-3b93-4b87-abc9-752d047b69c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:18.687564 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7922d4-3b93-4b87-abc9-752d047b69c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:18.695484 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:18.698304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7922d4-3b93-4b87-abc9-752d047b69c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:18.700031 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7922d4-3b93-4b87-abc9-752d047b69c4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:18.700966 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94024992-d6a6-41cd-88b4-acfcbf303263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:18.701583 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94024992-d6a6-41cd-88b4-acfcbf303263 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:18.701867 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94024992-d6a6-41cd-88b4-acfcbf303263 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:18.702139 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94024992-d6a6-41cd-88b4-acfcbf303263 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:18.709602 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94024992-d6a6-41cd-88b4-acfcbf303263 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:18.711039 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94024992-d6a6-41cd-88b4-acfcbf303263 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:18.715656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-2f7922d4-3b93-4b87-abc9-752d047b69c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:18.715656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:18.715656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:18.715656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:18.715656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:18.715656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:18.715656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:18.715656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:18.715656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:18.715656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:18.715656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:18.715656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:18.715656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:18.715656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:18.715656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:18.715656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:18.716510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:18.716510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:18.716510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:18.716510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:18.716510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:18.716510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:18.716510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:18.716510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:18.716510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:18.716510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:18.716510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:18.716510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:18.716510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:18.716510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:18.716510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:18.716510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:18.716510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:18.717368 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:18.717368 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:18.717368 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:18.717368 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 193/396] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:18.717595 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7922d4-3b93-4b87-abc9-752d047b69c4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:18.723692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-94024992-d6a6-41cd-88b4-acfcbf303263 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:18.723692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:18.723692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:18.723692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:18.723692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:18.723692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:18.723692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:18.723692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:18.723692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:18.723692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:18.723692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:18.723692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:18.723692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:20:18.723692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:20:18.723692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:20:18.724658 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:20:18.724658 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:18.724658 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:18.724658 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:18.724658 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:18.724658 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:18.724658 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:18.724658 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:18.724658 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:18.724658 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:18.724658 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:18.724658 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:18.724658 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:18.724658 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:18.724658 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:18.724658 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:18.724658 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:18.725567 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:20:18.725567 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:20:18.725567 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:20:18.725567 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:20:18.725567 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:20:18.725567 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:20:18.725567 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:18.725567 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:18.725567 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 204/397] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:18.725567 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94024992-d6a6-41cd-88b4-acfcbf303263 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:18.815490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7922d4-3b93-4b87-abc9-752d047b69c4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:18.825301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94024992-d6a6-41cd-88b4-acfcbf303263 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:18.849067 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d104f-b8e7-4f3a-bc25-579b6003096d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:18.849713 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d104f-b8e7-4f3a-bc25-579b6003096d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:18.849988 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d104f-b8e7-4f3a-bc25-579b6003096d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:18.850264 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d104f-b8e7-4f3a-bc25-579b6003096d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:18.857414 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db4435-66c3-43c6-bfac-f3fb6d54ef71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:18.858028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db4435-66c3-43c6-bfac-f3fb6d54ef71 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:18.858308 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db4435-66c3-43c6-bfac-f3fb6d54ef71 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:18.858584 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db4435-66c3-43c6-bfac-f3fb6d54ef71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:18.860642 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d104f-b8e7-4f3a-bc25-579b6003096d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:18.862110 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d104f-b8e7-4f3a-bc25-579b6003096d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:18.869815 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db4435-66c3-43c6-bfac-f3fb6d54ef71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:18.871237 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db4435-66c3-43c6-bfac-f3fb6d54ef71 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:18.875761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-1a8d104f-b8e7-4f3a-bc25-579b6003096d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:18.875761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:18.875761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:18.875761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:18.875761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:18.875761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:18.875761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:18.875761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:18.875761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:18.875761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:18.875761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:18.875761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:18.875761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:18.875761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:18.875761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:18.875761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:18.876760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:18.876760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:18.876760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:18.876760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:18.876760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:18.876760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:18.876760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:18.876760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:18.876760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:18.876760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:18.876760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:18.876760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:18.876760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:18.876760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:18.876760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:18.876760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:18.876760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:18.877644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:18.877644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:18.877644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:18.877644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 194/398] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:18.877644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d104f-b8e7-4f3a-bc25-579b6003096d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:18.889803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-97db4435-66c3-43c6-bfac-f3fb6d54ef71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:18.889803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:18.889803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:18.889803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:18.889803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:18.889803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:18.889803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:18.889803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:18.889803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:18.889803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:18.889803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:18.889803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:18.889803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:18.889803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:18.889803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:18.889803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:18.890704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:18.890704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:18.890704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:18.890704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:18.890704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:18.890704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:18.890704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:18.890704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:18.890704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:18.890704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:18.890704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:18.890704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:18.890704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:18.890704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:18.890704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:18.890704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:18.890704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:18.892111 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:18.892111 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:18.892111 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:18.892111 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 205/399] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:18.892111 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db4435-66c3-43c6-bfac-f3fb6d54ef71 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:18.901079 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:18.926079 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:18.979475 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d104f-b8e7-4f3a-bc25-579b6003096d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:18.990030 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db4435-66c3-43c6-bfac-f3fb6d54ef71 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:19.011758 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c865638-ed8c-4a8c-bd71-a1e6a5c7e647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:19.012353 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c865638-ed8c-4a8c-bd71-a1e6a5c7e647 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:19.012634 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c865638-ed8c-4a8c-bd71-a1e6a5c7e647 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:19.012903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c865638-ed8c-4a8c-bd71-a1e6a5c7e647 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:19.013572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c865638-ed8c-4a8c-bd71-a1e6a5c7e647 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:19.014988 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c865638-ed8c-4a8c-bd71-a1e6a5c7e647 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:19.022467 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95744e58-6087-446a-8a54-2b217e51dc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:19.023062 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95744e58-6087-446a-8a54-2b217e51dc03 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:19.023337 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95744e58-6087-446a-8a54-2b217e51dc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:19.023608 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95744e58-6087-446a-8a54-2b217e51dc03 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:19.024871 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95744e58-6087-446a-8a54-2b217e51dc03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:19.025205 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95744e58-6087-446a-8a54-2b217e51dc03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:19.026549 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95744e58-6087-446a-8a54-2b217e51dc03 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:19.036126 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 195/400] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 31 12:20:18 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:20:19.036920 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c865638-ed8c-4a8c-bd71-a1e6a5c7e647 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:19.043914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 206/401] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:19.043914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95744e58-6087-446a-8a54-2b217e51dc03 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:19.123187 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:19.154533 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:19.158248 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c865638-ed8c-4a8c-bd71-a1e6a5c7e647 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:19.164132 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95744e58-6087-446a-8a54-2b217e51dc03 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:19.199095 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4154bde-ad77-4ab9-a837-ebeff8f89c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:19.199706 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4154bde-ad77-4ab9-a837-ebeff8f89c19 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:19.199980 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4154bde-ad77-4ab9-a837-ebeff8f89c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:19.200264 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4154bde-ad77-4ab9-a837-ebeff8f89c19 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:19.200941 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4154bde-ad77-4ab9-a837-ebeff8f89c19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:19.201343 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4154bde-ad77-4ab9-a837-ebeff8f89c19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:19.202684 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8faa333-a826-4a03-805f-c69e973b4815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:19.202810 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4154bde-ad77-4ab9-a837-ebeff8f89c19 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:19.203297 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8faa333-a826-4a03-805f-c69e973b4815 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:19.203572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8faa333-a826-4a03-805f-c69e973b4815 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:19.203842 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8faa333-a826-4a03-805f-c69e973b4815 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:19.204484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8faa333-a826-4a03-805f-c69e973b4815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:19.204781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8faa333-a826-4a03-805f-c69e973b4815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:19.206160 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8faa333-a826-4a03-805f-c69e973b4815 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:19.217868 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 207/402] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:19.218672 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8faa333-a826-4a03-805f-c69e973b4815 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:19.225362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 196/403] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:20:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:19.226262 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4154bde-ad77-4ab9-a837-ebeff8f89c19 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:19.326389 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8faa333-a826-4a03-805f-c69e973b4815 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:19.333408 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4154bde-ad77-4ab9-a837-ebeff8f89c19 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:19.351414 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:19.361413 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab2ffa-7057-45b2-8098-aa5bef97af43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:19.362053 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab2ffa-7057-45b2-8098-aa5bef97af43 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:19.362308 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab2ffa-7057-45b2-8098-aa5bef97af43 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:19.362585 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab2ffa-7057-45b2-8098-aa5bef97af43 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:19.363234 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab2ffa-7057-45b2-8098-aa5bef97af43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:19.363538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab2ffa-7057-45b2-8098-aa5bef97af43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:19.364897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab2ffa-7057-45b2-8098-aa5bef97af43 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:19.370343 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404cdfe-5260-4f3f-a355-cea193bc4d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:19.371192 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404cdfe-5260-4f3f-a355-cea193bc4d83 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:19.371641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404cdfe-5260-4f3f-a355-cea193bc4d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:19.372081 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404cdfe-5260-4f3f-a355-cea193bc4d83 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:19.377272 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 208/404] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:19.378085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab2ffa-7057-45b2-8098-aa5bef97af43 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:19.383884 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404cdfe-5260-4f3f-a355-cea193bc4d83 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:19.385343 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404cdfe-5260-4f3f-a355-cea193bc4d83 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:19.397296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-7404cdfe-5260-4f3f-a355-cea193bc4d83 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 31 12:20:19.397296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:19.397296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:19.397296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:19.397296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:19.397296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:19.397296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:19.397296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:19.397296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:19.397296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:19.397296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:19.397296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:19.397296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:20:19.397296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:20:19.397296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:20:19.397296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:20:19.398222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:19.398222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:19.398222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:20:19.398222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:19.398222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:20:19.398222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:19.398222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:19.398222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:19.398222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:19.398222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:19.398222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:19.398222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:19.398222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:19.398222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:19.398222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:19.398222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:19.398222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:19.398222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:19.399157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:19.399157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:19.399157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:20:19.399157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:20:19.399157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:20:19.399157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:20:19.399157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:20:19.399157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:20:19.399157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 31 12:20:19.399157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:19.399157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 197/405] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 31 12:20:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:19.400332 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404cdfe-5260-4f3f-a355-cea193bc4d83 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:19.424293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:19.489523 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab2ffa-7057-45b2-8098-aa5bef97af43 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:19.516864 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404cdfe-5260-4f3f-a355-cea193bc4d83 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:19.524029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315053d-51dd-4624-999f-dbc4962d91db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:19.524536 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315053d-51dd-4624-999f-dbc4962d91db None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:19.524536 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315053d-51dd-4624-999f-dbc4962d91db None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:19.524668 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315053d-51dd-4624-999f-dbc4962d91db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:19.531478 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315053d-51dd-4624-999f-dbc4962d91db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:19.532929 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315053d-51dd-4624-999f-dbc4962d91db None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:19.544763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-2315053d-51dd-4624-999f-dbc4962d91db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:19.544763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:19.544763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:19.544763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:19.544763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:19.544763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:19.544763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:19.544763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:19.544763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:19.544763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:19.544763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:19.544763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:19.544763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:20:19.544763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:20:19.544763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:20:19.545643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:20:19.545643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:19.545643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:19.545643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:19.545643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:19.545643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:19.545643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:19.545643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:19.545643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:19.545643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:19.545643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:19.545643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:19.545643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:19.545643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:19.545643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:19.545643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:19.545643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:19.546475 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:20:19.546475 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:20:19.546475 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:20:19.546475 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:20:19.546475 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:20:19.546475 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:20:19.546475 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:19.546475 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:19.546475 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 209/406] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:19.547355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315053d-51dd-4624-999f-dbc4962d91db None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:19.558682 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726e66c-f00f-42e2-b3df-27c5632f3ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:19.559346 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726e66c-f00f-42e2-b3df-27c5632f3ce9 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:19.559631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726e66c-f00f-42e2-b3df-27c5632f3ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:19.559905 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726e66c-f00f-42e2-b3df-27c5632f3ce9 None admin] PATH_INFO: `/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/d93ce5759e0648a1934ff4d9c9d8fe61/roles/df935cf8a7f24352ba94fe83718280ea` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:19.574730 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726e66c-f00f-42e2-b3df-27c5632f3ce9 None admin] RBAC: Authorizing `identity:create_grant(project_id=786ee416a639447ab3698d1f56d04e9a, user_id=d93ce5759e0648a1934ff4d9c9d8fe61, role_id=df935cf8a7f24352ba94fe83718280ea)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:19.576283 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726e66c-f00f-42e2-b3df-27c5632f3ce9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:19.597222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 198/407] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:20:19 2022] PUT /identity/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/d93ce5759e0648a1934ff4d9c9d8fe61/roles/df935cf8a7f24352ba94fe83718280ea => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:20:19.597222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726e66c-f00f-42e2-b3df-27c5632f3ce9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:19.604817 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:19.682107 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315053d-51dd-4624-999f-dbc4962d91db None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:19.695002 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:19.730588 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d9da0-7de4-4c3b-be1e-c88d9781627a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:19.731249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d9da0-7de4-4c3b-be1e-c88d9781627a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:19.731914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d9da0-7de4-4c3b-be1e-c88d9781627a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:19.732191 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d9da0-7de4-4c3b-be1e-c88d9781627a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:19.734724 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726e66c-f00f-42e2-b3df-27c5632f3ce9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:19.741241 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d9da0-7de4-4c3b-be1e-c88d9781627a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:19.743281 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d9da0-7de4-4c3b-be1e-c88d9781627a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:19.761249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-e76d9da0-7de4-4c3b-be1e-c88d9781627a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:19.761249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:19.761249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:19.761249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:19.761249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:19.761249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:19.761249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:19.761249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:19.761249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:19.761249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:19.761249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:19.761249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:19.761249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:20:19.761249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:20:19.761249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:20:19.762174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:20:19.762174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:19.762174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:19.762174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:19.762174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:19.762174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:19.762174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:19.762174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:19.762174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:19.762174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:19.762174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:19.762174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:19.762174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:19.762174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:19.762174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:19.762174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:19.762174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:19.763028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:20:19.763028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:20:19.763028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:20:19.763028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:20:19.763028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:20:19.763028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:20:19.763028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:19.763028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:19.765264 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 210/408] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:19.766141 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d9da0-7de4-4c3b-be1e-c88d9781627a None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:19.787021 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cfd77-d95a-4fe5-8e53-ef2b5804ea19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:19.787632 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cfd77-d95a-4fe5-8e53-ef2b5804ea19 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:19.787913 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cfd77-d95a-4fe5-8e53-ef2b5804ea19 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:19.788188 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cfd77-d95a-4fe5-8e53-ef2b5804ea19 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:19.788929 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842cfd77-d95a-4fe5-8e53-ef2b5804ea19 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:19.789275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842cfd77-d95a-4fe5-8e53-ef2b5804ea19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:19.791241 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842cfd77-d95a-4fe5-8e53-ef2b5804ea19 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:19.811938 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 199/409] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Oct 31 12:20:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:19.813639 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cfd77-d95a-4fe5-8e53-ef2b5804ea19 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:19.896932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d9da0-7de4-4c3b-be1e-c88d9781627a None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:19.905070 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:19.922382 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cfd77-d95a-4fe5-8e53-ef2b5804ea19 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:19.936053 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4558e2-da53-46a7-81ff-daa4049ccd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:19.936999 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4558e2-da53-46a7-81ff-daa4049ccd1f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:19.937517 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4558e2-da53-46a7-81ff-daa4049ccd1f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:19.937981 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4558e2-da53-46a7-81ff-daa4049ccd1f None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:19.938873 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4558e2-da53-46a7-81ff-daa4049ccd1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:19.939374 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4558e2-da53-46a7-81ff-daa4049ccd1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:19.941573 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4558e2-da53-46a7-81ff-daa4049ccd1f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:19.960198 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172b731-6424-4220-89ef-5b9ad536f99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:19.960829 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172b731-6424-4220-89ef-5b9ad536f99b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:19.961133 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172b731-6424-4220-89ef-5b9ad536f99b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:19.961969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172b731-6424-4220-89ef-5b9ad536f99b None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:19.962634 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172b731-6424-4220-89ef-5b9ad536f99b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:19.962935 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172b731-6424-4220-89ef-5b9ad536f99b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:19.964367 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172b731-6424-4220-89ef-5b9ad536f99b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:19.965287 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 211/410] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:20:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:19.966319 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4558e2-da53-46a7-81ff-daa4049ccd1f None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:19.967198 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:19.985028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 200/411] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:20:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:19.985958 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172b731-6424-4220-89ef-5b9ad536f99b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:20.077259 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4558e2-da53-46a7-81ff-daa4049ccd1f None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:20.108804 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172b731-6424-4220-89ef-5b9ad536f99b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:20.120706 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9a211-37cf-4dd5-a914-b4afe6c7f792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:20.121413 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9a211-37cf-4dd5-a914-b4afe6c7f792 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:20.121695 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9a211-37cf-4dd5-a914-b4afe6c7f792 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:20.122374 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9a211-37cf-4dd5-a914-b4afe6c7f792 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:20.134934 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9a211-37cf-4dd5-a914-b4afe6c7f792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:20.136933 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9a211-37cf-4dd5-a914-b4afe6c7f792 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:20.148597 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b4e92-0d04-4b5c-a817-b3dfa202ebe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:20.150128 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b4e92-0d04-4b5c-a817-b3dfa202ebe0 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:20.150601 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b4e92-0d04-4b5c-a817-b3dfa202ebe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:20.151128 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b4e92-0d04-4b5c-a817-b3dfa202ebe0 None admin] PATH_INFO: `/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/d4c6b6b1cdc649dda3a9caa8d9713569/roles/df935cf8a7f24352ba94fe83718280ea` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:20.156117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-1dd9a211-37cf-4dd5-a914-b4afe6c7f792 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:20.156117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:20.156117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:20.156117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:20.156117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:20.156117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:20.156117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:20.156117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:20.156117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:20.156117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:20.156117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:20.156117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:20.156117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:20.156117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:20.156117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:20.156117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:20.156989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:20.156989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:20.156989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:20.156989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:20.156989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:20.156989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:20.156989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:20.156989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:20.156989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:20.156989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:20.156989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:20.156989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:20.156989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:20.156989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:20.156989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:20.156989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:20.156989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:20.157861 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:20.157861 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:20.157861 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:20.162145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 212/412] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:20.163535 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9a211-37cf-4dd5-a914-b4afe6c7f792 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:20.175660 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b4e92-0d04-4b5c-a817-b3dfa202ebe0 None admin] RBAC: Authorizing `identity:create_grant(project_id=786ee416a639447ab3698d1f56d04e9a, user_id=d4c6b6b1cdc649dda3a9caa8d9713569, role_id=df935cf8a7f24352ba94fe83718280ea)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:20.178443 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b4e92-0d04-4b5c-a817-b3dfa202ebe0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:20.185900 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:20.196835 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 201/413] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:20:19 2022] PUT /identity/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/d4c6b6b1cdc649dda3a9caa8d9713569/roles/df935cf8a7f24352ba94fe83718280ea => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:20:20.198001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b4e92-0d04-4b5c-a817-b3dfa202ebe0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:20.285069 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:20.372099 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9a211-37cf-4dd5-a914-b4afe6c7f792 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:20.421086 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b4e92-0d04-4b5c-a817-b3dfa202ebe0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:20.435405 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd0312-4b95-4fc6-b327-2e5ef83bd7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:20.436070 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd0312-4b95-4fc6-b327-2e5ef83bd7ce None admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:20.436348 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd0312-4b95-4fc6-b327-2e5ef83bd7ce None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:20.436617 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd0312-4b95-4fc6-b327-2e5ef83bd7ce None admin] PATH_INFO: `/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/b2ffd08478684105b83c4e74566ca6a9/roles/df935cf8a7f24352ba94fe83718280ea` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:20.457227 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd0312-4b95-4fc6-b327-2e5ef83bd7ce None admin] RBAC: Authorizing `identity:create_grant(project_id=786ee416a639447ab3698d1f56d04e9a, user_id=b2ffd08478684105b83c4e74566ca6a9, role_id=df935cf8a7f24352ba94fe83718280ea)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:20.458996 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd0312-4b95-4fc6-b327-2e5ef83bd7ce None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:20.461998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163d897-69ee-4998-9d48-12a1e9b89272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:20.463096 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163d897-69ee-4998-9d48-12a1e9b89272 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:20.463575 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163d897-69ee-4998-9d48-12a1e9b89272 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:20.464040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163d897-69ee-4998-9d48-12a1e9b89272 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:20.464881 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163d897-69ee-4998-9d48-12a1e9b89272 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:20.465476 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163d897-69ee-4998-9d48-12a1e9b89272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:20.467122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163d897-69ee-4998-9d48-12a1e9b89272 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:20.475425 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 213/414] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:20:20 2022] PUT /identity/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/b2ffd08478684105b83c4e74566ca6a9/roles/df935cf8a7f24352ba94fe83718280ea => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:20:20.480555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 202/415] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:20.486037 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd0312-4b95-4fc6-b327-2e5ef83bd7ce None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:20.561979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:20.614972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd0312-4b95-4fc6-b327-2e5ef83bd7ce None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:20.662923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc100f65-e1e9-4d43-a5aa-a4788665823e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:20.663729 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc100f65-e1e9-4d43-a5aa-a4788665823e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:20.664106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc100f65-e1e9-4d43-a5aa-a4788665823e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:20.664593 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc100f65-e1e9-4d43-a5aa-a4788665823e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:20.672969 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc100f65-e1e9-4d43-a5aa-a4788665823e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:20.674587 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc100f65-e1e9-4d43-a5aa-a4788665823e None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:20.687932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-bc100f65-e1e9-4d43-a5aa-a4788665823e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:20.687932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:20.687932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:20.687932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:20.687932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:20.687932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:20.687932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:20.687932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:20.687932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:20.687932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:20.687932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:20.687932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:20.687932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:20:20.687932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:20:20.687932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:20:20.689014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:20:20.689014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:20.689014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:20.689014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:20.689014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:20.689014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:20.689014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:20.689014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:20.689014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:20.689014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:20.689014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:20.689014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:20.689014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:20.689014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:20.689014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:20.689014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:20.689014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:20.690084 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:20:20.690084 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:20:20.690084 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:20:20.690084 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:20:20.690084 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:20:20.690084 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:20:20.690084 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:20.690084 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:20.691449 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 214/416] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:20.697724 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163d897-69ee-4998-9d48-12a1e9b89272 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:20.803044 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:20.807490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163d897-69ee-4998-9d48-12a1e9b89272 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:20.854508 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e5a1b-4ad0-4276-8b6b-e8ef906cf9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:20.855270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e5a1b-4ad0-4276-8b6b-e8ef906cf9cb None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:20.855673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e5a1b-4ad0-4276-8b6b-e8ef906cf9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:20.856041 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e5a1b-4ad0-4276-8b6b-e8ef906cf9cb None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:20.856855 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e5a1b-4ad0-4276-8b6b-e8ef906cf9cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:20.857337 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e5a1b-4ad0-4276-8b6b-e8ef906cf9cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:20.858861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e5a1b-4ad0-4276-8b6b-e8ef906cf9cb None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:20.875371 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 203/417] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:20:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:20.880927 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc100f65-e1e9-4d43-a5aa-a4788665823e None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:21.030160 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc100f65-e1e9-4d43-a5aa-a4788665823e None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:21.072485 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:21.086936 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4c31a-118c-4d6f-a0c6-03919ac2adf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:21.087608 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4c31a-118c-4d6f-a0c6-03919ac2adf6 None admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:21.087890 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4c31a-118c-4d6f-a0c6-03919ac2adf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:21.088165 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4c31a-118c-4d6f-a0c6-03919ac2adf6 None admin] PATH_INFO: `/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/7179d21011064d5b91d0e35a51b8adae/roles/df935cf8a7f24352ba94fe83718280ea` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:21.110684 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4c31a-118c-4d6f-a0c6-03919ac2adf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=786ee416a639447ab3698d1f56d04e9a, user_id=7179d21011064d5b91d0e35a51b8adae, role_id=df935cf8a7f24352ba94fe83718280ea)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:21.112132 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4c31a-118c-4d6f-a0c6-03919ac2adf6 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:21.141072 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 215/418] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:20:20 2022] PUT /identity/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/7179d21011064d5b91d0e35a51b8adae/roles/df935cf8a7f24352ba94fe83718280ea => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:20:21.389833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cca806-3526-4322-8a0b-fd584500d0a2 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:21.390243 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cca806-3526-4322-8a0b-fd584500d0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:21.390418 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cca806-3526-4322-8a0b-fd584500d0a2 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:21.391976 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 204/419] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:21.397881 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f074cf-d059-4ad9-9ccb-3c20b4de02f2 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:21.398168 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f074cf-d059-4ad9-9ccb-3c20b4de02f2 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:21.398452 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f074cf-d059-4ad9-9ccb-3c20b4de02f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:21.421924 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-55f074cf-d059-4ad9-9ccb-3c20b4de02f2 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:21.423118 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-55f074cf-d059-4ad9-9ccb-3c20b4de02f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:21.494063 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 216/420] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 12:20:21.791751 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cca806-3526-4322-8a0b-fd584500d0a2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:21.919465 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cca806-3526-4322-8a0b-fd584500d0a2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:21.954000 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796aae9-be79-485d-8f9d-283dcc316742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:21.954626 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796aae9-be79-485d-8f9d-283dcc316742 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:21.954905 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796aae9-be79-485d-8f9d-283dcc316742 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:21.955182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796aae9-be79-485d-8f9d-283dcc316742 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:21.966427 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796aae9-be79-485d-8f9d-283dcc316742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:21.971247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-4796aae9-be79-485d-8f9d-283dcc316742 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:21.971247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:21.971247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:21.971247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:21.971247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:21.971247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:21.971247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:21.971247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:21.971247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:21.971247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:21.971247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:21.971247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:21.971247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:21.971247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:21.971247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:21.971247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:21.972136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:21.972136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:21.972136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:21.972136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:21.972136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:21.972136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:21.972136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:21.972136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:21.972136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:21.972136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:21.972136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:21.972136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:21.972136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:21.972136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:21.972136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:21.972136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:21.972933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:21.972933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:21.972933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:21.972933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:21.972933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:21.972933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:21.972933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:21.972933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:21.972933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:21.972933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:21.972933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:21.972933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:21.972933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 205/421] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 31 12:20:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:21.979903 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f074cf-d059-4ad9-9ccb-3c20b4de02f2 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:22.130928 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f074cf-d059-4ad9-9ccb-3c20b4de02f2 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:22.141156 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:22.169254 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d523a6-0dc1-455d-92de-bab2af44d17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:22.169873 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d523a6-0dc1-455d-92de-bab2af44d17a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:22.170156 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d523a6-0dc1-455d-92de-bab2af44d17a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:22.170430 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d523a6-0dc1-455d-92de-bab2af44d17a None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:22.171102 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d523a6-0dc1-455d-92de-bab2af44d17a None admin] RBAC: Adding query filter params (name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:22.171405 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d523a6-0dc1-455d-92de-bab2af44d17a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:22.172775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d523a6-0dc1-455d-92de-bab2af44d17a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:22.182205 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 217/422] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 31 12:20:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:22.187574 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796aae9-be79-485d-8f9d-283dcc316742 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:22.230296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:22.353898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796aae9-be79-485d-8f9d-283dcc316742 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:22.387395 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e632a6-d75b-432e-9ded-c9d90ca45e2c None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:22.387712 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e632a6-d75b-432e-9ded-c9d90ca45e2c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:22.387955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e632a6-d75b-432e-9ded-c9d90ca45e2c None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:22.389559 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 218/423] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:22.394595 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e3843-05aa-4445-bbd4-daeeda708dfc None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:22.394884 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e3843-05aa-4445-bbd4-daeeda708dfc None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:22.395161 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e3843-05aa-4445-bbd4-daeeda708dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:22.403229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025d41c-fe44-475c-8faf-fae277f75257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:22.404758 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025d41c-fe44-475c-8faf-fae277f75257 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:22.405050 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025d41c-fe44-475c-8faf-fae277f75257 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:22.405351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025d41c-fe44-475c-8faf-fae277f75257 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:22.424603 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-cb5e3843-05aa-4445-bbd4-daeeda708dfc None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:22.426151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-cb5e3843-05aa-4445-bbd4-daeeda708dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:22.429554 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025d41c-fe44-475c-8faf-fae277f75257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:22.429554 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025d41c-fe44-475c-8faf-fae277f75257 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:22.457422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-4025d41c-fe44-475c-8faf-fae277f75257 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:22.457422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:22.457422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:22.457422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:22.457422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:22.457422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:22.457422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:22.457422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:22.457422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:22.457422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:22.457422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:22.457422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:22.457422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:22.457422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:22.457422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:22.457422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:22.458372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:22.458372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:22.458372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:22.458372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:22.458372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:22.458372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:22.458372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:22.458372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:22.458372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:22.458372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:22.458372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:22.458372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:22.458372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:22.458372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:22.458372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:22.458372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:22.458372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:22.459189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:22.459189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:22.459189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:22.461859 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 206/424] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:22.467374 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025d41c-fe44-475c-8faf-fae277f75257 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:22.556270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 219/425] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 12:20:22.581334 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:22.619032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025d41c-fe44-475c-8faf-fae277f75257 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:22.661001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f173648-ceab-4d83-a118-5d9f032cbd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:22.661633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f173648-ceab-4d83-a118-5d9f032cbd4f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:22.661914 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f173648-ceab-4d83-a118-5d9f032cbd4f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:22.662185 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f173648-ceab-4d83-a118-5d9f032cbd4f None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:22.662825 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f173648-ceab-4d83-a118-5d9f032cbd4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:22.663124 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f173648-ceab-4d83-a118-5d9f032cbd4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:22.664589 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f173648-ceab-4d83-a118-5d9f032cbd4f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:22.676770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 207/426] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:22.682378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e3843-05aa-4445-bbd4-daeeda708dfc None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:22.789831 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:22.793078 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e3843-05aa-4445-bbd4-daeeda708dfc None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:22.830250 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1adbb-dae9-4158-88b9-89ae5cca9b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:22.830886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1adbb-dae9-4158-88b9-89ae5cca9b19 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:22.831164 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1adbb-dae9-4158-88b9-89ae5cca9b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:22.831433 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1adbb-dae9-4158-88b9-89ae5cca9b19 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:22.839105 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1adbb-dae9-4158-88b9-89ae5cca9b19 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:22.840564 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1adbb-dae9-4158-88b9-89ae5cca9b19 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:22.853871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e4b3a-0bb2-47f2-a0f6-e5ab553e3f0a None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:22.854377 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e4b3a-0bb2-47f2-a0f6-e5ab553e3f0a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:22.854448 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e4b3a-0bb2-47f2-a0f6-e5ab553e3f0a None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:22.854846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-a1f1adbb-dae9-4158-88b9-89ae5cca9b19 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 31 12:20:22.854846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:22.854846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:22.854846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:22.854846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:22.854846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:22.854846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:22.854846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:22.854846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:22.854846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:22.854846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:22.854846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:22.854846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:20:22.854846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:20:22.854846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:20:22.854846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:20:22.855682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:22.855682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:22.855682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:20:22.855682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:22.855682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:20:22.855682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:22.855682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:22.855682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:22.855682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:22.855682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:22.855682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:22.855682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:22.855682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:22.855682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:22.855682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:22.855682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:22.855682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:22.855682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:22.856579 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:22.856579 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:22.856579 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:20:22.856579 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:20:22.856579 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:20:22.856579 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:20:22.856579 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:20:22.856579 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:20:22.856579 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 31 12:20:22.856579 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:22.857082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 208/427] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:20:22.857382 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 220/428] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 31 12:20:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:22.861773 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e4b3a-0bb2-47f2-a0f6-e5ab553e3f0a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:22.865885 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be992e-04d2-43ea-be29-b34107465c45 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:22.866167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be992e-04d2-43ea-be29-b34107465c45 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:22.866444 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be992e-04d2-43ea-be29-b34107465c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:22.886074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-21be992e-04d2-43ea-be29-b34107465c45 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:22.887191 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-21be992e-04d2-43ea-be29-b34107465c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:23.017231 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 221/429] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 12:20:23.043956 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e4b3a-0bb2-47f2-a0f6-e5ab553e3f0a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:23.063312 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be992e-04d2-43ea-be29-b34107465c45 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:23.100275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:23.119683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b60239-6f14-47dd-8f70-67f693c17c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:23.120298 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b60239-6f14-47dd-8f70-67f693c17c6d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:23.120583 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b60239-6f14-47dd-8f70-67f693c17c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:23.120858 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b60239-6f14-47dd-8f70-67f693c17c6d None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:23.121617 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b60239-6f14-47dd-8f70-67f693c17c6d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:23.121922 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b60239-6f14-47dd-8f70-67f693c17c6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:23.123339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b60239-6f14-47dd-8f70-67f693c17c6d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:23.159988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:23.160868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 209/430] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Oct 31 12:20:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:23.166463 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b60239-6f14-47dd-8f70-67f693c17c6d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:23.170856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be992e-04d2-43ea-be29-b34107465c45 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:23.209069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2b5e6-ff57-4315-8135-36bbbb7e17a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:23.209812 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2b5e6-ff57-4315-8135-36bbbb7e17a5 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:23.210092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2b5e6-ff57-4315-8135-36bbbb7e17a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:23.210363 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2b5e6-ff57-4315-8135-36bbbb7e17a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:23.230012 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2b5e6-ff57-4315-8135-36bbbb7e17a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:23.235031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-c8e2b5e6-ff57-4315-8135-36bbbb7e17a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:23.235031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:23.235031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:23.235031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:23.235031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:23.235031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:23.235031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:23.235031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:23.235031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:23.235031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:23.235031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:23.235031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:23.235031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:23.235031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:23.235031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:23.235031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:23.235975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:23.235975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:23.235975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:23.235975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:23.235975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:23.235975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:23.235975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:23.235975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:23.235975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:23.235975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:23.235975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:23.235975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:23.235975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:23.235975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:23.235975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:23.235975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:23.236765 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:23.236765 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:23.236765 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:23.236765 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:23.236765 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:23.236765 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:23.236765 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:23.236765 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:23.236765 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:23.236765 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:23.236765 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:23.236765 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:23.236765 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 222/431] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 31 12:20:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:23.249441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2b5e6-ff57-4315-8135-36bbbb7e17a5 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:23.368697 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b60239-6f14-47dd-8f70-67f693c17c6d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:23.380624 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2b5e6-ff57-4315-8135-36bbbb7e17a5 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:23.405643 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7c075-6a6b-42d6-be6d-3be5c5267ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:23.406539 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7c075-6a6b-42d6-be6d-3be5c5267ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:23.406996 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7c075-6a6b-42d6-be6d-3be5c5267ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:23.407441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7c075-6a6b-42d6-be6d-3be5c5267ac6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:23.417542 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9360a1-c0d7-4a1b-9c15-c5ff2a01a60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:23.418085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9360a1-c0d7-4a1b-9c15-c5ff2a01a60d None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:23.418365 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9360a1-c0d7-4a1b-9c15-c5ff2a01a60d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:23.418657 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9360a1-c0d7-4a1b-9c15-c5ff2a01a60d None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:23.419311 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9360a1-c0d7-4a1b-9c15-c5ff2a01a60d None admin] RBAC: Adding query filter params (name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:23.419618 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9360a1-c0d7-4a1b-9c15-c5ff2a01a60d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:23.419864 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7c075-6a6b-42d6-be6d-3be5c5267ac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:23.420995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9360a1-c0d7-4a1b-9c15-c5ff2a01a60d None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:23.421701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7c075-6a6b-42d6-be6d-3be5c5267ac6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:23.429382 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 223/432] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 31 12:20:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:23.429382 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff03eff-ad37-43a0-9c73-2bbeddc86e3a None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:23.429382 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff03eff-ad37-43a0-9c73-2bbeddc86e3a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:23.429382 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff03eff-ad37-43a0-9c73-2bbeddc86e3a None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:23.429382 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 224/433] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:23.429382 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff03eff-ad37-43a0-9c73-2bbeddc86e3a None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:23.443901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-83b7c075-6a6b-42d6-be6d-3be5c5267ac6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:23.443901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:23.443901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:23.443901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:23.443901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:23.443901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:23.443901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:23.443901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:23.443901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:23.443901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:23.443901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:23.443901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:23.443901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:23.443901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:23.443901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:23.443901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:23.444981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:23.444981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:23.444981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:23.444981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:23.444981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:23.444981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:23.444981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:23.444981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:23.444981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:23.444981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:23.444981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:23.444981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:23.444981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:23.444981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:23.444981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:23.444981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:23.444981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:23.446030 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:23.446030 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:23.446030 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:23.452172 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 210/434] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:20:23.452364 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:23.453360 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7c075-6a6b-42d6-be6d-3be5c5267ac6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:23.501465 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:23.540309 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff03eff-ad37-43a0-9c73-2bbeddc86e3a None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:23.564576 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7c075-6a6b-42d6-be6d-3be5c5267ac6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:23.574762 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f70896-a1bd-4d72-8d69-a42e7cdddc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:23.575608 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f70896-a1bd-4d72-8d69-a42e7cdddc9b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:23.575715 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f70896-a1bd-4d72-8d69-a42e7cdddc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:23.575921 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f70896-a1bd-4d72-8d69-a42e7cdddc9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:23.586804 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f70896-a1bd-4d72-8d69-a42e7cdddc9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:23.592805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-b9f70896-a1bd-4d72-8d69-a42e7cdddc9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:23.592805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:23.592805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:23.592805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:23.592805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:23.592805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:23.592805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:23.592805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:23.592805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:23.592805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:23.592805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:23.592805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:23.592805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:23.592805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:23.592805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:23.592805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:23.593882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:23.593882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:23.593882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:23.593882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:23.593882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:23.593882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:23.593882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:23.593882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:23.593882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:23.593882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:23.593882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:23.593882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:23.593882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:23.593882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:23.593882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:23.593882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:23.594694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:23.594694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:23.594694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:23.594694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:23.594694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:23.594694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:23.594694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:23.594694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:23.594694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:23.594694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:23.594694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:23.594694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:23.594694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 225/435] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 31 12:20:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:23.595398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934598e2-b610-4db3-a5bd-ac5268daf7af None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:23.595398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934598e2-b610-4db3-a5bd-ac5268daf7af None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:23.595517 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934598e2-b610-4db3-a5bd-ac5268daf7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:23.607123 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bade7-f2b5-4f5c-8a23-9d237493e205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:23.607763 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bade7-f2b5-4f5c-8a23-9d237493e205 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:23.608044 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bade7-f2b5-4f5c-8a23-9d237493e205 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:23.608311 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bade7-f2b5-4f5c-8a23-9d237493e205 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:23.614069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-934598e2-b610-4db3-a5bd-ac5268daf7af None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:23.615248 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-934598e2-b610-4db3-a5bd-ac5268daf7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:23.620451 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bade7-f2b5-4f5c-8a23-9d237493e205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:23.621913 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573bade7-f2b5-4f5c-8a23-9d237493e205 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:23.636832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-573bade7-f2b5-4f5c-8a23-9d237493e205 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:23.636832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:23.636832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:23.636832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:23.636832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:23.636832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:23.636832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:23.636832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:23.636832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:23.636832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:23.636832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:23.636832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:23.636832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:23.636832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:23.636832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:23.636832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:23.637937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:23.637937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:23.637937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:23.637937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:23.637937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:23.637937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:23.637937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:23.637937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:23.637937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:23.637937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:23.637937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:23.637937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:23.637937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:23.637937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:23.637937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:23.637937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:23.637937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:23.638771 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:23.638771 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:23.638771 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:23.638771 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 211/436] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:23.638771 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bade7-f2b5-4f5c-8a23-9d237493e205 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:23.690965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 226/437] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:23.692156 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934598e2-b610-4db3-a5bd-ac5268daf7af None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:23.694824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:23.757438 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:23.768200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bade7-f2b5-4f5c-8a23-9d237493e205 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:23.806631 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934598e2-b610-4db3-a5bd-ac5268daf7af None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:23.811762 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8313f0-9ddc-4006-bb58-cc4e254333c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:23.812689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8313f0-9ddc-4006-bb58-cc4e254333c1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:23.813197 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8313f0-9ddc-4006-bb58-cc4e254333c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:23.813663 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8313f0-9ddc-4006-bb58-cc4e254333c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:23.815003 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8313f0-9ddc-4006-bb58-cc4e254333c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:23.815524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8313f0-9ddc-4006-bb58-cc4e254333c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:23.818067 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8313f0-9ddc-4006-bb58-cc4e254333c1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:23.834815 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 212/438] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:23.837177 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8313f0-9ddc-4006-bb58-cc4e254333c1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:23.843941 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08e7f3-6244-46f7-a0b9-985985fb548a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:23.844559 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08e7f3-6244-46f7-a0b9-985985fb548a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:23.844840 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08e7f3-6244-46f7-a0b9-985985fb548a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:23.845140 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08e7f3-6244-46f7-a0b9-985985fb548a None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:23.845814 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08e7f3-6244-46f7-a0b9-985985fb548a None admin] RBAC: Adding query filter params (name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:23.846117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08e7f3-6244-46f7-a0b9-985985fb548a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:23.847483 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08e7f3-6244-46f7-a0b9-985985fb548a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:23.861145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 227/439] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 31 12:20:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:23.861145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08e7f3-6244-46f7-a0b9-985985fb548a None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:23.923997 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:23.950415 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8313f0-9ddc-4006-bb58-cc4e254333c1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:23.967271 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08e7f3-6244-46f7-a0b9-985985fb548a None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:23.984488 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3295c93-7604-49a8-a012-e19c59b4cce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:23.985087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3295c93-7604-49a8-a012-e19c59b4cce4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:23.985514 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3295c93-7604-49a8-a012-e19c59b4cce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:23.985643 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3295c93-7604-49a8-a012-e19c59b4cce4 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:23.986277 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3295c93-7604-49a8-a012-e19c59b4cce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:23.986572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3295c93-7604-49a8-a012-e19c59b4cce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:23.987914 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3295c93-7604-49a8-a012-e19c59b4cce4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:23.999032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 213/440] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:24.000274 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d917e94-a023-4033-90fa-ba4e72bd8623 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:24.000472 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d917e94-a023-4033-90fa-ba4e72bd8623 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:24.000747 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d917e94-a023-4033-90fa-ba4e72bd8623 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:24.002073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 214/441] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:24.003555 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609f99a-90a2-44f7-9270-bcb4b97a066b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:24.004308 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f99a-90a2-44f7-9270-bcb4b97a066b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:24.004591 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f99a-90a2-44f7-9270-bcb4b97a066b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:24.004865 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f99a-90a2-44f7-9270-bcb4b97a066b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:24.005979 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d917e94-a023-4033-90fa-ba4e72bd8623 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:24.012180 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609f99a-90a2-44f7-9270-bcb4b97a066b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:24.013638 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609f99a-90a2-44f7-9270-bcb4b97a066b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:24.021227 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:24.025500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-7609f99a-90a2-44f7-9270-bcb4b97a066b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:24.025500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:24.025500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:24.025500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:24.025500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:24.025500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:24.025500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:24.025500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:24.025500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:24.025500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:24.025500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:24.025500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:24.025500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:20:24.025500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:20:24.025500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:20:24.026652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:20:24.026652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:24.026652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:24.026652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:24.026652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:24.026652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:24.026652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:24.026652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:24.026652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:24.026652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:24.026652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:24.026652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:24.026652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:24.026652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:24.026652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:24.026652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:24.026652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:24.027532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:20:24.027532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:20:24.027532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:20:24.027532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:20:24.027532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:20:24.027532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:20:24.027532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:24.027532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:24.027532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 228/442] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:24.027983 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609f99a-90a2-44f7-9270-bcb4b97a066b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:24.112245 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d917e94-a023-4033-90fa-ba4e72bd8623 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:24.129617 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609f99a-90a2-44f7-9270-bcb4b97a066b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:24.144243 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0354d0e-cbb6-438a-9686-e28199868b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:24.144864 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0354d0e-cbb6-438a-9686-e28199868b1b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:24.145164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0354d0e-cbb6-438a-9686-e28199868b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:24.145439 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0354d0e-cbb6-438a-9686-e28199868b1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:24.152982 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:24.156775 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0354d0e-cbb6-438a-9686-e28199868b1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:24.158247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0354d0e-cbb6-438a-9686-e28199868b1b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:24.163842 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503f888-b244-4de2-86d4-4924d0d9389f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:24.164516 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503f888-b244-4de2-86d4-4924d0d9389f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:24.164795 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503f888-b244-4de2-86d4-4924d0d9389f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:24.165063 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503f888-b244-4de2-86d4-4924d0d9389f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:24.172189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-f0354d0e-cbb6-438a-9686-e28199868b1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:24.172189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:24.172189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:24.172189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:24.172189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:24.172189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:24.172189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:24.172189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:24.172189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:24.172189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:24.172189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:24.172189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:24.172189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:24.172189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:24.172189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:24.172189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:24.173150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:24.173150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:24.173150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:24.173150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:24.173150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:24.173150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:24.173150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:24.173150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:24.173150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:24.173150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:24.173150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:24.173150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:24.173150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:24.173150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:24.173150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:24.173150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:24.173150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:24.174168 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:24.174168 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:24.174168 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:24.174168 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 215/443] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:24.174168 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0354d0e-cbb6-438a-9686-e28199868b1b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:24.179482 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503f888-b244-4de2-86d4-4924d0d9389f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:24.184951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-c503f888-b244-4de2-86d4-4924d0d9389f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:24.184951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:24.184951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:24.184951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:24.184951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:24.184951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:24.184951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:24.184951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:24.184951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:24.184951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:24.184951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:24.184951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:24.184951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:24.184951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:24.184951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:24.184951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:24.185886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:24.185886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:24.185886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:24.185886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:24.185886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:24.185886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:24.185886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:24.185886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:24.185886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:24.185886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:24.185886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:24.185886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:24.185886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:24.185886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:24.185886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:24.185886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:24.186678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:24.186678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:24.186678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:24.186678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:24.186678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:24.186678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:24.186678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:24.186678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:24.186678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:24.186678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:24.186678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:24.186678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:24.186678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 229/444] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 31 12:20:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:24.187904 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d52be-aa2e-447c-be85-84a08949add5 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:24.187904 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d52be-aa2e-447c-be85-84a08949add5 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:24.187904 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d52be-aa2e-447c-be85-84a08949add5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:24.205782 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-344d52be-aa2e-447c-be85-84a08949add5 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:24.206958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-344d52be-aa2e-447c-be85-84a08949add5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:24.236131 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:24.274496 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 230/445] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:24.275385 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d52be-aa2e-447c-be85-84a08949add5 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:24.275794 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0354d0e-cbb6-438a-9686-e28199868b1b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:24.314327 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e9aaa-0b2d-4c7a-aa7d-5e99adae5de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:24.314956 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e9aaa-0b2d-4c7a-aa7d-5e99adae5de9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:24.315234 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e9aaa-0b2d-4c7a-aa7d-5e99adae5de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:24.315503 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e9aaa-0b2d-4c7a-aa7d-5e99adae5de9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:24.323587 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e9aaa-0b2d-4c7a-aa7d-5e99adae5de9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:24.325206 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e9aaa-0b2d-4c7a-aa7d-5e99adae5de9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:24.335874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-4f0e9aaa-0b2d-4c7a-aa7d-5e99adae5de9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 12:20:24.335874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:24.335874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:24.335874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:24.335874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:24.335874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:24.335874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:24.335874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:24.335874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:24.335874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:24.335874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:24.335874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:24.335874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:20:24.335874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:20:24.335874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:20:24.335874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:20:24.336840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:24.336840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:24.336840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:20:24.336840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:24.336840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:20:24.336840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:24.336840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:24.336840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:24.336840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:24.336840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:24.336840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:24.336840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:24.336840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:24.336840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:24.336840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:24.336840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:24.336840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:24.336840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:24.337789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:24.337789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:24.337789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:20:24.337789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:20:24.337789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:20:24.337789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:20:24.337789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:20:24.337789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:20:24.337789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 12:20:24.337789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:24.337789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 216/446] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Oct 31 12:20:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:24.337789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e9aaa-0b2d-4c7a-aa7d-5e99adae5de9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:24.396227 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d52be-aa2e-447c-be85-84a08949add5 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:24.410682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:24.431821 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52dbbe-9a53-40ae-9ae9-b3b81f15caca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:24.432420 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52dbbe-9a53-40ae-9ae9-b3b81f15caca None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:24.432693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52dbbe-9a53-40ae-9ae9-b3b81f15caca None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:24.432961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52dbbe-9a53-40ae-9ae9-b3b81f15caca None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:24.433668 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52dbbe-9a53-40ae-9ae9-b3b81f15caca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:24.433974 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52dbbe-9a53-40ae-9ae9-b3b81f15caca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:24.435408 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52dbbe-9a53-40ae-9ae9-b3b81f15caca None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:24.447522 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e9aaa-0b2d-4c7a-aa7d-5e99adae5de9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:24.447974 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 231/447] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:20:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:24.448767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52dbbe-9a53-40ae-9ae9-b3b81f15caca None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:24.479773 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:24.491066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90896586-e482-4e86-b010-93f3c47042c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:24.491743 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90896586-e482-4e86-b010-93f3c47042c9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:24.492087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90896586-e482-4e86-b010-93f3c47042c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:24.492942 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90896586-e482-4e86-b010-93f3c47042c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:24.493679 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90896586-e482-4e86-b010-93f3c47042c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:24.494049 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90896586-e482-4e86-b010-93f3c47042c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:24.495463 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90896586-e482-4e86-b010-93f3c47042c9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:24.507571 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 217/448] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:24.508972 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90896586-e482-4e86-b010-93f3c47042c9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:24.559817 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52dbbe-9a53-40ae-9ae9-b3b81f15caca None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:24.592272 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a7914-2205-4d31-bf3d-a9d59afbcb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:24.592874 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a7914-2205-4d31-bf3d-a9d59afbcb9b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:24.593175 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a7914-2205-4d31-bf3d-a9d59afbcb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:24.593450 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a7914-2205-4d31-bf3d-a9d59afbcb9b None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:24.594106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a7914-2205-4d31-bf3d-a9d59afbcb9b None admin] RBAC: Adding query filter params (name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:24.594405 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a7914-2205-4d31-bf3d-a9d59afbcb9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:24.595749 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a7914-2205-4d31-bf3d-a9d59afbcb9b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:24.603697 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 232/449] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 31 12:20:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:24.604476 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a7914-2205-4d31-bf3d-a9d59afbcb9b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:24.607403 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90896586-e482-4e86-b010-93f3c47042c9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:24.641164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b99b8-a63a-468a-bbbb-492a4fb5f90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:24.641771 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b99b8-a63a-468a-bbbb-492a4fb5f90a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:24.641915 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:24.642051 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b99b8-a63a-468a-bbbb-492a4fb5f90a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:24.642325 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b99b8-a63a-468a-bbbb-492a4fb5f90a None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:24.643044 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b99b8-a63a-468a-bbbb-492a4fb5f90a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:24.643373 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b99b8-a63a-468a-bbbb-492a4fb5f90a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:24.644789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b99b8-a63a-468a-bbbb-492a4fb5f90a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:24.661597 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 218/450] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Oct 31 12:20:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:24.662433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b99b8-a63a-468a-bbbb-492a4fb5f90a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:24.703697 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:24.705279 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a7914-2205-4d31-bf3d-a9d59afbcb9b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:24.738719 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb1403-1686-4e71-923e-ebc904c74614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:24.739300 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb1403-1686-4e71-923e-ebc904c74614 None admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:24.739577 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb1403-1686-4e71-923e-ebc904c74614 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:24.739847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb1403-1686-4e71-923e-ebc904c74614 None admin] PATH_INFO: `/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/188c4989dcfb4f99a04c3349e1a882d1/roles/df935cf8a7f24352ba94fe83718280ea` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:24.754813 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb1403-1686-4e71-923e-ebc904c74614 None admin] RBAC: Authorizing `identity:create_grant(project_id=786ee416a639447ab3698d1f56d04e9a, user_id=188c4989dcfb4f99a04c3349e1a882d1, role_id=df935cf8a7f24352ba94fe83718280ea)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:24.756251 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb1403-1686-4e71-923e-ebc904c74614 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:24.759896 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b99b8-a63a-468a-bbbb-492a4fb5f90a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:24.768580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 233/451] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:20:24 2022] PUT /identity/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/188c4989dcfb4f99a04c3349e1a882d1/roles/df935cf8a7f24352ba94fe83718280ea => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:20:24.769393 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb1403-1686-4e71-923e-ebc904c74614 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:24.798703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f92c5-9c6a-4f2a-8192-09d296c04ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:24.799353 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f92c5-9c6a-4f2a-8192-09d296c04ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:24.799633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f92c5-9c6a-4f2a-8192-09d296c04ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:24.799900 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f92c5-9c6a-4f2a-8192-09d296c04ac5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:24.809162 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f92c5-9c6a-4f2a-8192-09d296c04ac5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:24.810642 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f92c5-9c6a-4f2a-8192-09d296c04ac5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:24.823970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-9a9f92c5-9c6a-4f2a-8192-09d296c04ac5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 31 12:20:24.823970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:24.823970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:24.823970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:24.823970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:24.823970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:24.823970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:24.823970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:24.823970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:24.823970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:24.823970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:24.823970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:24.823970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:20:24.823970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:20:24.823970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:20:24.823970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:20:24.824960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:24.824960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:24.824960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:20:24.824960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:24.824960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:20:24.824960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:24.824960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:24.824960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:24.824960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:24.824960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:24.824960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:24.824960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:24.824960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:24.824960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:24.824960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:24.824960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:24.824960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:24.824960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:24.825937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:24.825937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:24.825937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:20:24.825937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:20:24.825937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:20:24.825937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:20:24.825937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:20:24.825937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:20:24.825937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 31 12:20:24.825937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:24.825937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 219/452] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:20:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:24.826490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f92c5-9c6a-4f2a-8192-09d296c04ac5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:24.869900 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:24.886399 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb1403-1686-4e71-923e-ebc904c74614 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:24.923049 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4d0e2-ecfb-40ef-9a87-9e23cda30959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:24.923785 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4d0e2-ecfb-40ef-9a87-9e23cda30959 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:24.924134 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4d0e2-ecfb-40ef-9a87-9e23cda30959 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:24.924480 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4d0e2-ecfb-40ef-9a87-9e23cda30959 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:24.936742 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4d0e2-ecfb-40ef-9a87-9e23cda30959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:24.941674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-ace4d0e2-ecfb-40ef-9a87-9e23cda30959 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:24.941674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:24.941674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:24.941674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:24.941674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:24.941674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:24.941674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:24.941674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:24.941674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:24.941674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:24.941674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:24.941674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:24.941674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:24.941674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:24.941674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:24.941674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:24.942714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:24.942714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:24.942714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:24.942714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:24.942714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:24.942714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:24.942714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:24.942714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:24.942714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:24.942714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:24.942714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:24.942714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:24.942714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:24.942714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:24.942714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:24.942714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:24.943698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:24.943698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:24.943698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:24.943698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:24.943698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:24.943698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:24.943698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:24.943698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:24.943698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:24.943698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:24.943698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:24.943698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:24.943698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 234/453] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 31 12:20:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:24.944769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4d0e2-ecfb-40ef-9a87-9e23cda30959 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:24.947157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f92c5-9c6a-4f2a-8192-09d296c04ac5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:24.948783 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:24.990102 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf0fd2-c39a-4d54-83a0-ae9d9a18880c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:24.990737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf0fd2-c39a-4d54-83a0-ae9d9a18880c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:24.990926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf0fd2-c39a-4d54-83a0-ae9d9a18880c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:24.991197 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf0fd2-c39a-4d54-83a0-ae9d9a18880c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:25.002580 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf0fd2-c39a-4d54-83a0-ae9d9a18880c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:25.004027 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf0fd2-c39a-4d54-83a0-ae9d9a18880c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:25.018409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-dacf0fd2-c39a-4d54-83a0-ae9d9a18880c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:25.018409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:25.018409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:25.018409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:25.018409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:25.018409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:25.018409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:25.018409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:25.018409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:25.018409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:25.018409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:25.018409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:25.018409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:25.018409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:25.018409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:25.018409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:25.019550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:25.019550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:25.019550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:25.019550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:25.019550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:25.019550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:25.019550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:25.019550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:25.019550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:25.019550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:25.019550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:25.019550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:25.019550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:25.019550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:25.019550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:25.019550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:25.019550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:25.020627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:25.020627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:25.020627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:25.021299 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 220/454] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:25.022126 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf0fd2-c39a-4d54-83a0-ae9d9a18880c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:25.067254 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4d0e2-ecfb-40ef-9a87-9e23cda30959 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:25.105833 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3024eb-4b26-470a-886a-984faedfd70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:25.106437 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3024eb-4b26-470a-886a-984faedfd70d None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:25.106718 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3024eb-4b26-470a-886a-984faedfd70d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:25.107012 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3024eb-4b26-470a-886a-984faedfd70d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:25.123616 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:25.136667 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf0fd2-c39a-4d54-83a0-ae9d9a18880c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:25.176745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105929e-fa60-4947-9370-09ceab39cb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:25.177396 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105929e-fa60-4947-9370-09ceab39cb2b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:25.177704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105929e-fa60-4947-9370-09ceab39cb2b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:25.177950 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105929e-fa60-4947-9370-09ceab39cb2b None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:25.178940 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105929e-fa60-4947-9370-09ceab39cb2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:25.179043 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105929e-fa60-4947-9370-09ceab39cb2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:25.180413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105929e-fa60-4947-9370-09ceab39cb2b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:25.181369 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3024eb-4b26-470a-886a-984faedfd70d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:25.183466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3024eb-4b26-470a-886a-984faedfd70d None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:25.202651 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 221/455] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Oct 31 12:20:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:25.202651 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105929e-fa60-4947-9370-09ceab39cb2b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:25.217573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:25.292817 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 235/456] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:20:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 12:20:25.293605 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3024eb-4b26-470a-886a-984faedfd70d None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:25.314801 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105929e-fa60-4947-9370-09ceab39cb2b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:25.339344 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:25.352536 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b372687-c633-4e59-bf83-190f37722ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:25.353167 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b372687-c633-4e59-bf83-190f37722ffd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:25.353606 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b372687-c633-4e59-bf83-190f37722ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:25.353731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b372687-c633-4e59-bf83-190f37722ffd None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:25.354378 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b372687-c633-4e59-bf83-190f37722ffd None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:25.354685 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b372687-c633-4e59-bf83-190f37722ffd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:25.356044 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b372687-c633-4e59-bf83-190f37722ffd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:25.369013 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 222/457] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 31 12:20:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:25.369013 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b372687-c633-4e59-bf83-190f37722ffd None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:25.400648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3024eb-4b26-470a-886a-984faedfd70d None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:25.436498 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c248f18-5004-4b41-8ffa-d6c6b9dd9b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:25.437125 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c248f18-5004-4b41-8ffa-d6c6b9dd9b1c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:25.437427 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c248f18-5004-4b41-8ffa-d6c6b9dd9b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:25.437699 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c248f18-5004-4b41-8ffa-d6c6b9dd9b1c None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:25.438342 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c248f18-5004-4b41-8ffa-d6c6b9dd9b1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:25.438645 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c248f18-5004-4b41-8ffa-d6c6b9dd9b1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:25.439993 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c248f18-5004-4b41-8ffa-d6c6b9dd9b1c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:25.445994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:25.452253 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 236/458] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:25.453147 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c248f18-5004-4b41-8ffa-d6c6b9dd9b1c None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:25.481653 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b372687-c633-4e59-bf83-190f37722ffd None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:25.515186 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a50357-8f3b-4795-b3e2-6ce18472cbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:25.515806 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a50357-8f3b-4795-b3e2-6ce18472cbeb None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:25.516083 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a50357-8f3b-4795-b3e2-6ce18472cbeb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:25.516356 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a50357-8f3b-4795-b3e2-6ce18472cbeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:25.563201 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c248f18-5004-4b41-8ffa-d6c6b9dd9b1c None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:25.571422 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:25.588949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a50357-8f3b-4795-b3e2-6ce18472cbeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:25.590430 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a50357-8f3b-4795-b3e2-6ce18472cbeb None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:25.605586 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcd3cb-45f4-4722-a5c1-826838030799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:25.606209 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcd3cb-45f4-4722-a5c1-826838030799 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:25.606484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcd3cb-45f4-4722-a5c1-826838030799 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:25.606756 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcd3cb-45f4-4722-a5c1-826838030799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:25.617290 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcd3cb-45f4-4722-a5c1-826838030799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:25.618707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcd3cb-45f4-4722-a5c1-826838030799 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:25.632655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-68fcd3cb-45f4-4722-a5c1-826838030799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:25.632655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:25.632655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:25.632655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:25.632655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:25.632655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:25.632655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:25.632655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:25.632655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:25.632655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:25.632655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:25.632655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:25.632655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:25.632655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:25.632655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:25.632655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:25.634107 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:25.634107 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:25.634107 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:25.634107 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:25.634107 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:25.634107 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:25.634107 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:25.634107 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:25.634107 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:25.634107 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:25.634107 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:25.634107 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:25.634107 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:25.634107 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:25.634107 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:25.634107 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:25.634107 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:25.634980 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:25.634980 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:25.634980 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:25.634980 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 237/459] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:25.635196 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcd3cb-45f4-4722-a5c1-826838030799 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:25.673378 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:25.702489 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 223/460] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:20:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 12:20:25.703726 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a50357-8f3b-4795-b3e2-6ce18472cbeb None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:25.743133 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcd3cb-45f4-4722-a5c1-826838030799 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:25.779150 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e8a50-8f7b-4ed4-82e4-4d0c13c8132d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:25.780069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e8a50-8f7b-4ed4-82e4-4d0c13c8132d None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:25.780557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e8a50-8f7b-4ed4-82e4-4d0c13c8132d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:25.781065 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e8a50-8f7b-4ed4-82e4-4d0c13c8132d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:25.791585 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e8a50-8f7b-4ed4-82e4-4d0c13c8132d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:25.793259 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e8a50-8f7b-4ed4-82e4-4d0c13c8132d None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:25.808022 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-439e8a50-8f7b-4ed4-82e4-4d0c13c8132d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:25.808022 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:25.808022 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:25.808022 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:25.808022 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:25.808022 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:25.808022 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:25.808022 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:25.808022 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:25.808022 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:25.808022 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:25.808022 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:25.808022 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:25.808022 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:25.808022 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:25.808022 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:25.809077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:25.809077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:25.809077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:25.809077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:25.809077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:25.809077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:25.809077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:25.809077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:25.809077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:25.809077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:25.809077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:25.809077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:25.809077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:25.809077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:25.809077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:25.809077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:25.809077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:25.810094 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:25.810094 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:25.810094 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:25.811444 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 238/461] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:25.812129 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a50357-8f3b-4795-b3e2-6ce18472cbeb None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:25.812520 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e8a50-8f7b-4ed4-82e4-4d0c13c8132d None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:25.829256 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:25.851917 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddb6b2-e9e9-42fb-986a-950127de25ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:25.852647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddb6b2-e9e9-42fb-986a-950127de25ad None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:25.852925 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddb6b2-e9e9-42fb-986a-950127de25ad None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:25.853938 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddb6b2-e9e9-42fb-986a-950127de25ad None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:25.860628 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddb6b2-e9e9-42fb-986a-950127de25ad None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:25.862174 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddb6b2-e9e9-42fb-986a-950127de25ad None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:25.874552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-6cddb6b2-e9e9-42fb-986a-950127de25ad None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 12:20:25.874552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:25.874552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:25.874552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:25.874552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:25.874552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:25.874552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:25.874552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:25.874552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:25.874552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:25.874552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:25.874552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:25.874552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:20:25.874552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:20:25.874552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:20:25.874552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:20:25.875627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:25.875627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:25.875627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:20:25.875627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:25.875627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:20:25.875627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:25.875627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:25.875627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:25.875627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:25.875627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:25.875627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:25.875627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:25.875627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:25.875627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:25.875627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:25.875627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:25.875627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:25.875627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:25.876555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:25.876555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:25.876555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:20:25.876555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:20:25.876555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:20:25.876555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:20:25.876555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:20:25.876555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:20:25.876555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 12:20:25.876555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:25.876555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 224/462] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:20:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:25.877152 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddb6b2-e9e9-42fb-986a-950127de25ad None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:25.912297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:25.928091 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e8a50-8f7b-4ed4-82e4-4d0c13c8132d None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:25.969784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a91a8-a60e-43f4-83cc-31fc366355a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:25.970394 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a91a8-a60e-43f4-83cc-31fc366355a4 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:25.970680 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a91a8-a60e-43f4-83cc-31fc366355a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:25.970952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a91a8-a60e-43f4-83cc-31fc366355a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:25.971593 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a91a8-a60e-43f4-83cc-31fc366355a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:25.971884 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a91a8-a60e-43f4-83cc-31fc366355a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:25.973321 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a91a8-a60e-43f4-83cc-31fc366355a4 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:25.980906 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddb6b2-e9e9-42fb-986a-950127de25ad None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:25.989485 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 239/463] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:25.989485 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a91a8-a60e-43f4-83cc-31fc366355a4 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:26.018569 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7d32c-84ed-47e1-bc87-24de3311d5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:26.019242 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7d32c-84ed-47e1-bc87-24de3311d5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:26.019526 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7d32c-84ed-47e1-bc87-24de3311d5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:26.019800 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7d32c-84ed-47e1-bc87-24de3311d5b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:26.032794 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7d32c-84ed-47e1-bc87-24de3311d5b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:26.034928 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7d32c-84ed-47e1-bc87-24de3311d5b5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:26.049364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-ccd7d32c-84ed-47e1-bc87-24de3311d5b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:26.049364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:26.049364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:26.049364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:26.049364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:26.049364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:26.049364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:26.049364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:26.049364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:26.049364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:26.049364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:26.049364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:26.049364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:26.049364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:26.049364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:26.049364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:26.050320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:26.050320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:26.050320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:26.050320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:26.050320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:26.050320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:26.050320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:26.050320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:26.050320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:26.050320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:26.050320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:26.050320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:26.050320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:26.050320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:26.050320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:26.050320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:26.050320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:26.052163 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:26.052163 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:26.052163 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:26.052163 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 225/464] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:26.054210 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7d32c-84ed-47e1-bc87-24de3311d5b5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:26.062804 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:26.096189 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a91a8-a60e-43f4-83cc-31fc366355a4 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:26.131267 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df2eda-8dda-46f6-a57f-7cf06585135b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:26.132189 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df2eda-8dda-46f6-a57f-7cf06585135b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:26.132189 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df2eda-8dda-46f6-a57f-7cf06585135b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:26.132445 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df2eda-8dda-46f6-a57f-7cf06585135b None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:26.133692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df2eda-8dda-46f6-a57f-7cf06585135b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:26.133996 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df2eda-8dda-46f6-a57f-7cf06585135b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:26.135368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df2eda-8dda-46f6-a57f-7cf06585135b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:26.150732 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 240/465] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:26.150732 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df2eda-8dda-46f6-a57f-7cf06585135b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:26.154879 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:26.172603 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7d32c-84ed-47e1-bc87-24de3311d5b5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:26.208011 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2085c-b8d6-402e-9d64-b5b2b293c049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:26.208618 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2085c-b8d6-402e-9d64-b5b2b293c049 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:26.208899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2085c-b8d6-402e-9d64-b5b2b293c049 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:26.209203 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2085c-b8d6-402e-9d64-b5b2b293c049 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:26.209941 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2085c-b8d6-402e-9d64-b5b2b293c049 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:26.210247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2085c-b8d6-402e-9d64-b5b2b293c049 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:26.211755 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2085c-b8d6-402e-9d64-b5b2b293c049 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:26.233392 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 226/466] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Oct 31 12:20:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:26.233392 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2085c-b8d6-402e-9d64-b5b2b293c049 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:26.256699 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df2eda-8dda-46f6-a57f-7cf06585135b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:26.284000 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:26.292422 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8a6d3-83e0-4a68-9f58-96445e564379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:26.293039 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8a6d3-83e0-4a68-9f58-96445e564379 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:26.293343 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8a6d3-83e0-4a68-9f58-96445e564379 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:26.293616 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8a6d3-83e0-4a68-9f58-96445e564379 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:26.300366 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8a6d3-83e0-4a68-9f58-96445e564379 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:26.301829 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8a6d3-83e0-4a68-9f58-96445e564379 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:26.313424 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-80f8a6d3-83e0-4a68-9f58-96445e564379 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:26.313424 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:26.313424 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:26.313424 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:26.313424 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:26.313424 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:26.313424 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:26.313424 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:26.313424 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:26.313424 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:26.313424 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:26.313424 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:26.313424 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:20:26.313424 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:20:26.313424 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:20:26.314270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:20:26.314270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:26.314270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:26.314270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:26.314270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:26.314270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:26.314270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:26.314270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:26.314270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:26.314270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:26.314270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:26.314270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:26.314270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:26.314270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:26.314270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:26.314270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:26.314270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:26.315120 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:20:26.315120 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:20:26.315120 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:20:26.315120 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:20:26.315120 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:20:26.315120 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:20:26.315120 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:26.315120 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:26.315120 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 241/467] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:26.315583 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8a6d3-83e0-4a68-9f58-96445e564379 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:26.341601 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2085c-b8d6-402e-9d64-b5b2b293c049 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:26.380262 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee98b9c-5531-4102-b2fa-3630a9baeab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:26.380790 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee98b9c-5531-4102-b2fa-3630a9baeab0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:26.381067 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee98b9c-5531-4102-b2fa-3630a9baeab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:26.381370 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee98b9c-5531-4102-b2fa-3630a9baeab0 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:26.382037 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee98b9c-5531-4102-b2fa-3630a9baeab0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:26.382334 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee98b9c-5531-4102-b2fa-3630a9baeab0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:26.383717 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee98b9c-5531-4102-b2fa-3630a9baeab0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:26.396333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 227/468] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:26.398627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee98b9c-5531-4102-b2fa-3630a9baeab0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:26.403012 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:26.419137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8a6d3-83e0-4a68-9f58-96445e564379 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:26.454434 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fced0-14f8-4713-94c9-bfd1242e0cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:26.455064 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fced0-14f8-4713-94c9-bfd1242e0cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:26.455348 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fced0-14f8-4713-94c9-bfd1242e0cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:26.455624 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fced0-14f8-4713-94c9-bfd1242e0cb8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:26.463319 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fced0-14f8-4713-94c9-bfd1242e0cb8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:26.464773 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fced0-14f8-4713-94c9-bfd1242e0cb8 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:26.475845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-652fced0-14f8-4713-94c9-bfd1242e0cb8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 31 12:20:26.475845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:26.475845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:26.475845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:26.475845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:26.475845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:26.475845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:26.475845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:26.475845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:26.475845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:26.475845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:26.475845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:26.475845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:20:26.475845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:20:26.475845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:20:26.475845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:20:26.482167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:26.482167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:26.482167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:20:26.482167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:26.482167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:20:26.482167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:26.482167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:26.482167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:26.482167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:26.482167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:26.482167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:26.482167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:26.482167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:26.482167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:26.482167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:26.482167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:26.482167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:26.482167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:26.483103 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:26.483103 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:26.483103 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:20:26.483103 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:20:26.483103 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:20:26.483103 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:20:26.483103 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:20:26.483103 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:20:26.483103 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 31 12:20:26.483103 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:26.483103 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 242/469] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 31 12:20:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:26.483103 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fced0-14f8-4713-94c9-bfd1242e0cb8 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:26.511595 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee98b9c-5531-4102-b2fa-3630a9baeab0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:26.538813 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:26.549582 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919dc88-12f3-4ccf-ab58-3c66ab39aaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:26.550204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919dc88-12f3-4ccf-ab58-3c66ab39aaed None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:26.550470 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919dc88-12f3-4ccf-ab58-3c66ab39aaed None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:26.550740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919dc88-12f3-4ccf-ab58-3c66ab39aaed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:26.597097 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fced0-14f8-4713-94c9-bfd1242e0cb8 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:26.621624 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919dc88-12f3-4ccf-ab58-3c66ab39aaed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:26.623061 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919dc88-12f3-4ccf-ab58-3c66ab39aaed None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:26.625738 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:26.637616 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567be93-0e54-45a6-b38c-74633e995691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:26.638173 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567be93-0e54-45a6-b38c-74633e995691 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:26.638453 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567be93-0e54-45a6-b38c-74633e995691 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:26.638720 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567be93-0e54-45a6-b38c-74633e995691 None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:26.639401 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567be93-0e54-45a6-b38c-74633e995691 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:26.639701 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567be93-0e54-45a6-b38c-74633e995691 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:26.641134 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567be93-0e54-45a6-b38c-74633e995691 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:26.653778 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 243/470] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:20:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:26.654565 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567be93-0e54-45a6-b38c-74633e995691 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:26.741355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 228/471] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:20:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 12:20:26.742913 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919dc88-12f3-4ccf-ab58-3c66ab39aaed None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:26.758232 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567be93-0e54-45a6-b38c-74633e995691 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:26.768970 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:26.793623 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de2562-69bf-4146-a3db-766faa260b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:26.794334 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de2562-69bf-4146-a3db-766faa260b1b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:26.794676 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de2562-69bf-4146-a3db-766faa260b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:26.795014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de2562-69bf-4146-a3db-766faa260b1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:26.802141 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de2562-69bf-4146-a3db-766faa260b1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:26.804052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de2562-69bf-4146-a3db-766faa260b1b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:26.815392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-60de2562-69bf-4146-a3db-766faa260b1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:26.815392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:26.815392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:26.815392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:26.815392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:26.815392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:26.815392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:26.815392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:26.815392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:26.815392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:26.815392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:26.815392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:26.815392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:20:26.815392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:20:26.815392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:20:26.816331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:20:26.816331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:26.816331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:26.816331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:26.816331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:26.816331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:26.816331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:26.816331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:26.816331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:26.816331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:26.816331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:26.816331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:26.816331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:26.816331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:26.816331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:26.816331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:26.816331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:26.817217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:20:26.817217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:20:26.817217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:20:26.817217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:20:26.817217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:20:26.817217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:20:26.817217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:26.817217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:26.821556 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 244/472] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:26.822551 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de2562-69bf-4146-a3db-766faa260b1b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:26.857874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919dc88-12f3-4ccf-ab58-3c66ab39aaed None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:26.860336 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:26.896859 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc978a93-1708-4fb0-bfee-c54f79762a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:26.897426 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc978a93-1708-4fb0-bfee-c54f79762a52 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:26.897713 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc978a93-1708-4fb0-bfee-c54f79762a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:26.897987 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc978a93-1708-4fb0-bfee-c54f79762a52 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:26.899203 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc978a93-1708-4fb0-bfee-c54f79762a52 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:26.899507 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc978a93-1708-4fb0-bfee-c54f79762a52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:26.901572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc978a93-1708-4fb0-bfee-c54f79762a52 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:26.923348 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 229/473] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Oct 31 12:20:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:26.923348 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc978a93-1708-4fb0-bfee-c54f79762a52 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:26.934002 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de2562-69bf-4146-a3db-766faa260b1b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:26.968066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a993f6-cc46-4d5f-8401-1438873be5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:26.968678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a993f6-cc46-4d5f-8401-1438873be5fc None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:26.968956 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a993f6-cc46-4d5f-8401-1438873be5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:26.969256 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a993f6-cc46-4d5f-8401-1438873be5fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:26.969974 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a993f6-cc46-4d5f-8401-1438873be5fc None admin] RBAC: Adding query filter params (role.id=df935cf8a7f24352ba94fe83718280ea, scope.project.id=786ee416a639447ab3698d1f56d04e9a, user.id=d93ce5759e0648a1934ff4d9c9d8fe61) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:26.970280 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a993f6-cc46-4d5f-8401-1438873be5fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:26.971737 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a993f6-cc46-4d5f-8401-1438873be5fc None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:26.977319 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 245/474] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:20:26 2022] GET /identity/v3/role_assignments?user.id=d93ce5759e0648a1934ff4d9c9d8fe61&scope.project.id=786ee416a639447ab3698d1f56d04e9a&role.id=df935cf8a7f24352ba94fe83718280ea => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:26.978085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a993f6-cc46-4d5f-8401-1438873be5fc None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:27.017081 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:27.040569 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc978a93-1708-4fb0-bfee-c54f79762a52 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:27.088924 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57a8d4-a716-480d-af04-2c975a4b9cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:27.089636 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57a8d4-a716-480d-af04-2c975a4b9cad None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:27.089889 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57a8d4-a716-480d-af04-2c975a4b9cad None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:27.090159 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57a8d4-a716-480d-af04-2c975a4b9cad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:27.094259 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a993f6-cc46-4d5f-8401-1438873be5fc None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:27.103273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57a8d4-a716-480d-af04-2c975a4b9cad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:27.104925 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57a8d4-a716-480d-af04-2c975a4b9cad None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:27.121384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-3f57a8d4-a716-480d-af04-2c975a4b9cad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:27.121384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:27.121384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:27.121384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:27.121384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:27.121384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:27.121384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:27.121384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:27.121384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:27.121384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:27.121384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:27.121384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:27.121384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:27.121384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:27.121384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:27.121384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:27.122547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:27.122547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:27.122547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:27.122547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:27.122547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:27.122547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:27.122547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:27.122547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:27.122547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:27.122547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:27.122547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:27.122547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:27.122547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:27.122547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:27.122547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:27.122547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:27.122547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:27.123602 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:27.123602 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:27.123602 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:27.124227 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 230/475] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:27.124227 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57a8d4-a716-480d-af04-2c975a4b9cad None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:27.140537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b226279-1493-43a4-906a-e1068fa962c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:27.141361 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b226279-1493-43a4-906a-e1068fa962c4 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:27.141646 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b226279-1493-43a4-906a-e1068fa962c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:27.141918 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b226279-1493-43a4-906a-e1068fa962c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:27.142352 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:27.143227 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b226279-1493-43a4-906a-e1068fa962c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:27.143357 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b226279-1493-43a4-906a-e1068fa962c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:27.145553 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b226279-1493-43a4-906a-e1068fa962c4 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:27.161212 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 246/476] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:20:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:27.163047 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc58b39-f249-47e6-a4fd-dd9e72985d41 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:27.163047 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc58b39-f249-47e6-a4fd-dd9e72985d41 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:27.163047 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc58b39-f249-47e6-a4fd-dd9e72985d41 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:27.164103 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 247/477] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:27.164920 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc58b39-f249-47e6-a4fd-dd9e72985d41 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:27.236829 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57a8d4-a716-480d-af04-2c975a4b9cad None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:27.268912 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:27.271354 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9575e8f-fc81-4cb4-91f0-e96b2b08eb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:27.272209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9575e8f-fc81-4cb4-91f0-e96b2b08eb61 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:27.272489 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9575e8f-fc81-4cb4-91f0-e96b2b08eb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:27.272762 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9575e8f-fc81-4cb4-91f0-e96b2b08eb61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:27.277528 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc58b39-f249-47e6-a4fd-dd9e72985d41 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:27.312752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa47016-77e9-4eed-81ee-75fff526ae6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:27.313400 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa47016-77e9-4eed-81ee-75fff526ae6b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:27.313676 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa47016-77e9-4eed-81ee-75fff526ae6b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:27.313948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa47016-77e9-4eed-81ee-75fff526ae6b None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:27.314588 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa47016-77e9-4eed-81ee-75fff526ae6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:27.314889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa47016-77e9-4eed-81ee-75fff526ae6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:27.316314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa47016-77e9-4eed-81ee-75fff526ae6b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:27.329162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 248/478] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:27.329950 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa47016-77e9-4eed-81ee-75fff526ae6b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:27.351222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9575e8f-fc81-4cb4-91f0-e96b2b08eb61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:27.352748 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9575e8f-fc81-4cb4-91f0-e96b2b08eb61 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:27.368035 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:27.434455 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa47016-77e9-4eed-81ee-75fff526ae6b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:27.458228 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 231/479] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:20:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 12:20:27.460293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74973b-ce97-4308-b64f-edb1788d6133 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:27.460680 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74973b-ce97-4308-b64f-edb1788d6133 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:27.461086 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74973b-ce97-4308-b64f-edb1788d6133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:27.471238 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae637c5-4ff4-41cb-afa0-a33679f62044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:27.472047 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae637c5-4ff4-41cb-afa0-a33679f62044 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:27.472494 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae637c5-4ff4-41cb-afa0-a33679f62044 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:27.472909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae637c5-4ff4-41cb-afa0-a33679f62044 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:27.473809 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae637c5-4ff4-41cb-afa0-a33679f62044 None admin] RBAC: Adding query filter params (role.id=df935cf8a7f24352ba94fe83718280ea, scope.project.id=786ee416a639447ab3698d1f56d04e9a, user.id=d4c6b6b1cdc649dda3a9caa8d9713569) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:27.474116 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae637c5-4ff4-41cb-afa0-a33679f62044 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:27.475549 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae637c5-4ff4-41cb-afa0-a33679f62044 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:27.479754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8b74973b-ce97-4308-b64f-edb1788d6133 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:27.480951 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8b74973b-ce97-4308-b64f-edb1788d6133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:27.482962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 249/480] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:20:27 2022] GET /identity/v3/role_assignments?user.id=d4c6b6b1cdc649dda3a9caa8d9713569&scope.project.id=786ee416a639447ab3698d1f56d04e9a&role.id=df935cf8a7f24352ba94fe83718280ea => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:27.482962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae637c5-4ff4-41cb-afa0-a33679f62044 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:27.513154 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:27.578317 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 232/481] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:27.579318 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74973b-ce97-4308-b64f-edb1788d6133 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:27.667319 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:27.667508 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae637c5-4ff4-41cb-afa0-a33679f62044 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:27.709216 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a78c2-6811-4bf8-8117-4c202c03e912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:27.709768 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a78c2-6811-4bf8-8117-4c202c03e912 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:27.710044 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a78c2-6811-4bf8-8117-4c202c03e912 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:27.710379 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a78c2-6811-4bf8-8117-4c202c03e912 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:27.717890 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a78c2-6811-4bf8-8117-4c202c03e912 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:27.719373 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a78c2-6811-4bf8-8117-4c202c03e912 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:27.731028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74973b-ce97-4308-b64f-edb1788d6133 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:27.734948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-f05a78c2-6811-4bf8-8117-4c202c03e912 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:27.734948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:27.734948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:27.734948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:27.734948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:27.734948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:27.734948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:27.734948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:27.734948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:27.734948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:27.734948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:27.734948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:27.734948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:20:27.734948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:20:27.734948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:20:27.735947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:20:27.735947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:27.735947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:27.735947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:27.735947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:27.735947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:27.735947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:27.735947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:27.735947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:27.735947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:27.735947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:27.735947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:27.735947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:27.735947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:27.735947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:27.735947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:27.735947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:27.736978 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:20:27.736978 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:20:27.736978 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:20:27.736978 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:20:27.736978 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:20:27.736978 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:20:27.736978 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:27.736978 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:27.739466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 250/482] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:27.742828 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a78c2-6811-4bf8-8117-4c202c03e912 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:27.780566 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1b037-472e-4e9d-91d4-223a1d3607d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:27.781454 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1b037-472e-4e9d-91d4-223a1d3607d4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:27.781733 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1b037-472e-4e9d-91d4-223a1d3607d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:27.782002 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1b037-472e-4e9d-91d4-223a1d3607d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:27.795049 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1b037-472e-4e9d-91d4-223a1d3607d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:27.796673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1b037-472e-4e9d-91d4-223a1d3607d4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:27.815028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-c3d1b037-472e-4e9d-91d4-223a1d3607d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:27.815028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:27.815028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:27.815028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:27.815028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:27.815028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:27.815028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:27.815028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:27.815028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:27.815028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:27.815028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:27.815028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:27.815028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:27.815028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:27.815028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:27.815028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:27.816140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:27.816140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:27.816140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:27.816140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:27.816140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:27.816140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:27.816140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:27.816140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:27.816140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:27.816140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:27.816140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:27.816140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:27.816140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:27.816140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:27.816140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:27.816140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:27.816140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:27.817303 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:27.817303 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:27.817303 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:27.817303 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 233/483] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:27.823975 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1b037-472e-4e9d-91d4-223a1d3607d4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:27.845895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:27.872305 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a78c2-6811-4bf8-8117-4c202c03e912 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:27.912589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4defe9f7-4814-4861-b545-e264efaa8e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:27.913538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defe9f7-4814-4861-b545-e264efaa8e78 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:27.914623 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defe9f7-4814-4861-b545-e264efaa8e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:27.915047 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defe9f7-4814-4861-b545-e264efaa8e78 None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:27.915903 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4defe9f7-4814-4861-b545-e264efaa8e78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:27.916379 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4defe9f7-4814-4861-b545-e264efaa8e78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:27.918147 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4defe9f7-4814-4861-b545-e264efaa8e78 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:27.933059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 251/484] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:20:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:27.934213 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4defe9f7-4814-4861-b545-e264efaa8e78 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:27.948842 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:27.956621 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1b037-472e-4e9d-91d4-223a1d3607d4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:27.999190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f76ad-f4b9-4112-b51f-2b0dbc6686e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:27.999976 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f76ad-f4b9-4112-b51f-2b0dbc6686e1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:28.000262 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f76ad-f4b9-4112-b51f-2b0dbc6686e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:28.000931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f76ad-f4b9-4112-b51f-2b0dbc6686e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:28.001619 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f76ad-f4b9-4112-b51f-2b0dbc6686e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:28.001926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f76ad-f4b9-4112-b51f-2b0dbc6686e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:28.003289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f76ad-f4b9-4112-b51f-2b0dbc6686e1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:28.017970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 234/485] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:28.019060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f76ad-f4b9-4112-b51f-2b0dbc6686e1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:28.058423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4defe9f7-4814-4861-b545-e264efaa8e78 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:28.098688 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c890513-f0d1-4ddb-bb7c-9c56f91d8db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:28.099484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c890513-f0d1-4ddb-bb7c-9c56f91d8db5 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:28.099749 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c890513-f0d1-4ddb-bb7c-9c56f91d8db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:28.100089 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c890513-f0d1-4ddb-bb7c-9c56f91d8db5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:28.107987 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:28.112078 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c890513-f0d1-4ddb-bb7c-9c56f91d8db5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:28.117673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-0c890513-f0d1-4ddb-bb7c-9c56f91d8db5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:28.117673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:28.117673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:28.117673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:28.117673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:28.117673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:28.117673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:28.117673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:28.117673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:28.117673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:28.117673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:28.117673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:28.117673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:28.117673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:28.117673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:28.117673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:28.118852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:28.118852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:28.118852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:28.118852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:28.118852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:28.118852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:28.118852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:28.118852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:28.118852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:28.118852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:28.118852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:28.118852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:28.118852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:28.118852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:28.118852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:28.118852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:28.119823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:28.119823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:28.119823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:28.119823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:28.119823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:28.119823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:28.119823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:28.119823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:28.119823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:28.119823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:28.119823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:28.119823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:28.125975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 252/486] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 31 12:20:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:28.126925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c890513-f0d1-4ddb-bb7c-9c56f91d8db5 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:28.151531 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f76ad-f4b9-4112-b51f-2b0dbc6686e1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:28.194358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d842fbf-4b2d-4eba-a447-1521fe860f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:28.195285 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d842fbf-4b2d-4eba-a447-1521fe860f52 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:28.195704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d842fbf-4b2d-4eba-a447-1521fe860f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:28.196135 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d842fbf-4b2d-4eba-a447-1521fe860f52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:28.196998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d842fbf-4b2d-4eba-a447-1521fe860f52 None admin] RBAC: Adding query filter params (role.id=df935cf8a7f24352ba94fe83718280ea, scope.project.id=786ee416a639447ab3698d1f56d04e9a, user.id=b2ffd08478684105b83c4e74566ca6a9) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:28.197470 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d842fbf-4b2d-4eba-a447-1521fe860f52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:28.199219 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d842fbf-4b2d-4eba-a447-1521fe860f52 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:28.206539 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 235/487] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:20:28 2022] GET /identity/v3/role_assignments?user.id=b2ffd08478684105b83c4e74566ca6a9&scope.project.id=786ee416a639447ab3698d1f56d04e9a&role.id=df935cf8a7f24352ba94fe83718280ea => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:28.207587 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d842fbf-4b2d-4eba-a447-1521fe860f52 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:28.234746 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:28.237179 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c890513-f0d1-4ddb-bb7c-9c56f91d8db5 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:28.276868 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed8362-dee6-4433-bb7a-a88fdd84eead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:28.277560 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed8362-dee6-4433-bb7a-a88fdd84eead None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:28.277852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed8362-dee6-4433-bb7a-a88fdd84eead None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:28.278128 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed8362-dee6-4433-bb7a-a88fdd84eead None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:28.285797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed8362-dee6-4433-bb7a-a88fdd84eead None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:28.287181 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed8362-dee6-4433-bb7a-a88fdd84eead None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:28.299977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-78ed8362-dee6-4433-bb7a-a88fdd84eead None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:28.299977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:28.299977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:28.299977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:28.299977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:28.299977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:28.299977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:28.299977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:28.299977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:28.299977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:28.299977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:28.299977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:28.299977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:20:28.299977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:20:28.299977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:20:28.301074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:20:28.301074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:28.301074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:28.301074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:28.301074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:28.301074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:28.301074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:28.301074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:28.301074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:28.301074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:28.301074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:28.301074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:28.301074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:28.301074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:28.301074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:28.301074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:28.301074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:28.302141 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:20:28.302141 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:20:28.302141 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:20:28.302141 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:20:28.302141 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:20:28.302141 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:20:28.302141 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:28.302141 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:28.302141 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 253/488] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:28.307350 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed8362-dee6-4433-bb7a-a88fdd84eead None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:28.332066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d842fbf-4b2d-4eba-a447-1521fe860f52 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:28.372425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8e413-d5e6-43e8-9968-2804dceb9f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:28.373666 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8e413-d5e6-43e8-9968-2804dceb9f07 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:28.374333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8e413-d5e6-43e8-9968-2804dceb9f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:28.374777 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8e413-d5e6-43e8-9968-2804dceb9f07 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:28.375302 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:28.375743 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8e413-d5e6-43e8-9968-2804dceb9f07 None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:28.376193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8e413-d5e6-43e8-9968-2804dceb9f07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:28.377756 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8e413-d5e6-43e8-9968-2804dceb9f07 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:28.388444 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 236/489] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 31 12:20:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:28.395111 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8e413-d5e6-43e8-9968-2804dceb9f07 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:28.431201 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed8362-dee6-4433-bb7a-a88fdd84eead None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:28.470197 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ec0c0-a00c-46fd-9053-7c333e031b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:28.471062 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ec0c0-a00c-46fd-9053-7c333e031b5e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:28.471518 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ec0c0-a00c-46fd-9053-7c333e031b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:28.471933 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ec0c0-a00c-46fd-9053-7c333e031b5e None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:28.472770 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ec0c0-a00c-46fd-9053-7c333e031b5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:28.473279 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ec0c0-a00c-46fd-9053-7c333e031b5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:28.474933 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ec0c0-a00c-46fd-9053-7c333e031b5e None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:28.488891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 254/490] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:20:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:28.495814 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ec0c0-a00c-46fd-9053-7c333e031b5e None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:28.563808 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:28.594174 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8e413-d5e6-43e8-9968-2804dceb9f07 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:28.609050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ec0c0-a00c-46fd-9053-7c333e031b5e None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:28.631210 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:28.636385 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a4815-79f8-4294-bd53-f487a4f06403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:28.637819 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a4815-79f8-4294-bd53-f487a4f06403 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:28.638466 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a4815-79f8-4294-bd53-f487a4f06403 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:28.638914 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a4815-79f8-4294-bd53-f487a4f06403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:28.651670 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a4815-79f8-4294-bd53-f487a4f06403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:28.652646 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce8a3c-4b51-41a0-894a-4d2ebc0dea4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:28.653352 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce8a3c-4b51-41a0-894a-4d2ebc0dea4e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:28.653716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce8a3c-4b51-41a0-894a-4d2ebc0dea4e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:28.654056 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce8a3c-4b51-41a0-894a-4d2ebc0dea4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:28.654281 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a4815-79f8-4294-bd53-f487a4f06403 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:28.654956 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce8a3c-4b51-41a0-894a-4d2ebc0dea4e None admin] RBAC: Adding query filter params (role.id=df935cf8a7f24352ba94fe83718280ea, scope.project.id=786ee416a639447ab3698d1f56d04e9a, user.id=7179d21011064d5b91d0e35a51b8adae) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:28.655387 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce8a3c-4b51-41a0-894a-4d2ebc0dea4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:28.657404 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce8a3c-4b51-41a0-894a-4d2ebc0dea4e None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:28.665365 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 255/491] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:20:28 2022] GET /identity/v3/role_assignments?user.id=7179d21011064d5b91d0e35a51b8adae&scope.project.id=786ee416a639447ab3698d1f56d04e9a&role.id=df935cf8a7f24352ba94fe83718280ea => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:28.680495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-487a4815-79f8-4294-bd53-f487a4f06403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:28.680495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:28.680495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:28.680495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:28.680495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:28.680495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:28.680495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:28.680495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:28.680495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:28.680495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:28.680495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:28.680495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:28.680495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:28.680495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:28.680495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:28.680495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:28.681513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:28.681513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:28.681513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:28.681513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:28.681513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:28.681513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:28.681513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:28.681513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:28.681513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:28.681513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:28.681513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:28.681513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:28.681513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:28.681513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:28.681513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:28.681513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:28.681513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:28.682869 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:28.682869 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:28.682869 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:28.689249 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 237/492] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:28.691332 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce8a3c-4b51-41a0-894a-4d2ebc0dea4e None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:28.842360 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce8a3c-4b51-41a0-894a-4d2ebc0dea4e None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:28.891869 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34037d84-cb83-4299-8480-e9d8e21dae3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:28.892491 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34037d84-cb83-4299-8480-e9d8e21dae3b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:28.892763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34037d84-cb83-4299-8480-e9d8e21dae3b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:28.893030 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34037d84-cb83-4299-8480-e9d8e21dae3b None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:28.893707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34037d84-cb83-4299-8480-e9d8e21dae3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:28.894006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34037d84-cb83-4299-8480-e9d8e21dae3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:28.895439 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34037d84-cb83-4299-8480-e9d8e21dae3b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:28.922682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 256/493] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:28.928268 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a4815-79f8-4294-bd53-f487a4f06403 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:29.046575 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a4815-79f8-4294-bd53-f487a4f06403 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:29.088720 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49ba38-936f-4f45-ac66-81db5ba53e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:29.089381 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49ba38-936f-4f45-ac66-81db5ba53e15 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:29.089661 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49ba38-936f-4f45-ac66-81db5ba53e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:29.089929 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49ba38-936f-4f45-ac66-81db5ba53e15 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:29.091815 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:29.098111 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49ba38-936f-4f45-ac66-81db5ba53e15 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:29.099476 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49ba38-936f-4f45-ac66-81db5ba53e15 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:29.111473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-3a49ba38-936f-4f45-ac66-81db5ba53e15 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 31 12:20:29.111473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:29.111473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:29.111473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:29.111473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:29.111473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:29.111473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:29.111473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:29.111473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:29.111473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:29.111473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:29.111473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:29.111473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:20:29.111473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:20:29.111473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:20:29.111473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:20:29.112391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:29.112391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:29.112391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:20:29.112391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:29.112391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:20:29.112391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:29.112391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:29.112391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:29.112391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:29.112391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:29.112391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:29.112391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:29.112391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:29.112391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:29.112391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:29.112391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:29.112391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:29.112391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:29.113348 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:29.113348 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:29.113348 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:20:29.113348 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:20:29.113348 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:20:29.113348 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:20:29.113348 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:20:29.113348 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:20:29.113348 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 31 12:20:29.113348 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:29.113348 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 238/494] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 31 12:20:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:29.118362 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34037d84-cb83-4299-8480-e9d8e21dae3b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:29.170317 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:29.260480 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34037d84-cb83-4299-8480-e9d8e21dae3b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:29.277895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6bbc5-b9ed-48f0-9305-1c3ffb317e38 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:29.278547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6bbc5-b9ed-48f0-9305-1c3ffb317e38 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:29.278547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6bbc5-b9ed-48f0-9305-1c3ffb317e38 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:29.280136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 239/495] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:20:29.287448 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab56b35-4b1b-4002-bce2-f00fadf9d1ce None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:29.287730 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab56b35-4b1b-4002-bce2-f00fadf9d1ce None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:29.288003 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab56b35-4b1b-4002-bce2-f00fadf9d1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:29.314187 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234e6c9-f8ed-4d23-8e3e-294b81237858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:29.315169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234e6c9-f8ed-4d23-8e3e-294b81237858 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:29.315652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234e6c9-f8ed-4d23-8e3e-294b81237858 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:29.316126 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234e6c9-f8ed-4d23-8e3e-294b81237858 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:29.317075 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234e6c9-f8ed-4d23-8e3e-294b81237858 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:29.317604 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234e6c9-f8ed-4d23-8e3e-294b81237858 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:29.319231 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234e6c9-f8ed-4d23-8e3e-294b81237858 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:29.326718 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-dab56b35-4b1b-4002-bce2-f00fadf9d1ce None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:29.327929 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dab56b35-4b1b-4002-bce2-f00fadf9d1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:29.354259 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 257/496] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Oct 31 12:20:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:29.360086 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234e6c9-f8ed-4d23-8e3e-294b81237858 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:29.481086 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 240/497] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:29.503623 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:29.507255 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234e6c9-f8ed-4d23-8e3e-294b81237858 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:29.557313 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2724ed9-84f3-465d-afd6-8d80af51a08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:29.557917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2724ed9-84f3-465d-afd6-8d80af51a08a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:29.558192 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2724ed9-84f3-465d-afd6-8d80af51a08a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:29.558456 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2724ed9-84f3-465d-afd6-8d80af51a08a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:29.633436 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2724ed9-84f3-465d-afd6-8d80af51a08a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:29.634798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2724ed9-84f3-465d-afd6-8d80af51a08a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:29.752258 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:29.760956 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 258/498] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:20:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 31 12:20:29.762239 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab56b35-4b1b-4002-bce2-f00fadf9d1ce None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:29.778090 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2724ed9-84f3-465d-afd6-8d80af51a08a None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:29.918216 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab56b35-4b1b-4002-bce2-f00fadf9d1ce None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:29.952688 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2724ed9-84f3-465d-afd6-8d80af51a08a None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:29.965007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:29.982514 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8427cf-1f80-4791-baba-158078827589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:29.984267 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8427cf-1f80-4791-baba-158078827589 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:29.984936 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8427cf-1f80-4791-baba-158078827589 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:29.986613 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8427cf-1f80-4791-baba-158078827589 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:30.001600 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8427cf-1f80-4791-baba-158078827589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:30.003439 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8427cf-1f80-4791-baba-158078827589 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:30.019116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-6c8427cf-1f80-4791-baba-158078827589 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:30.019116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:30.019116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:30.019116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:30.019116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:30.019116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:30.019116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:30.019116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:30.019116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:30.019116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:30.019116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:30.019116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:30.019116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:30.019116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:30.019116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:30.019116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:30.020098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:30.020098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:30.020098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:30.020098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:30.020098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:30.020098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:30.020098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:30.020098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:30.020098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:30.020098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:30.020098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:30.020098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:30.020098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:30.020098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:30.020098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:30.020098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:30.020098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:30.020970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:30.020970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:30.020970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:30.023293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 241/499] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:30.028353 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8427cf-1f80-4791-baba-158078827589 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:30.032629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7272d-640f-415e-82f0-152e68c29bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:30.033798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7272d-640f-415e-82f0-152e68c29bae None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:30.034866 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7272d-640f-415e-82f0-152e68c29bae None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:30.035653 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7272d-640f-415e-82f0-152e68c29bae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:30.059299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7272d-640f-415e-82f0-152e68c29bae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:30.064693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-97b7272d-640f-415e-82f0-152e68c29bae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:20:30.064693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:30.064693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:30.064693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:30.064693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:30.064693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:30.064693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:30.064693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:30.064693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:30.064693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:30.064693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:30.064693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:30.064693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:30.064693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:30.064693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:30.064693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:30.065753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:30.065753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:30.065753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:30.065753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:30.065753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:30.065753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:30.065753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:30.065753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:30.065753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:30.065753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:30.065753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:30.065753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:30.065753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:30.065753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:30.065753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:30.065753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:30.067109 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:30.067109 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:30.067109 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:30.067109 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:30.067109 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:30.067109 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:30.067109 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:30.067109 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:30.067109 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:30.067109 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:30.067109 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:20:30.067109 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:30.081026 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 259/500] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 31 12:20:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:20:30.094371 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7272d-640f-415e-82f0-152e68c29bae None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:30.195266 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:30.220817 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8427cf-1f80-4791-baba-158078827589 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:30.269017 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d59e4-66e4-4040-8777-2dfa3e16d31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:30.270119 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d59e4-66e4-4040-8777-2dfa3e16d31f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:30.270552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d59e4-66e4-4040-8777-2dfa3e16d31f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:30.270971 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d59e4-66e4-4040-8777-2dfa3e16d31f None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:30.271760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d59e4-66e4-4040-8777-2dfa3e16d31f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:30.272236 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d59e4-66e4-4040-8777-2dfa3e16d31f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:30.272800 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7272d-640f-415e-82f0-152e68c29bae None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:30.274701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d59e4-66e4-4040-8777-2dfa3e16d31f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:30.287882 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 242/501] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:30.298210 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d59e4-66e4-4040-8777-2dfa3e16d31f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:30.338430 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac689405-99e3-4b20-b422-e7a8c8ec01fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:30.338756 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:30.339048 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac689405-99e3-4b20-b422-e7a8c8ec01fa None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:30.339326 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac689405-99e3-4b20-b422-e7a8c8ec01fa None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:30.339604 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac689405-99e3-4b20-b422-e7a8c8ec01fa None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:30.340280 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac689405-99e3-4b20-b422-e7a8c8ec01fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:30.340583 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac689405-99e3-4b20-b422-e7a8c8ec01fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:30.342067 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac689405-99e3-4b20-b422-e7a8c8ec01fa None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:30.363309 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 260/502] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:20:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:30.369157 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac689405-99e3-4b20-b422-e7a8c8ec01fa None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:30.448653 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d59e4-66e4-4040-8777-2dfa3e16d31f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:30.494606 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c945a-939b-4f40-be19-e5502211d8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:30.495242 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c945a-939b-4f40-be19-e5502211d8f9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:30.495520 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c945a-939b-4f40-be19-e5502211d8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:30.495787 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c945a-939b-4f40-be19-e5502211d8f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:30.502711 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c945a-939b-4f40-be19-e5502211d8f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:30.504184 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c945a-939b-4f40-be19-e5502211d8f9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:30.515931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-202c945a-939b-4f40-be19-e5502211d8f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:30.515931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:30.515931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:30.515931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:30.515931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:30.515931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:30.515931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:30.515931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:30.515931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:30.515931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:30.515931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:30.515931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:30.515931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:20:30.515931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:20:30.515931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:20:30.516833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:20:30.516833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:30.516833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:30.516833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:30.516833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:30.516833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:30.516833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:30.516833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:30.516833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:30.516833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:30.516833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:30.516833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:30.516833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:30.516833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:30.516833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:30.516833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:30.516833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:30.517766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:20:30.517766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:20:30.517766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:20:30.517766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:20:30.517766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:20:30.517766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:20:30.517766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:30.517766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:30.517766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 243/503] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:30.518706 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d6f6c-15a0-4060-ad32-52f2638be287 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:30.518805 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d6f6c-15a0-4060-ad32-52f2638be287 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:30.519030 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d6f6c-15a0-4060-ad32-52f2638be287 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:30.525686 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 244/504] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:30.529916 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d6f6c-15a0-4060-ad32-52f2638be287 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:30.566119 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac689405-99e3-4b20-b422-e7a8c8ec01fa None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:30.598239 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:30.616912 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fe206-e1cf-4cea-82cc-d65db3cf83d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:30.617836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fe206-e1cf-4cea-82cc-d65db3cf83d3 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:30.618263 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fe206-e1cf-4cea-82cc-d65db3cf83d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:30.618681 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fe206-e1cf-4cea-82cc-d65db3cf83d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:30.634096 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fe206-e1cf-4cea-82cc-d65db3cf83d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:30.636142 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fe206-e1cf-4cea-82cc-d65db3cf83d3 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:30.644877 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:30.654209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d6f6c-15a0-4060-ad32-52f2638be287 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:30.658392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-fe5fe206-e1cf-4cea-82cc-d65db3cf83d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:30.658392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:30.658392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:30.658392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:30.658392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:30.658392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:30.658392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:30.658392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:30.658392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:30.658392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:30.658392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:30.658392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:30.658392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:30.658392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:30.658392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:30.658392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:30.659407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:30.659407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:30.659407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:30.659407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:30.659407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:30.659407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:30.659407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:30.659407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:30.659407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:30.659407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:30.659407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:30.659407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:30.659407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:30.659407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:30.659407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:30.659407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:30.659407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:30.660558 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:30.660558 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:30.660558 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:30.669222 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 261/505] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:20:30.669222 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc9161-7197-4ff7-ba04-12c3a8106a07 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:30.669222 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc9161-7197-4ff7-ba04-12c3a8106a07 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:30.669222 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc9161-7197-4ff7-ba04-12c3a8106a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:30.689066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-46dc9161-7197-4ff7-ba04-12c3a8106a07 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:30.690267 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-46dc9161-7197-4ff7-ba04-12c3a8106a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:30.702858 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d252e3-84dd-42f3-a6a7-9446e9ff2346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:30.703740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d252e3-84dd-42f3-a6a7-9446e9ff2346 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:30.704532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d252e3-84dd-42f3-a6a7-9446e9ff2346 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:30.705523 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d252e3-84dd-42f3-a6a7-9446e9ff2346 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:30.706788 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d252e3-84dd-42f3-a6a7-9446e9ff2346 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:30.707307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d252e3-84dd-42f3-a6a7-9446e9ff2346 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:30.709149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d252e3-84dd-42f3-a6a7-9446e9ff2346 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:30.725244 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 245/506] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:20:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:30.726450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d252e3-84dd-42f3-a6a7-9446e9ff2346 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:30.773744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 262/507] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:30.774931 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc9161-7197-4ff7-ba04-12c3a8106a07 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:30.837904 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d252e3-84dd-42f3-a6a7-9446e9ff2346 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:30.876732 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3674bc-d291-4530-9dc7-8c3a806aa2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:30.877765 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3674bc-d291-4530-9dc7-8c3a806aa2cb None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:30.878334 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3674bc-d291-4530-9dc7-8c3a806aa2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:30.878941 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3674bc-d291-4530-9dc7-8c3a806aa2cb None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:30.879863 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3674bc-d291-4530-9dc7-8c3a806aa2cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:30.880395 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3674bc-d291-4530-9dc7-8c3a806aa2cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:30.882046 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3674bc-d291-4530-9dc7-8c3a806aa2cb None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:30.897185 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 246/508] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:30.903579 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3674bc-d291-4530-9dc7-8c3a806aa2cb None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:30.923829 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:31.017319 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3674bc-d291-4530-9dc7-8c3a806aa2cb None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:31.022104 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc9161-7197-4ff7-ba04-12c3a8106a07 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:31.025963 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:31.066424 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41acb5-19cb-4298-aa12-8630eebd879b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:31.066774 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081dcac9-b32e-4851-a0a5-718e23267891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:31.067403 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dcac9-b32e-4851-a0a5-718e23267891 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:31.067688 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dcac9-b32e-4851-a0a5-718e23267891 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:31.067963 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dcac9-b32e-4851-a0a5-718e23267891 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:31.068259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41acb5-19cb-4298-aa12-8630eebd879b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:31.068694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081dcac9-b32e-4851-a0a5-718e23267891 None admin] RBAC: Adding query filter params (role.id=df935cf8a7f24352ba94fe83718280ea, scope.project.id=786ee416a639447ab3698d1f56d04e9a, user.id=188c4989dcfb4f99a04c3349e1a882d1) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:31.068935 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41acb5-19cb-4298-aa12-8630eebd879b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:31.069035 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081dcac9-b32e-4851-a0a5-718e23267891 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:31.069575 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41acb5-19cb-4298-aa12-8630eebd879b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:31.073190 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081dcac9-b32e-4851-a0a5-718e23267891 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:31.079765 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 263/509] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:20:30 2022] GET /identity/v3/role_assignments?user.id=188c4989dcfb4f99a04c3349e1a882d1&scope.project.id=786ee416a639447ab3698d1f56d04e9a&role.id=df935cf8a7f24352ba94fe83718280ea => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:31.080996 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300317c-30f4-43d6-941c-790562a6b23a None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:31.081314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300317c-30f4-43d6-941c-790562a6b23a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:31.081591 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300317c-30f4-43d6-941c-790562a6b23a None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:31.085278 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 264/510] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:31.086488 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300317c-30f4-43d6-941c-790562a6b23a None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:31.089006 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41acb5-19cb-4298-aa12-8630eebd879b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:31.090911 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41acb5-19cb-4298-aa12-8630eebd879b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:31.104076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-ca41acb5-19cb-4298-aa12-8630eebd879b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 12:20:31.104076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:31.104076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:31.104076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:31.104076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:31.104076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:31.104076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:31.104076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:31.104076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:31.104076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:31.104076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:31.104076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:31.104076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:20:31.104076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:20:31.104076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:20:31.104076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:20:31.105138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:31.105138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:31.105138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:20:31.105138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:31.105138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:20:31.105138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:31.105138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:31.105138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:31.105138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:31.105138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:31.105138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:31.105138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:31.105138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:31.105138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:31.105138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:31.105138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:31.105138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:31.105138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:31.106087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:31.106087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:31.106087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:20:31.106087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:20:31.106087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:20:31.106087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:20:31.106087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:20:31.106087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:20:31.106087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 12:20:31.106087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:31.106608 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 247/511] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Oct 31 12:20:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:20:31.112032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2cf0b-2378-43d9-b88a-48129f2b7706 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:31.112032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2cf0b-2378-43d9-b88a-48129f2b7706 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:31.112032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2cf0b-2378-43d9-b88a-48129f2b7706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:31.132290 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7cc2cf0b-2378-43d9-b88a-48129f2b7706 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:31.135493 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7cc2cf0b-2378-43d9-b88a-48129f2b7706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:31.223573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 248/512] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:31.224800 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2cf0b-2378-43d9-b88a-48129f2b7706 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:31.236317 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:31.252374 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300317c-30f4-43d6-941c-790562a6b23a None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:31.303025 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083c920-3cdf-4ae9-91f9-d0c15c1d66b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:31.303921 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083c920-3cdf-4ae9-91f9-d0c15c1d66b9 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:31.304836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083c920-3cdf-4ae9-91f9-d0c15c1d66b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:31.305728 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083c920-3cdf-4ae9-91f9-d0c15c1d66b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:31.322218 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083c920-3cdf-4ae9-91f9-d0c15c1d66b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:31.324535 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083c920-3cdf-4ae9-91f9-d0c15c1d66b9 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:31.345495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-9083c920-3cdf-4ae9-91f9-d0c15c1d66b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:31.345495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:31.345495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:31.345495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:31.345495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:31.345495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:31.345495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:31.345495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:31.345495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:31.345495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:31.345495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:31.345495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:31.345495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:31.345495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:31.345495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:31.345495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:31.346707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:31.346707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:31.346707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:31.346707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:31.346707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:31.346707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:31.346707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:31.346707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:31.346707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:31.346707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:31.346707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:31.346707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:31.346707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:31.346707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:31.346707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:31.346707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:31.346707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:31.347799 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:31.347799 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:31.347799 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:31.350314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 265/513] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:31.355760 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083c920-3cdf-4ae9-91f9-d0c15c1d66b9 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:31.377515 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2cf0b-2378-43d9-b88a-48129f2b7706 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:31.383052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:31.414704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9ddc9-a2b3-42ad-b655-bb94c15a21e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:31.416442 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9ddc9-a2b3-42ad-b655-bb94c15a21e4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:31.416913 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9ddc9-a2b3-42ad-b655-bb94c15a21e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:31.417390 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9ddc9-a2b3-42ad-b655-bb94c15a21e4 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:31.418309 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9ddc9-a2b3-42ad-b655-bb94c15a21e4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:31.418796 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9ddc9-a2b3-42ad-b655-bb94c15a21e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:31.420425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9ddc9-a2b3-42ad-b655-bb94c15a21e4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:31.439866 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 249/514] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Oct 31 12:20:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:31.446237 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9ddc9-a2b3-42ad-b655-bb94c15a21e4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:31.481574 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083c920-3cdf-4ae9-91f9-d0c15c1d66b9 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:31.516181 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:31.528431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d9821-e546-4f54-944f-d65ba79c9f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:31.528628 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d9821-e546-4f54-944f-d65ba79c9f58 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:31.528822 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d9821-e546-4f54-944f-d65ba79c9f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:31.529101 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d9821-e546-4f54-944f-d65ba79c9f58 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:31.529855 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d9821-e546-4f54-944f-d65ba79c9f58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:31.530164 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d9821-e546-4f54-944f-d65ba79c9f58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:31.531534 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d9821-e546-4f54-944f-d65ba79c9f58 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:31.544745 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 266/515] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:31.546011 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42618ae1-a6aa-4497-a590-ed004a2a4c71 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:31.546301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42618ae1-a6aa-4497-a590-ed004a2a4c71 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:31.546578 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42618ae1-a6aa-4497-a590-ed004a2a4c71 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:31.547944 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 267/516] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:31.548504 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42618ae1-a6aa-4497-a590-ed004a2a4c71 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:31.567231 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9ddc9-a2b3-42ad-b655-bb94c15a21e4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:31.600983 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae4ad6-67ca-4b1b-9cee-214450dacce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:31.602208 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae4ad6-67ca-4b1b-9cee-214450dacce7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:31.602492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae4ad6-67ca-4b1b-9cee-214450dacce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:31.602808 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae4ad6-67ca-4b1b-9cee-214450dacce7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:31.612992 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae4ad6-67ca-4b1b-9cee-214450dacce7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:31.614445 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae4ad6-67ca-4b1b-9cee-214450dacce7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:31.630199 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-c3ae4ad6-67ca-4b1b-9cee-214450dacce7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:31.630199 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:31.630199 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:31.630199 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:31.630199 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:31.630199 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:31.630199 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:31.630199 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:31.630199 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:31.630199 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:31.630199 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:31.630199 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:31.630199 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:31.630199 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:31.630199 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:31.630199 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:31.631251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:31.631251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:31.631251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:31.631251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:31.631251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:31.631251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:31.631251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:31.631251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:31.631251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:31.631251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:31.631251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:31.631251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:31.631251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:31.631251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:31.631251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:31.631251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:31.631251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:31.632149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:31.632149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:31.632149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:31.632149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 250/517] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:20:31.632149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae4ad6-67ca-4b1b-9cee-214450dacce7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:31.643687 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:31.667172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42618ae1-a6aa-4497-a590-ed004a2a4c71 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:31.705991 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325efe1-f327-413a-9a48-f57e186a2a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:31.706619 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325efe1-f327-413a-9a48-f57e186a2a40 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:31.706895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325efe1-f327-413a-9a48-f57e186a2a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:31.707164 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325efe1-f327-413a-9a48-f57e186a2a40 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:31.707858 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325efe1-f327-413a-9a48-f57e186a2a40 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:31.709360 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325efe1-f327-413a-9a48-f57e186a2a40 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:31.721172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-c325efe1-f327-413a-9a48-f57e186a2a40 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 12:20:31.721172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:31.721172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:20:31.721172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:20:31.721172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:20:31.721172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:20:31.721172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:20:31.721172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:31.721172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 12:20:31.721172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:31.721172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:20:31.721172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:31.721172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:31.721172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:31.721172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:31.721172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:31.721172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:31.722398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:31.722398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:31.722398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:31.722398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:31.722398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:31.722398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:31.722398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:20:31.722398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:20:31.722398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:20:31.722398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:20:31.722398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:31.722398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:31.722398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:31.722398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:31.722398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:31.722398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:31.723446 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:31.723446 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:31.723446 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:31.723446 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:31.723446 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:31.723446 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:31.723446 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:31.723446 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:31.723446 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:31.723446 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:31.723446 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:20:31.723446 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:31.723446 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 12:20:31.723446 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:31.727111 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 268/518] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Oct 31 12:20:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:31.728254 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bea952-4323-48e4-8b54-cc3a208054a9 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:31.728574 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bea952-4323-48e4-8b54-cc3a208054a9 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:31.728876 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bea952-4323-48e4-8b54-cc3a208054a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:31.743572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae4ad6-67ca-4b1b-9cee-214450dacce7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:31.748444 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f0bea952-4323-48e4-8b54-cc3a208054a9 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:31.749650 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f0bea952-4323-48e4-8b54-cc3a208054a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:31.760605 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:31.780260 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f4974-10f0-4db5-88d5-af926b252e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:31.780868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f4974-10f0-4db5-88d5-af926b252e2d None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:31.781176 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f4974-10f0-4db5-88d5-af926b252e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:31.781451 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f4974-10f0-4db5-88d5-af926b252e2d None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:31.782088 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f4974-10f0-4db5-88d5-af926b252e2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:31.783508 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f4974-10f0-4db5-88d5-af926b252e2d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:31.808418 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 251/519] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 31 12:20:31 2022] POST /identity/v3/users => generated 254 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:20:31.808418 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f4974-10f0-4db5-88d5-af926b252e2d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:31.826249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 269/520] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:31.826659 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bea952-4323-48e4-8b54-cc3a208054a9 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:31.917950 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:31.947750 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bea952-4323-48e4-8b54-cc3a208054a9 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:32.008048 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d0ff5-6549-4285-b82f-0321520d279e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:32.008673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d0ff5-6549-4285-b82f-0321520d279e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:32.008954 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d0ff5-6549-4285-b82f-0321520d279e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:32.009996 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d0ff5-6549-4285-b82f-0321520d279e None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:32.010641 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d0ff5-6549-4285-b82f-0321520d279e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:32.010945 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d0ff5-6549-4285-b82f-0321520d279e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:32.012315 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d0ff5-6549-4285-b82f-0321520d279e None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:32.017497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 270/521] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Oct 31 12:20:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:32.025742 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d0ff5-6549-4285-b82f-0321520d279e None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:32.027936 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f4974-10f0-4db5-88d5-af926b252e2d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:32.066874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b404f-b248-43b8-b459-6ca31b45b1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:32.067872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b404f-b248-43b8-b459-6ca31b45b1cd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:32.068394 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b404f-b248-43b8-b459-6ca31b45b1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:32.068875 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b404f-b248-43b8-b459-6ca31b45b1cd None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:32.069779 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b404f-b248-43b8-b459-6ca31b45b1cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:32.071434 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b404f-b248-43b8-b459-6ca31b45b1cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:32.073008 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b404f-b248-43b8-b459-6ca31b45b1cd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:32.089640 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 252/522] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:32.095518 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b404f-b248-43b8-b459-6ca31b45b1cd None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:32.135722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:32.156291 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d0ff5-6549-4285-b82f-0321520d279e None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:32.204425 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74228432-5d18-420b-ae24-ebd424691bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:32.205925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74228432-5d18-420b-ae24-ebd424691bab None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:32.206361 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74228432-5d18-420b-ae24-ebd424691bab None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:32.206814 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74228432-5d18-420b-ae24-ebd424691bab None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:32.207886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74228432-5d18-420b-ae24-ebd424691bab None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:32.208775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74228432-5d18-420b-ae24-ebd424691bab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:32.210879 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74228432-5d18-420b-ae24-ebd424691bab None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:32.214271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b404f-b248-43b8-b459-6ca31b45b1cd None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:32.218854 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 271/523] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Oct 31 12:20:32 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:32.226581 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74228432-5d18-420b-ae24-ebd424691bab None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:32.230666 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:32.275862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628dbb74-5005-4df0-b503-125ab46efb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:32.276686 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628dbb74-5005-4df0-b503-125ab46efb0e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:32.277057 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628dbb74-5005-4df0-b503-125ab46efb0e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:32.277451 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628dbb74-5005-4df0-b503-125ab46efb0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:32.291390 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628dbb74-5005-4df0-b503-125ab46efb0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:32.293267 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628dbb74-5005-4df0-b503-125ab46efb0e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:32.315127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-628dbb74-5005-4df0-b503-125ab46efb0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:32.315127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:32.315127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:32.315127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:32.315127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:32.315127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:32.315127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:32.315127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:32.315127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:32.315127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:32.315127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:32.315127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:32.315127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:20:32.315127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:20:32.315127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:20:32.316270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:20:32.316270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:32.316270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:32.316270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:32.316270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:32.316270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:32.316270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:32.316270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:32.316270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:32.316270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:32.316270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:32.316270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:32.316270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:32.316270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:32.316270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:32.316270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:32.316270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:32.317401 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:20:32.317401 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:20:32.317401 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:20:32.317401 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:20:32.317401 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:20:32.317401 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:20:32.317401 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:32.317401 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:32.325134 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 253/524] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:32.326551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628dbb74-5005-4df0-b503-125ab46efb0e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:32.415670 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74228432-5d18-420b-ae24-ebd424691bab None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:32.444986 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:32.452952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3822d-ee75-4bf2-9ff3-1d86105f3155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:32.453854 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3822d-ee75-4bf2-9ff3-1d86105f3155 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:32.454292 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3822d-ee75-4bf2-9ff3-1d86105f3155 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:32.454726 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3822d-ee75-4bf2-9ff3-1d86105f3155 None admin] PATH_INFO: `/v3/services/network` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:32.455456 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a3822d-ee75-4bf2-9ff3-1d86105f3155 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:32.456172 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628dbb74-5005-4df0-b503-125ab46efb0e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:32.457145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a3822d-ee75-4bf2-9ff3-1d86105f3155 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:32.470895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-33a3822d-ee75-4bf2-9ff3-1d86105f3155 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 12:20:32.470895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:32.470895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:20:32.470895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:20:32.470895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:20:32.470895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:20:32.470895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:20:32.470895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:32.470895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 12:20:32.470895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:32.470895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:20:32.470895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:32.470895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:32.470895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:32.470895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:32.470895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:32.470895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:32.472200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:32.472200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:32.472200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:32.472200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:32.472200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:32.472200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:32.472200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:20:32.472200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:20:32.472200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:20:32.472200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:20:32.472200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:32.472200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:32.472200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:32.472200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:32.472200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:32.472200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:32.473299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:32.473299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:32.473299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:32.473299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:32.473299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:32.473299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:32.473299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:32.473299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:32.473299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:32.473299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:32.473299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:20:32.473299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:32.473299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 12:20:32.473299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:32.477414 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 272/525] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:32 2022] GET /identity/v3/services/network => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:32.485288 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3822d-ee75-4bf2-9ff3-1d86105f3155 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:32.504209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773c92f-b39d-44f2-961a-c9d2d1905b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:32.505144 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773c92f-b39d-44f2-961a-c9d2d1905b63 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:32.505727 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773c92f-b39d-44f2-961a-c9d2d1905b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:32.506832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773c92f-b39d-44f2-961a-c9d2d1905b63 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:32.507825 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773c92f-b39d-44f2-961a-c9d2d1905b63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:32.508310 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773c92f-b39d-44f2-961a-c9d2d1905b63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:32.510054 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773c92f-b39d-44f2-961a-c9d2d1905b63 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:32.526848 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 254/526] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:20:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:32.534095 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773c92f-b39d-44f2-961a-c9d2d1905b63 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:32.568002 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:32.609056 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3822d-ee75-4bf2-9ff3-1d86105f3155 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:32.653306 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f74a45-adc2-4cfb-9447-50016caa5c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:32.654009 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773c92f-b39d-44f2-961a-c9d2d1905b63 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:32.654453 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f74a45-adc2-4cfb-9447-50016caa5c76 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:32.654938 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f74a45-adc2-4cfb-9447-50016caa5c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:32.655387 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f74a45-adc2-4cfb-9447-50016caa5c76 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:32.656266 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f74a45-adc2-4cfb-9447-50016caa5c76 None admin] RBAC: Adding query filter params (name=network) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:32.656801 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f74a45-adc2-4cfb-9447-50016caa5c76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:32.658377 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f74a45-adc2-4cfb-9447-50016caa5c76 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:32.664525 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 273/527] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 31 12:20:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:32.674507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f74a45-adc2-4cfb-9447-50016caa5c76 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:32.696132 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9f451-badb-430a-b7dc-5d7e47977cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:32.696821 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9f451-badb-430a-b7dc-5d7e47977cec None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:32.697231 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9f451-badb-430a-b7dc-5d7e47977cec None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:32.697570 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9f451-badb-430a-b7dc-5d7e47977cec None admin] PATH_INFO: `/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/d93ce5759e0648a1934ff4d9c9d8fe61/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:32.699714 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9f451-badb-430a-b7dc-5d7e47977cec None admin] RBAC: Authorizing `identity:create_grant(project_id=786ee416a639447ab3698d1f56d04e9a, user_id=d93ce5759e0648a1934ff4d9c9d8fe61, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:32.701255 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9f451-badb-430a-b7dc-5d7e47977cec None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:32.747630 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 255/528] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:20:32 2022] PUT /identity/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/d93ce5759e0648a1934ff4d9c9d8fe61/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:20:32.833878 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f74a45-adc2-4cfb-9447-50016caa5c76 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:32.866367 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:32.872884 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e85e6e-27c7-4c71-a8ac-e2c1d56a6d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:32.873766 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e85e6e-27c7-4c71-a8ac-e2c1d56a6d9a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:32.874325 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e85e6e-27c7-4c71-a8ac-e2c1d56a6d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:32.874795 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e85e6e-27c7-4c71-a8ac-e2c1d56a6d9a None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:32.875758 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e85e6e-27c7-4c71-a8ac-e2c1d56a6d9a None admin] RBAC: Adding query filter params (type=network) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:32.876061 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e85e6e-27c7-4c71-a8ac-e2c1d56a6d9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:32.877447 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e85e6e-27c7-4c71-a8ac-e2c1d56a6d9a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:32.882555 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 274/529] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 31 12:20:32 2022] GET /identity/v3/services?type=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:33.805722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd72d2-f169-40e3-a409-57448b664589 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:33.806332 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd72d2-f169-40e3-a409-57448b664589 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:33.806556 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd72d2-f169-40e3-a409-57448b664589 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:33.808276 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 256/530] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:33.813278 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3ef28-c80c-4f76-9f6b-0654bc7a3123 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:33.813704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3ef28-c80c-4f76-9f6b-0654bc7a3123 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:33.813813 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3ef28-c80c-4f76-9f6b-0654bc7a3123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:33.838079 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-11b3ef28-c80c-4f76-9f6b-0654bc7a3123 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:33.839275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-11b3ef28-c80c-4f76-9f6b-0654bc7a3123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:33.922967 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 275/531] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:34.325788 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd72d2-f169-40e3-a409-57448b664589 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:34.345322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:34.398956 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4c59b-375b-4798-8062-462549265a58 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:34.399269 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4c59b-375b-4798-8062-462549265a58 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:34.399517 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4c59b-375b-4798-8062-462549265a58 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:34.401155 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 276/532] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:34.406064 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed90760-4f69-4e97-ae4d-b0966bc71c10 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:34.406348 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed90760-4f69-4e97-ae4d-b0966bc71c10 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:34.406624 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed90760-4f69-4e97-ae4d-b0966bc71c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:34.438143 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-bed90760-4f69-4e97-ae4d-b0966bc71c10 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:34.439324 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-bed90760-4f69-4e97-ae4d-b0966bc71c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:34.471812 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd72d2-f169-40e3-a409-57448b664589 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:34.539164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d1dfd-4172-40b2-b8d2-c68db8e76371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:34.541464 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d1dfd-4172-40b2-b8d2-c68db8e76371 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:34.541760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d1dfd-4172-40b2-b8d2-c68db8e76371 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:34.542049 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d1dfd-4172-40b2-b8d2-c68db8e76371 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:34.556556 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 277/533] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 12:20:34.571090 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d1dfd-4172-40b2-b8d2-c68db8e76371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:34.576010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-dc6d1dfd-4172-40b2-b8d2-c68db8e76371 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:20:34.576010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:34.576010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:34.576010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:34.576010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:34.576010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:34.576010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:34.576010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:34.576010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:34.576010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:34.576010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:34.576010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:34.576010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:34.576010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:34.576010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:34.576010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:34.576908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:34.576908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:34.576908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:34.576908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:34.576908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:34.576908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:34.576908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:34.576908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:34.576908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:34.576908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:34.576908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:34.576908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:34.576908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:34.576908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:34.576908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:34.576908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:34.577814 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:34.577814 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:34.577814 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:34.577814 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:34.577814 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:34.577814 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:34.577814 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:34.577814 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:34.577814 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:34.577814 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:34.577814 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:20:34.577814 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:34.577814 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 257/534] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 31 12:20:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:34.584588 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed90760-4f69-4e97-ae4d-b0966bc71c10 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:34.658751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:34.705651 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed90760-4f69-4e97-ae4d-b0966bc71c10 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:34.741084 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03597c-49da-4f3a-8f9a-8403d054f171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:34.741952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03597c-49da-4f3a-8f9a-8403d054f171 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:34.742405 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03597c-49da-4f3a-8f9a-8403d054f171 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:34.742820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03597c-49da-4f3a-8f9a-8403d054f171 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:34.743625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03597c-49da-4f3a-8f9a-8403d054f171 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:34.744071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03597c-49da-4f3a-8f9a-8403d054f171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:34.745592 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03597c-49da-4f3a-8f9a-8403d054f171 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:34.754980 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 278/535] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:20:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:34.761601 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d1dfd-4172-40b2-b8d2-c68db8e76371 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:34.834079 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:34.848420 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03597c-49da-4f3a-8f9a-8403d054f171 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:34.875824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d1dfd-4172-40b2-b8d2-c68db8e76371 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:34.949894 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02638c70-aca5-425a-a365-30402400203e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:34.950570 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02638c70-aca5-425a-a365-30402400203e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:34.950853 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02638c70-aca5-425a-a365-30402400203e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:34.951128 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02638c70-aca5-425a-a365-30402400203e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:34.971815 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03597c-49da-4f3a-8f9a-8403d054f171 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:34.977904 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02638c70-aca5-425a-a365-30402400203e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:34.979353 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02638c70-aca5-425a-a365-30402400203e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:34.989965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:35.013092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e3876-6c9d-4f97-8500-facddfc14c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:35.014056 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e3876-6c9d-4f97-8500-facddfc14c49 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:35.014510 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e3876-6c9d-4f97-8500-facddfc14c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:35.014951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e3876-6c9d-4f97-8500-facddfc14c49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:35.015143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-02638c70-aca5-425a-a365-30402400203e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:35.015143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:35.015143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:35.015143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:35.015143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:35.015143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:35.015143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:35.015143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:35.015143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:35.015143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:35.015143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:35.015143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:35.015143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:35.015143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:35.015143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:35.015143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:35.016026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:35.016026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:35.016026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:35.016026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:35.016026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:35.016026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:35.016026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:35.016026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:35.016026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:35.016026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:35.016026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:35.016026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:35.016026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:35.016026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:35.016026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:35.016026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:35.016026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:35.016898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:35.016898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:35.016898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:35.016898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 258/536] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:35.023070 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02638c70-aca5-425a-a365-30402400203e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:35.032573 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e3876-6c9d-4f97-8500-facddfc14c49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:35.043880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-172e3876-6c9d-4f97-8500-facddfc14c49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:35.043880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:35.043880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:35.043880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:35.043880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:35.043880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:35.043880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:35.043880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:35.043880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:35.043880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:35.043880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:35.043880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:35.043880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:35.043880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:35.043880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:35.043880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:35.045151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:35.045151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:35.045151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:35.045151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:35.045151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:35.045151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:35.045151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:35.045151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:35.045151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:35.045151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:35.045151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:35.045151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:35.045151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:35.045151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:35.045151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:35.045151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:35.046192 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:35.046192 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:35.046192 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:35.046192 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:35.046192 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:35.046192 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:35.046192 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:35.046192 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:35.046192 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:35.046192 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:35.046192 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:35.046192 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:35.049299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 279/537] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 31 12:20:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:35.050834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1d037-0ab2-41ed-97d8-fb8e4525d5db None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:35.050953 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1d037-0ab2-41ed-97d8-fb8e4525d5db None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:35.051181 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1d037-0ab2-41ed-97d8-fb8e4525d5db None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:35.052665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 280/538] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:35.062144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1d037-0ab2-41ed-97d8-fb8e4525d5db None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:35.149876 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02638c70-aca5-425a-a365-30402400203e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:35.181326 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:35.195951 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda0432-3096-425e-9eae-13ad5b602ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:35.196804 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda0432-3096-425e-9eae-13ad5b602ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:35.197319 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda0432-3096-425e-9eae-13ad5b602ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:35.197642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1d037-0ab2-41ed-97d8-fb8e4525d5db None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:35.197889 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda0432-3096-425e-9eae-13ad5b602ca1 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:35.198685 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda0432-3096-425e-9eae-13ad5b602ca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:35.199233 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda0432-3096-425e-9eae-13ad5b602ca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:35.200823 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda0432-3096-425e-9eae-13ad5b602ca1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:35.215005 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 259/539] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:35.216512 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64f997-f6bf-4ea1-8782-fe6941901b31 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:35.216942 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64f997-f6bf-4ea1-8782-fe6941901b31 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:35.217402 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64f997-f6bf-4ea1-8782-fe6941901b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:35.238611 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-bf64f997-f6bf-4ea1-8782-fe6941901b31 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:35.238893 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21091fb-a77b-4f4c-9d1c-04af35d121ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:35.239560 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21091fb-a77b-4f4c-9d1c-04af35d121ea None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:35.239841 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21091fb-a77b-4f4c-9d1c-04af35d121ea None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:35.240114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21091fb-a77b-4f4c-9d1c-04af35d121ea None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:35.240679 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bf64f997-f6bf-4ea1-8782-fe6941901b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:35.240828 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21091fb-a77b-4f4c-9d1c-04af35d121ea None admin] RBAC: Adding query filter params (name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:35.241165 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21091fb-a77b-4f4c-9d1c-04af35d121ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:35.243202 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21091fb-a77b-4f4c-9d1c-04af35d121ea None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:35.253709 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 281/540] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 31 12:20:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:35.254426 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21091fb-a77b-4f4c-9d1c-04af35d121ea None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:35.306159 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:35.327448 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 260/541] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:35.328408 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64f997-f6bf-4ea1-8782-fe6941901b31 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:35.410576 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21091fb-a77b-4f4c-9d1c-04af35d121ea None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:35.489078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64f997-f6bf-4ea1-8782-fe6941901b31 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:35.490215 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103a74b-9776-4a6c-a073-e5d362c55229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:35.490861 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103a74b-9776-4a6c-a073-e5d362c55229 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:35.491143 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103a74b-9776-4a6c-a073-e5d362c55229 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:35.491411 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103a74b-9776-4a6c-a073-e5d362c55229 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:35.507130 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:35.508374 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103a74b-9776-4a6c-a073-e5d362c55229 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:35.509580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103a74b-9776-4a6c-a073-e5d362c55229 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:35.529692 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5847ae-05d6-4e52-be30-60fc5d94d261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:35.530847 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5847ae-05d6-4e52-be30-60fc5d94d261 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:35.531003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-c103a74b-9776-4a6c-a073-e5d362c55229 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 31 12:20:35.531003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:35.531003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:35.531003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:35.531003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:35.531003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:35.531003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:35.531003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:35.531003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:35.531003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:35.531003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:35.531003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:35.531003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:20:35.531003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:20:35.531003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:20:35.531003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:20:35.531889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:35.531889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:35.531889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:20:35.531889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:35.531889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:20:35.531889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:35.531889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:35.531889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:35.531889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:35.531889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:35.531889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:35.531889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:35.531889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:35.531889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:35.531889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:35.531889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:35.531889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:35.531889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:35.532817 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:35.532817 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:35.532817 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:20:35.532817 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:20:35.532817 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:20:35.532817 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:20:35.532817 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:20:35.532817 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:20:35.532817 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 31 12:20:35.532817 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:35.532817 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 282/542] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 31 12:20:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:35.534637 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5847ae-05d6-4e52-be30-60fc5d94d261 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:35.535342 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5847ae-05d6-4e52-be30-60fc5d94d261 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:35.545138 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103a74b-9776-4a6c-a073-e5d362c55229 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:35.555923 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5847ae-05d6-4e52-be30-60fc5d94d261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:35.562320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5847ae-05d6-4e52-be30-60fc5d94d261 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:35.586543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-db5847ae-05d6-4e52-be30-60fc5d94d261 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:35.586543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:35.586543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:35.586543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:35.586543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:35.586543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:35.586543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:35.586543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:35.586543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:35.586543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:35.586543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:35.586543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:35.586543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:35.586543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:35.586543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:35.586543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:35.587534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:35.587534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:35.587534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:35.587534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:35.587534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:35.587534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:35.587534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:35.587534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:35.587534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:35.587534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:35.587534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:35.587534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:35.587534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:35.587534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:35.587534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:35.587534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:35.587534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:35.588417 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:35.588417 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:35.588417 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:35.588417 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 261/543] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:35.589318 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae237c-4210-4e85-9b93-2c89940f9d4b None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:35.589318 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae237c-4210-4e85-9b93-2c89940f9d4b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:35.589477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae237c-4210-4e85-9b93-2c89940f9d4b None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:35.594869 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 262/544] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:35.595644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae237c-4210-4e85-9b93-2c89940f9d4b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:35.665954 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:35.670811 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103a74b-9776-4a6c-a073-e5d362c55229 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:35.706345 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ae0ce-21f3-4c24-804d-286e80277634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:35.706953 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ae0ce-21f3-4c24-804d-286e80277634 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:35.707234 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ae0ce-21f3-4c24-804d-286e80277634 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:35.707515 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ae0ce-21f3-4c24-804d-286e80277634 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:35.708224 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ae0ce-21f3-4c24-804d-286e80277634 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:35.708530 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ae0ce-21f3-4c24-804d-286e80277634 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:35.709980 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ae0ce-21f3-4c24-804d-286e80277634 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:35.711054 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae237c-4210-4e85-9b93-2c89940f9d4b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:35.734802 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 283/545] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Oct 31 12:20:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:35.734802 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc9cea-b4dc-470b-897b-6b53bbd0b190 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:35.734802 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc9cea-b4dc-470b-897b-6b53bbd0b190 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:35.734802 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc9cea-b4dc-470b-897b-6b53bbd0b190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:35.748312 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a73121-4102-484b-8d84-3b0b1411fb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:35.748988 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a73121-4102-484b-8d84-3b0b1411fb6f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:35.749386 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a73121-4102-484b-8d84-3b0b1411fb6f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:35.749668 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a73121-4102-484b-8d84-3b0b1411fb6f None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:35.750416 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a73121-4102-484b-8d84-3b0b1411fb6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:35.750722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a73121-4102-484b-8d84-3b0b1411fb6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:35.751611 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-1cdc9cea-b4dc-470b-897b-6b53bbd0b190 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:35.752132 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a73121-4102-484b-8d84-3b0b1411fb6f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:35.752788 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1cdc9cea-b4dc-470b-897b-6b53bbd0b190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:35.771621 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 263/546] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:35.771621 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a73121-4102-484b-8d84-3b0b1411fb6f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:35.797867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:35.824920 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 284/547] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:35.829426 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc9cea-b4dc-470b-897b-6b53bbd0b190 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:35.871537 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a73121-4102-484b-8d84-3b0b1411fb6f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:35.911744 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676669e-3d39-4055-aa7f-5d358ccd9663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:35.912583 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:35.913439 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676669e-3d39-4055-aa7f-5d358ccd9663 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:35.914377 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676669e-3d39-4055-aa7f-5d358ccd9663 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:35.914589 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676669e-3d39-4055-aa7f-5d358ccd9663 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:35.915131 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676669e-3d39-4055-aa7f-5d358ccd9663 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:35.917000 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676669e-3d39-4055-aa7f-5d358ccd9663 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:35.929966 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc9cea-b4dc-470b-897b-6b53bbd0b190 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:35.934543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 264/548] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 31 12:20:35 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:20:35.935829 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58141a-0175-4a43-a9f4-8dbc664aecda None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:35.936193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58141a-0175-4a43-a9f4-8dbc664aecda None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:35.936542 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58141a-0175-4a43-a9f4-8dbc664aecda None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:35.941267 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 265/549] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:35.942461 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58141a-0175-4a43-a9f4-8dbc664aecda None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:35.990803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1256f7-47ff-4ce9-a3a3-5ecf4bcc89a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:35.992188 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1256f7-47ff-4ce9-a3a3-5ecf4bcc89a1 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:35.992799 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1256f7-47ff-4ce9-a3a3-5ecf4bcc89a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:35.993292 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1256f7-47ff-4ce9-a3a3-5ecf4bcc89a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:36.005682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1256f7-47ff-4ce9-a3a3-5ecf4bcc89a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:36.008126 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1256f7-47ff-4ce9-a3a3-5ecf4bcc89a1 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:36.025594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-6d1256f7-47ff-4ce9-a3a3-5ecf4bcc89a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:36.025594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:36.025594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:36.025594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:36.025594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:36.025594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:36.025594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:36.025594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:36.025594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:36.025594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:36.025594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:36.025594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:36.025594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:36.025594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:36.025594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:36.025594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:36.026639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:36.026639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:36.026639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:36.026639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:36.026639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:36.026639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:36.026639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:36.026639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:36.026639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:36.026639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:36.026639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:36.026639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:36.026639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:36.026639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:36.026639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:36.026639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:36.026639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:36.027545 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:36.027545 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:36.027545 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:36.029817 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 285/550] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:36.031449 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5f455-26e4-4a35-98a7-e82e614b936d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:36.031985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5f455-26e4-4a35-98a7-e82e614b936d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:36.032479 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5f455-26e4-4a35-98a7-e82e614b936d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:36.057150 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-6ad5f455-26e4-4a35-98a7-e82e614b936d None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:36.057439 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:36.059136 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6ad5f455-26e4-4a35-98a7-e82e614b936d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:36.083966 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58141a-0175-4a43-a9f4-8dbc664aecda None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:36.125629 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5a0f4-c1fe-429b-8cdf-d7ac64546ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:36.127012 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5a0f4-c1fe-429b-8cdf-d7ac64546ecc None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:36.127012 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5a0f4-c1fe-429b-8cdf-d7ac64546ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:36.127183 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5a0f4-c1fe-429b-8cdf-d7ac64546ecc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:36.136576 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5a0f4-c1fe-429b-8cdf-d7ac64546ecc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:36.138169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5a0f4-c1fe-429b-8cdf-d7ac64546ecc None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:36.151193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-77c5a0f4-c1fe-429b-8cdf-d7ac64546ecc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 12:20:36.151193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:36.151193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:36.151193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:36.151193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:36.151193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:36.151193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:36.151193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:36.151193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:36.151193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:36.151193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:36.151193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:36.151193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:20:36.151193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:20:36.151193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:20:36.151193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:20:36.152171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:36.152171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:36.152171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:20:36.152171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:36.152171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:20:36.152171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:36.152171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:36.152171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:36.152171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:36.152171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:36.152171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:36.152171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:36.152171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:36.152171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:36.152171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:36.152171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:36.152171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:36.152171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:36.153236 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:36.153236 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:36.153236 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:20:36.153236 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:20:36.153236 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:20:36.153236 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:20:36.153236 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:20:36.153236 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:20:36.153236 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 12:20:36.153236 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:36.153236 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 266/551] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Oct 31 12:20:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:36.153885 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5a0f4-c1fe-429b-8cdf-d7ac64546ecc None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:36.158182 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 286/552] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:36 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 12:20:36.159200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5f455-26e4-4a35-98a7-e82e614b936d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:36.239821 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:36.286132 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5a0f4-c1fe-429b-8cdf-d7ac64546ecc None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:36.289263 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5f455-26e4-4a35-98a7-e82e614b936d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:36.323635 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72115beb-1801-4f41-83e8-ae1aba75607d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:36.324256 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72115beb-1801-4f41-83e8-ae1aba75607d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:36.324521 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72115beb-1801-4f41-83e8-ae1aba75607d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:36.324796 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72115beb-1801-4f41-83e8-ae1aba75607d None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:36.325529 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72115beb-1801-4f41-83e8-ae1aba75607d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:36.325835 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72115beb-1801-4f41-83e8-ae1aba75607d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:36.326874 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac9f0f-e554-4c09-a6b4-85c7ce8139f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:36.327203 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72115beb-1801-4f41-83e8-ae1aba75607d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:36.327925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac9f0f-e554-4c09-a6b4-85c7ce8139f4 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:36.328403 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac9f0f-e554-4c09-a6b4-85c7ce8139f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:36.328871 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac9f0f-e554-4c09-a6b4-85c7ce8139f4 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:36.329783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac9f0f-e554-4c09-a6b4-85c7ce8139f4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:36.331516 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac9f0f-e554-4c09-a6b4-85c7ce8139f4 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:36.340800 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 267/553] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:36.346340 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72115beb-1801-4f41-83e8-ae1aba75607d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:36.354929 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 287/554] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 31 12:20:36 2022] POST /identity/v3/services => generated 240 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:20:36.356147 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac9f0f-e554-4c09-a6b4-85c7ce8139f4 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:36.356386 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:36.465505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72115beb-1801-4f41-83e8-ae1aba75607d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:36.479244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac9f0f-e554-4c09-a6b4-85c7ce8139f4 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:36.502456 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:36.508584 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084e289-c1cd-4d79-80b3-5af259d1be41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:36.509878 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084e289-c1cd-4d79-80b3-5af259d1be41 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:36.510170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084e289-c1cd-4d79-80b3-5af259d1be41 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:36.510455 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084e289-c1cd-4d79-80b3-5af259d1be41 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:36.512008 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084e289-c1cd-4d79-80b3-5af259d1be41 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:36.512466 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084e289-c1cd-4d79-80b3-5af259d1be41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:36.515566 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084e289-c1cd-4d79-80b3-5af259d1be41 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:36.520228 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a96df-a670-450a-80ea-ecb12cce5265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:36.520884 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a96df-a670-450a-80ea-ecb12cce5265 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:36.521201 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a96df-a670-450a-80ea-ecb12cce5265 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:36.521476 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a96df-a670-450a-80ea-ecb12cce5265 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:36.529518 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a96df-a670-450a-80ea-ecb12cce5265 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:36.531753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a96df-a670-450a-80ea-ecb12cce5265 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:36.538259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 268/555] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Oct 31 12:20:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:36.539690 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084e289-c1cd-4d79-80b3-5af259d1be41 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:36.545925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-c65a96df-a670-450a-80ea-ecb12cce5265 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:36.545925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:36.545925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:36.545925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:36.545925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:36.545925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:36.545925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:36.545925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:36.545925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:36.545925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:36.545925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:36.545925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:36.545925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:20:36.545925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:20:36.545925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:20:36.547058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:20:36.547058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:36.547058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:36.547058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:36.547058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:36.547058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:36.547058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:36.547058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:36.547058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:36.547058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:36.547058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:36.547058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:36.547058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:36.547058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:36.547058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:36.547058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:36.547058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:36.549350 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:20:36.549350 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:20:36.549350 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:20:36.549350 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:20:36.549350 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:20:36.549350 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:20:36.549350 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:36.549350 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:36.549350 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 288/556] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:36.549350 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a96df-a670-450a-80ea-ecb12cce5265 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:36.622020 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:36.664087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084e289-c1cd-4d79-80b3-5af259d1be41 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:36.672920 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a96df-a670-450a-80ea-ecb12cce5265 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:36.705501 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98500bff-43fd-4412-b2a4-1dd5c3894367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:36.706517 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98500bff-43fd-4412-b2a4-1dd5c3894367 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:36.706869 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98500bff-43fd-4412-b2a4-1dd5c3894367 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:36.707209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98500bff-43fd-4412-b2a4-1dd5c3894367 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:36.717943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc852a8-eb33-406c-932c-cc5b6718bfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:36.718822 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc852a8-eb33-406c-932c-cc5b6718bfea None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:36.719334 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc852a8-eb33-406c-932c-cc5b6718bfea None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:36.719809 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98500bff-43fd-4412-b2a4-1dd5c3894367 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:36.720043 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc852a8-eb33-406c-932c-cc5b6718bfea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:36.725007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-98500bff-43fd-4412-b2a4-1dd5c3894367 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:20:36.725007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:36.725007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:36.725007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:36.725007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:36.725007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:36.725007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:36.725007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:36.725007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:36.725007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:36.725007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:36.725007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:36.725007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:36.725007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:36.725007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:36.725007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:36.726060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:36.726060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:36.726060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:36.726060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:36.726060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:36.726060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:36.726060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:36.726060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:36.726060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:36.726060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:36.726060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:36.726060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:36.726060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:36.726060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:36.726060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:36.726060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:36.726910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:36.726910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:36.726910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:36.726910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:36.726910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:36.726910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:36.726910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:36.726910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:36.726910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:36.726910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:36.726910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:20:36.726910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:36.726910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 269/557] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 31 12:20:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:36.727681 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98500bff-43fd-4412-b2a4-1dd5c3894367 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:36.735006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc852a8-eb33-406c-932c-cc5b6718bfea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:36.736894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc852a8-eb33-406c-932c-cc5b6718bfea None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:36.753759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-2bc852a8-eb33-406c-932c-cc5b6718bfea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:36.753759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:36.753759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:36.753759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:36.753759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:36.753759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:36.753759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:36.753759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:36.753759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:36.753759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:36.753759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:36.753759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:36.753759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:36.753759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:36.753759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:36.753759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:36.755066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:36.755066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:36.755066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:36.755066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:36.755066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:36.755066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:36.755066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:36.755066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:36.755066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:36.755066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:36.755066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:36.755066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:36.755066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:36.755066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:36.755066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:36.755066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:36.755066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:36.755950 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:36.755950 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:36.755950 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:36.758710 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 289/558] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:36.759919 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc852a8-eb33-406c-932c-cc5b6718bfea None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:36.798333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:36.839865 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98500bff-43fd-4412-b2a4-1dd5c3894367 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:36.864287 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:36.880100 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3cb4a-b720-4706-a7fe-744f1d0d19e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:36.880718 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3cb4a-b720-4706-a7fe-744f1d0d19e9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:36.880986 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3cb4a-b720-4706-a7fe-744f1d0d19e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:36.881290 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3cb4a-b720-4706-a7fe-744f1d0d19e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:36.881992 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3cb4a-b720-4706-a7fe-744f1d0d19e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:36.882815 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3cb4a-b720-4706-a7fe-744f1d0d19e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:36.884240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3cb4a-b720-4706-a7fe-744f1d0d19e9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:36.895892 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc852a8-eb33-406c-932c-cc5b6718bfea None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:36.901411 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 270/559] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:20:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:36.902410 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3cb4a-b720-4706-a7fe-744f1d0d19e9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:36.941780 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87aad14-883b-45cd-831e-b165e0905001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:36.943179 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87aad14-883b-45cd-831e-b165e0905001 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:36.944467 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87aad14-883b-45cd-831e-b165e0905001 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:36.945431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87aad14-883b-45cd-831e-b165e0905001 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:36.946254 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87aad14-883b-45cd-831e-b165e0905001 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:36.946757 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87aad14-883b-45cd-831e-b165e0905001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:36.948328 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87aad14-883b-45cd-831e-b165e0905001 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:36.963785 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 290/560] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:20:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:36.964892 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87aad14-883b-45cd-831e-b165e0905001 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:37.016402 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3cb4a-b720-4706-a7fe-744f1d0d19e9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:37.052046 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6c920-0074-463a-9baa-6d2da5517060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:37.052867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6c920-0074-463a-9baa-6d2da5517060 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:37.053295 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6c920-0074-463a-9baa-6d2da5517060 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:37.053745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6c920-0074-463a-9baa-6d2da5517060 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:37.055216 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6c920-0074-463a-9baa-6d2da5517060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:37.055358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6c920-0074-463a-9baa-6d2da5517060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:37.056811 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6c920-0074-463a-9baa-6d2da5517060 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:37.073830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 271/561] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:37.074949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6c920-0074-463a-9baa-6d2da5517060 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:37.089368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:37.098305 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87aad14-883b-45cd-831e-b165e0905001 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:37.128173 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:37.141160 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8af68-f407-4bd5-9dd9-fcb5b853e24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:37.142354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8af68-f407-4bd5-9dd9-fcb5b853e24c None admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:37.142778 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8af68-f407-4bd5-9dd9-fcb5b853e24c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:37.143472 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8af68-f407-4bd5-9dd9-fcb5b853e24c None admin] PATH_INFO: `/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/188c4989dcfb4f99a04c3349e1a882d1/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:37.145984 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8af68-f407-4bd5-9dd9-fcb5b853e24c None admin] RBAC: Authorizing `identity:create_grant(project_id=786ee416a639447ab3698d1f56d04e9a, user_id=188c4989dcfb4f99a04c3349e1a882d1, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:37.147995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8af68-f407-4bd5-9dd9-fcb5b853e24c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:37.166286 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 291/562] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:20:36 2022] PUT /identity/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/188c4989dcfb4f99a04c3349e1a882d1/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:20:37.167422 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8af68-f407-4bd5-9dd9-fcb5b853e24c None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:37.220180 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6c920-0074-463a-9baa-6d2da5517060 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:37.262868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bae70-39d5-4a25-b382-0c5e6887e5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:37.263740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bae70-39d5-4a25-b382-0c5e6887e5fc None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:37.264163 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bae70-39d5-4a25-b382-0c5e6887e5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:37.264576 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bae70-39d5-4a25-b382-0c5e6887e5fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:37.280183 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bae70-39d5-4a25-b382-0c5e6887e5fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:37.281875 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bae70-39d5-4a25-b382-0c5e6887e5fc None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:37.303567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-cc7bae70-39d5-4a25-b382-0c5e6887e5fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:37.303567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:37.303567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:37.303567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:37.303567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:37.303567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:37.303567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:37.303567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:37.303567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:37.303567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:37.303567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:37.303567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:37.303567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:37.303567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:37.303567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:37.303567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:37.305322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:37.305322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:37.305322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:37.305322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:37.305322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:37.305322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:37.305322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:37.305322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:37.305322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:37.305322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:37.305322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:37.305322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:37.305322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:37.305322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:37.305322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:37.305322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:37.305322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:37.306234 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:37.306234 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:37.306234 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:37.313237 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 272/563] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:37.314864 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bae70-39d5-4a25-b382-0c5e6887e5fc None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:37.409599 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8af68-f407-4bd5-9dd9-fcb5b853e24c None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:37.458380 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:37.458977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ff7c3-5ceb-45c9-a363-89b91ff8f172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:37.460139 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ff7c3-5ceb-45c9-a363-89b91ff8f172 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:37.460942 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ff7c3-5ceb-45c9-a363-89b91ff8f172 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:37.461416 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ff7c3-5ceb-45c9-a363-89b91ff8f172 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:37.468404 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bae70-39d5-4a25-b382-0c5e6887e5fc None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:37.471869 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ff7c3-5ceb-45c9-a363-89b91ff8f172 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:37.473545 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ff7c3-5ceb-45c9-a363-89b91ff8f172 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:37.488781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-f89ff7c3-5ceb-45c9-a363-89b91ff8f172 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:37.488781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:37.488781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:37.488781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:37.488781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:37.488781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:37.488781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:37.488781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:37.488781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:37.488781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:37.488781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:37.488781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:37.488781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:20:37.488781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:20:37.488781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:20:37.489700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:20:37.489700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:37.489700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:37.489700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:37.489700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:37.489700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:37.489700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:37.489700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:37.489700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:37.489700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:37.489700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:37.489700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:37.489700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:37.489700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:37.489700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:37.489700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:37.489700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:37.490578 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:20:37.490578 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:20:37.490578 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:20:37.490578 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:20:37.490578 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:20:37.490578 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:20:37.490578 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:37.490578 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:37.493664 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 292/564] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:37.501408 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ff7c3-5ceb-45c9-a363-89b91ff8f172 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:37.519930 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3b201-b709-4111-b074-14a296dfdb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:37.520548 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3b201-b709-4111-b074-14a296dfdb46 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:37.520832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3b201-b709-4111-b074-14a296dfdb46 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:37.521129 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3b201-b709-4111-b074-14a296dfdb46 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:37.522054 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3b201-b709-4111-b074-14a296dfdb46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:37.522364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3b201-b709-4111-b074-14a296dfdb46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:37.523759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:37.525742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3b201-b709-4111-b074-14a296dfdb46 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:37.550364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 273/565] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:37.556325 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3b201-b709-4111-b074-14a296dfdb46 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:37.669357 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3b201-b709-4111-b074-14a296dfdb46 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:37.705269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e306ed1-a6e9-4d28-b4f5-337ce58205f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:37.706249 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e306ed1-a6e9-4d28-b4f5-337ce58205f4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:37.706750 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e306ed1-a6e9-4d28-b4f5-337ce58205f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:37.707252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e306ed1-a6e9-4d28-b4f5-337ce58205f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:37.715059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e306ed1-a6e9-4d28-b4f5-337ce58205f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:37.716748 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e306ed1-a6e9-4d28-b4f5-337ce58205f4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:37.729480 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-5e306ed1-a6e9-4d28-b4f5-337ce58205f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 12:20:37.729480 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:37.729480 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:37.729480 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:37.729480 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:37.729480 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:37.729480 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:37.729480 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:37.729480 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:37.729480 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:37.729480 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:37.729480 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:37.729480 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:20:37.729480 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:20:37.729480 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:20:37.729480 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:20:37.730429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:37.730429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:37.730429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:20:37.730429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:37.730429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:20:37.730429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:37.730429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:37.730429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:37.730429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:37.730429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:37.730429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:37.730429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:37.730429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:37.730429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:37.730429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:37.730429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:37.730429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:37.730429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:37.731482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:37.731482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:37.731482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:20:37.731482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:20:37.731482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:20:37.731482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:20:37.731482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:20:37.731482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:20:37.731482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 12:20:37.731482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:37.738411 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 274/566] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Oct 31 12:20:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:20:37.740377 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e306ed1-a6e9-4d28-b4f5-337ce58205f4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:37.755904 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ff7c3-5ceb-45c9-a363-89b91ff8f172 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:37.773786 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:37.829764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bd21a-53f8-4d6e-8116-3716f2c4c09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:37.830301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bd21a-53f8-4d6e-8116-3716f2c4c09c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:37.830638 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bd21a-53f8-4d6e-8116-3716f2c4c09c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:37.830914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bd21a-53f8-4d6e-8116-3716f2c4c09c None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:37.831669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bd21a-53f8-4d6e-8116-3716f2c4c09c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:37.832058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bd21a-53f8-4d6e-8116-3716f2c4c09c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:37.833723 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bd21a-53f8-4d6e-8116-3716f2c4c09c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:37.856435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 293/567] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:20:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:37.866244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bd21a-53f8-4d6e-8116-3716f2c4c09c None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:37.866970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e306ed1-a6e9-4d28-b4f5-337ce58205f4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:37.903330 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf017c-bd78-4b2b-893e-ad86ad31794e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:37.904721 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf017c-bd78-4b2b-893e-ad86ad31794e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:37.905250 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf017c-bd78-4b2b-893e-ad86ad31794e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:37.905740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf017c-bd78-4b2b-893e-ad86ad31794e None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:37.906761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf017c-bd78-4b2b-893e-ad86ad31794e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:37.907277 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf017c-bd78-4b2b-893e-ad86ad31794e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:37.908956 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf017c-bd78-4b2b-893e-ad86ad31794e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:37.933546 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 275/568] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Oct 31 12:20:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:37.935660 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf017c-bd78-4b2b-893e-ad86ad31794e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:37.987492 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:38.020154 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bd21a-53f8-4d6e-8116-3716f2c4c09c None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:38.025181 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:38.052333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf017c-bd78-4b2b-893e-ad86ad31794e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:38.058402 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6399d12-24fb-45e8-ad69-dbe7fbdbbf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:38.059066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6399d12-24fb-45e8-ad69-dbe7fbdbbf51 None admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:38.059349 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6399d12-24fb-45e8-ad69-dbe7fbdbbf51 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:38.059677 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6399d12-24fb-45e8-ad69-dbe7fbdbbf51 None admin] PATH_INFO: `/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/912693f459f147a5a479ad01e2e8387a/roles/df935cf8a7f24352ba94fe83718280ea` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:38.095379 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6399d12-24fb-45e8-ad69-dbe7fbdbbf51 None admin] RBAC: Authorizing `identity:create_grant(project_id=786ee416a639447ab3698d1f56d04e9a, user_id=912693f459f147a5a479ad01e2e8387a, role_id=df935cf8a7f24352ba94fe83718280ea)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:38.097632 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6399d12-24fb-45e8-ad69-dbe7fbdbbf51 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:38.102037 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e70a7-cac1-4daf-a676-0caf61e5aeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:38.102886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e70a7-cac1-4daf-a676-0caf61e5aeb5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:38.103429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e70a7-cac1-4daf-a676-0caf61e5aeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:38.103763 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e70a7-cac1-4daf-a676-0caf61e5aeb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:38.114187 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 294/569] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:20:37 2022] PUT /identity/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/912693f459f147a5a479ad01e2e8387a/roles/df935cf8a7f24352ba94fe83718280ea => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:20:38.182465 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e70a7-cac1-4daf-a676-0caf61e5aeb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:38.183967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e70a7-cac1-4daf-a676-0caf61e5aeb5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:38.270145 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:38.308575 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 276/570] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:20:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 12:20:38.313874 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6399d12-24fb-45e8-ad69-dbe7fbdbbf51 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:38.348415 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e743a6-5185-480a-adf8-8f6c6b942230 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:38.349020 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e743a6-5185-480a-adf8-8f6c6b942230 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:38.349535 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e743a6-5185-480a-adf8-8f6c6b942230 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:38.351092 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 277/571] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:20:38.356333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cd02f-f489-46f9-81aa-34a4453553fe None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:38.356616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cd02f-f489-46f9-81aa-34a4453553fe None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:38.356888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cd02f-f489-46f9-81aa-34a4453553fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:38.384899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-354cd02f-f489-46f9-81aa-34a4453553fe None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:38.386460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-354cd02f-f489-46f9-81aa-34a4453553fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:38.446005 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6399d12-24fb-45e8-ad69-dbe7fbdbbf51 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:38.467832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 278/572] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 12:20:38.480755 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:38.494663 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18b6dc-f71c-4377-82eb-89e4b9f66ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:38.495351 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18b6dc-f71c-4377-82eb-89e4b9f66ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:38.495634 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18b6dc-f71c-4377-82eb-89e4b9f66ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:38.495978 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18b6dc-f71c-4377-82eb-89e4b9f66ca3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:38.508512 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18b6dc-f71c-4377-82eb-89e4b9f66ca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:38.510019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18b6dc-f71c-4377-82eb-89e4b9f66ca3 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:38.528717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-4f18b6dc-f71c-4377-82eb-89e4b9f66ca3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:38.528717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:38.528717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:38.528717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:38.528717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:38.528717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:38.528717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:38.528717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:38.528717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:38.528717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:38.528717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:38.528717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:38.528717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:38.528717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:38.528717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:38.528717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:38.529837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:38.529837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:38.529837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:38.529837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:38.529837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:38.529837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:38.529837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:38.529837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:38.529837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:38.529837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:38.529837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:38.529837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:38.529837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:38.529837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:38.529837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:38.529837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:38.529837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:38.530715 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:38.530715 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:38.530715 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:38.530715 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 295/573] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:38.536252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cd02f-f489-46f9-81aa-34a4453553fe None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:38.681465 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cd02f-f489-46f9-81aa-34a4453553fe None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:38.686057 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:38.732180 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d939f-f37f-437f-b923-78374ac0748f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:38.732800 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d939f-f37f-437f-b923-78374ac0748f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:38.733080 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d939f-f37f-437f-b923-78374ac0748f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:38.733376 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d939f-f37f-437f-b923-78374ac0748f None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:38.734031 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d939f-f37f-437f-b923-78374ac0748f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:38.734331 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d939f-f37f-437f-b923-78374ac0748f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:38.735697 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d939f-f37f-437f-b923-78374ac0748f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:38.752339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 279/574] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:38.758691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18b6dc-f71c-4377-82eb-89e4b9f66ca3 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:38.835972 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d939f-f37f-437f-b923-78374ac0748f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:38.946819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18b6dc-f71c-4377-82eb-89e4b9f66ca3 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:38.984865 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd88ea0-3475-4381-87d0-5065c020c79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:38.985625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd88ea0-3475-4381-87d0-5065c020c79f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:38.985906 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd88ea0-3475-4381-87d0-5065c020c79f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:38.986175 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd88ea0-3475-4381-87d0-5065c020c79f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:38.994156 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd88ea0-3475-4381-87d0-5065c020c79f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:38.995779 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd88ea0-3475-4381-87d0-5065c020c79f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:38.999671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d939f-f37f-437f-b923-78374ac0748f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:39.007914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-ebd88ea0-3475-4381-87d0-5065c020c79f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:39.007914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:39.007914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:39.007914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:39.007914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:39.007914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:39.007914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:39.007914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:39.007914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:39.007914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:39.007914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:39.007914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:39.007914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:20:39.007914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:20:39.007914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:20:39.008820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:20:39.008820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:39.008820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:39.008820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:39.008820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:39.008820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:39.008820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:39.008820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:39.008820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:39.008820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:39.008820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:39.008820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:39.008820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:39.008820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:39.008820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:39.008820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:39.008820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:39.009791 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:20:39.009791 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:20:39.009791 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:20:39.009791 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:20:39.009791 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:20:39.009791 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:20:39.009791 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:39.009791 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:39.009791 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 296/575] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:20:39.014785 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f4f5d-2eaa-4f01-b92c-fc7b893c455b None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:39.015193 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f4f5d-2eaa-4f01-b92c-fc7b893c455b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:39.015478 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f4f5d-2eaa-4f01-b92c-fc7b893c455b None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:39.017007 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 297/576] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:39.019292 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f4f5d-2eaa-4f01-b92c-fc7b893c455b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:39.037299 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2e0f5-420c-44c0-b82a-3a2380b53449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:39.038754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2e0f5-420c-44c0-b82a-3a2380b53449 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:39.039035 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2e0f5-420c-44c0-b82a-3a2380b53449 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:39.039306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2e0f5-420c-44c0-b82a-3a2380b53449 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:39.040164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2e0f5-420c-44c0-b82a-3a2380b53449 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:39.042328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2e0f5-420c-44c0-b82a-3a2380b53449 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:39.059164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-10f2e0f5-420c-44c0-b82a-3a2380b53449 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 12:20:39.059164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:39.059164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:20:39.059164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:20:39.059164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:20:39.059164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:20:39.059164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:20:39.059164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:39.059164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 12:20:39.059164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:39.059164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:20:39.059164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:39.059164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:39.059164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:39.059164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:39.059164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:39.059164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:39.061550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:39.061550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:39.061550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:39.061550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:39.061550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:39.061550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:39.061550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:20:39.061550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:20:39.061550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:20:39.061550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:20:39.061550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:39.061550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:39.061550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:39.061550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:39.061550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:39.061550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:39.063122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:39.063122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:39.063122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:39.063122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:39.063122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:39.063122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:39.063122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:39.063122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:39.063122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:39.063122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:39.063122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:20:39.063122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:39.063122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 12:20:39.063122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:39.063122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 280/577] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Oct 31 12:20:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:39.064469 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81072f-d7e7-40da-9183-440dbee5ddf2 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:39.064469 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81072f-d7e7-40da-9183-440dbee5ddf2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:39.064469 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81072f-d7e7-40da-9183-440dbee5ddf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:39.064820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:39.087290 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9b81072f-d7e7-40da-9183-440dbee5ddf2 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:39.088951 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9b81072f-d7e7-40da-9183-440dbee5ddf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:39.119264 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:39.147532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f4f5d-2eaa-4f01-b92c-fc7b893c455b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:39.174465 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 281/578] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:20:39.175528 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81072f-d7e7-40da-9183-440dbee5ddf2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:39.194123 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf5d9c-362c-43bb-a12f-b697f7346c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:39.195026 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf5d9c-362c-43bb-a12f-b697f7346c4c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:39.195401 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf5d9c-362c-43bb-a12f-b697f7346c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:39.195926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf5d9c-362c-43bb-a12f-b697f7346c4c None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:39.196647 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf5d9c-362c-43bb-a12f-b697f7346c4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:39.197117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf5d9c-362c-43bb-a12f-b697f7346c4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:39.198634 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf5d9c-362c-43bb-a12f-b697f7346c4c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:39.222868 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 298/579] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:20:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:39.229738 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf5d9c-362c-43bb-a12f-b697f7346c4c None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:39.290162 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81072f-d7e7-40da-9183-440dbee5ddf2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:39.329433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c153879-384e-4856-bbb4-129c5c335158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:39.330277 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c153879-384e-4856-bbb4-129c5c335158 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:39.330703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c153879-384e-4856-bbb4-129c5c335158 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:39.331280 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c153879-384e-4856-bbb4-129c5c335158 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:39.332076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c153879-384e-4856-bbb4-129c5c335158 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:39.332523 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c153879-384e-4856-bbb4-129c5c335158 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:39.334350 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c153879-384e-4856-bbb4-129c5c335158 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:39.340351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 282/580] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Oct 31 12:20:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:39.348225 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c153879-384e-4856-bbb4-129c5c335158 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:39.395698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:39.402866 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:39.403811 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf5d9c-362c-43bb-a12f-b697f7346c4c None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:39.448101 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f7b2f-6ee9-47e9-9cca-4ef702b4791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:39.448626 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f7b2f-6ee9-47e9-9cca-4ef702b4791e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:39.448903 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f7b2f-6ee9-47e9-9cca-4ef702b4791e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:39.449194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f7b2f-6ee9-47e9-9cca-4ef702b4791e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:39.450063 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f7b2f-6ee9-47e9-9cca-4ef702b4791e None admin] RBAC: Adding query filter params (role.id=e1b3a811029244d2a7e2664cd3246eec, scope.project.id=786ee416a639447ab3698d1f56d04e9a, user.id=d93ce5759e0648a1934ff4d9c9d8fe61) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:39.450370 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f7b2f-6ee9-47e9-9cca-4ef702b4791e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:39.452652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f7b2f-6ee9-47e9-9cca-4ef702b4791e None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:39.462004 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 299/581] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:20:39 2022] GET /identity/v3/role_assignments?user.id=d93ce5759e0648a1934ff4d9c9d8fe61&scope.project.id=786ee416a639447ab3698d1f56d04e9a&role.id=e1b3a811029244d2a7e2664cd3246eec => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:39.515459 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c153879-384e-4856-bbb4-129c5c335158 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:39.552988 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1441d-969b-454a-9a8e-797c04b532a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:39.553626 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1441d-969b-454a-9a8e-797c04b532a5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:39.553951 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1441d-969b-454a-9a8e-797c04b532a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:39.554220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1441d-969b-454a-9a8e-797c04b532a5 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:39.554857 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1441d-969b-454a-9a8e-797c04b532a5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:39.555154 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1441d-969b-454a-9a8e-797c04b532a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:39.556528 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1441d-969b-454a-9a8e-797c04b532a5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:39.563979 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 283/582] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Oct 31 12:20:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:39.573215 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f7b2f-6ee9-47e9-9cca-4ef702b4791e None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:39.625635 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1441d-969b-454a-9a8e-797c04b532a5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:39.688515 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f7b2f-6ee9-47e9-9cca-4ef702b4791e None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:39.731547 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886183af-470b-4294-92a1-6644e28a18a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:39.732680 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886183af-470b-4294-92a1-6644e28a18a7 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:39.734155 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886183af-470b-4294-92a1-6644e28a18a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:39.735677 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886183af-470b-4294-92a1-6644e28a18a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:39.736644 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886183af-470b-4294-92a1-6644e28a18a7 None admin] RBAC: Adding query filter params (interface=public, service_id=79378dcd48f74568a45f46c3198ad396, region_id=RegionOne) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:39.738482 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886183af-470b-4294-92a1-6644e28a18a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:39.740164 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886183af-470b-4294-92a1-6644e28a18a7 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:39.743863 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:39.758002 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 300/583] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Oct 31 12:20:39 2022] GET /identity/v3/endpoints?service_id=79378dcd48f74568a45f46c3198ad396&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:39.765731 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886183af-470b-4294-92a1-6644e28a18a7 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:39.783027 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1441d-969b-454a-9a8e-797c04b532a5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:39.803912 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:39.825083 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ceaa5-a7ae-4cdd-887e-2578362946b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:39.825741 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ceaa5-a7ae-4cdd-887e-2578362946b0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:39.826015 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ceaa5-a7ae-4cdd-887e-2578362946b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:39.826386 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ceaa5-a7ae-4cdd-887e-2578362946b0 None admin] PATH_INFO: `/v3/services/network` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:39.826973 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ceaa5-a7ae-4cdd-887e-2578362946b0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:39.828325 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ceaa5-a7ae-4cdd-887e-2578362946b0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:39.838657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-8e4ceaa5-a7ae-4cdd-887e-2578362946b0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 12:20:39.838657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:39.838657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:20:39.838657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:20:39.838657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:20:39.838657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:20:39.838657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:20:39.838657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:39.838657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 12:20:39.838657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:39.838657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:20:39.838657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:39.838657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:39.838657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:39.838657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:39.838657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:39.838657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:39.839778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:39.839778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:39.839778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:39.839778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:39.839778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:39.839778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:39.839778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:20:39.839778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:20:39.839778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:20:39.839778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:20:39.839778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:39.839778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:39.839778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:39.839778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:39.839778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:39.839778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:39.840708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:39.840708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:39.840708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:39.840708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:39.840708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:39.840708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:39.840708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:39.840708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:39.840708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:39.840708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:39.840708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:20:39.840708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:39.840708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 12:20:39.840708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:39.840708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 284/584] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:39 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:39.846533 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ceaa5-a7ae-4cdd-887e-2578362946b0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:39.906366 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886183af-470b-4294-92a1-6644e28a18a7 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:39.947765 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5d63f-1aa9-40cf-86b0-5e7a098b2a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:39.948618 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5d63f-1aa9-40cf-86b0-5e7a098b2a09 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:39.948618 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5d63f-1aa9-40cf-86b0-5e7a098b2a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:39.948895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5d63f-1aa9-40cf-86b0-5e7a098b2a09 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:39.949548 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5d63f-1aa9-40cf-86b0-5e7a098b2a09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:39.950958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5d63f-1aa9-40cf-86b0-5e7a098b2a09 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:39.956486 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 301/585] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Oct 31 12:20:39 2022] GET /identity/v3/services => generated 772 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:39.970402 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650474c-568d-4526-b36c-24753ff1ab7d None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:39.970739 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650474c-568d-4526-b36c-24753ff1ab7d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:39.970952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650474c-568d-4526-b36c-24753ff1ab7d None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:39.972487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 302/586] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:20:39.978608 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69169c1c-1b4c-4b19-8245-81b86d1b5207 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:39.979115 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69169c1c-1b4c-4b19-8245-81b86d1b5207 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:39.979540 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69169c1c-1b4c-4b19-8245-81b86d1b5207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:39.986757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ceaa5-a7ae-4cdd-887e-2578362946b0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:40.001320 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-69169c1c-1b4c-4b19-8245-81b86d1b5207 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:40.003330 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-69169c1c-1b4c-4b19-8245-81b86d1b5207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:40.025015 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91218859-e974-4af9-a5fd-d2b367b7efed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:40.025787 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91218859-e974-4af9-a5fd-d2b367b7efed None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:40.026137 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91218859-e974-4af9-a5fd-d2b367b7efed None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:40.026477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91218859-e974-4af9-a5fd-d2b367b7efed None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:40.027187 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91218859-e974-4af9-a5fd-d2b367b7efed None admin] RBAC: Adding query filter params (name=network) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:40.027558 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91218859-e974-4af9-a5fd-d2b367b7efed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:40.029538 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91218859-e974-4af9-a5fd-d2b367b7efed None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:40.038228 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 285/587] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 31 12:20:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:40.049172 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91218859-e974-4af9-a5fd-d2b367b7efed None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:40.076958 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:40.128933 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 303/588] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 12:20:40.193591 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91218859-e974-4af9-a5fd-d2b367b7efed None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:40.228858 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117303a-dd29-447e-bee2-adecb464bba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:40.229556 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117303a-dd29-447e-bee2-adecb464bba8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:40.229842 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117303a-dd29-447e-bee2-adecb464bba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:40.230176 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117303a-dd29-447e-bee2-adecb464bba8 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:40.230813 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117303a-dd29-447e-bee2-adecb464bba8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:40.231119 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117303a-dd29-447e-bee2-adecb464bba8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:40.232494 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117303a-dd29-447e-bee2-adecb464bba8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:40.238172 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 286/589] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 31 12:20:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:40.244004 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69169c1c-1b4c-4b19-8245-81b86d1b5207 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:40.272380 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:40.371551 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69169c1c-1b4c-4b19-8245-81b86d1b5207 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:40.407016 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43df53f-d136-4ac2-8f49-c96bebfaee65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:40.407683 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43df53f-d136-4ac2-8f49-c96bebfaee65 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:40.407963 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43df53f-d136-4ac2-8f49-c96bebfaee65 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:40.408231 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43df53f-d136-4ac2-8f49-c96bebfaee65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:40.408935 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43df53f-d136-4ac2-8f49-c96bebfaee65 None admin] RBAC: Adding query filter params (interface=public, service_id=01210132b4ab4ec49b9934b32653e0fc, region_id=RegionOne) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:40.409267 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43df53f-d136-4ac2-8f49-c96bebfaee65 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:40.410882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43df53f-d136-4ac2-8f49-c96bebfaee65 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:40.416500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 304/590] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Oct 31 12:20:40 2022] GET /identity/v3/endpoints?service_id=01210132b4ab4ec49b9934b32653e0fc&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:40.422043 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117303a-dd29-447e-bee2-adecb464bba8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:40.456088 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43df53f-d136-4ac2-8f49-c96bebfaee65 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:40.555526 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:40.576591 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43df53f-d136-4ac2-8f49-c96bebfaee65 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:40.578651 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:40.617308 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3082616-239c-486b-96db-356480c39536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:40.618321 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3082616-239c-486b-96db-356480c39536 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:40.619212 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3082616-239c-486b-96db-356480c39536 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:40.619676 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3082616-239c-486b-96db-356480c39536 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:40.632429 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3082616-239c-486b-96db-356480c39536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:40.638797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-b3082616-239c-486b-96db-356480c39536 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:20:40.638797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:40.638797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:40.638797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:40.638797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:40.638797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:40.638797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:40.638797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:40.638797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:40.638797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:40.638797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:40.638797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:40.638797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:40.638797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:40.638797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:40.638797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:40.639805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:40.639805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:40.639805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:40.639805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:40.639805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:40.639805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:40.639805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:40.639805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:40.639805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:40.639805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:40.639805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:40.639805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:40.639805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:40.639805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:40.639805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:40.639805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:40.640680 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:40.640680 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:40.640680 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:40.640680 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:40.640680 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:40.640680 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:40.640680 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:40.640680 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:40.640680 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:40.640680 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:40.640680 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:20:40.640680 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:40.649985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 305/591] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 31 12:20:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:40.651908 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3082616-239c-486b-96db-356480c39536 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:40.659251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117303a-dd29-447e-bee2-adecb464bba8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:40.751246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea06ef2-a86e-4826-8bf0-fe35404056d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:40.751870 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea06ef2-a86e-4826-8bf0-fe35404056d9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:40.752154 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea06ef2-a86e-4826-8bf0-fe35404056d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:40.752434 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea06ef2-a86e-4826-8bf0-fe35404056d9 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:40.753045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea06ef2-a86e-4826-8bf0-fe35404056d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:40.754481 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea06ef2-a86e-4826-8bf0-fe35404056d9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:40.765842 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 287/592] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Oct 31 12:20:40 2022] GET /identity/v3/services => generated 772 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:40.766374 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3082616-239c-486b-96db-356480c39536 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:40.772321 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ece47-bfe5-4ca9-8520-3cfcd289bf1c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:40.772321 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ece47-bfe5-4ca9-8520-3cfcd289bf1c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:40.772321 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ece47-bfe5-4ca9-8520-3cfcd289bf1c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:40.772321 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 288/593] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:20:40.785697 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df81e5-a685-47f3-af68-5f133c89d563 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:40.785977 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df81e5-a685-47f3-af68-5f133c89d563 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:40.786271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df81e5-a685-47f3-af68-5f133c89d563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:40.815521 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-11df81e5-a685-47f3-af68-5f133c89d563 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:40.816686 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-11df81e5-a685-47f3-af68-5f133c89d563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:40.821534 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233108cf-40ea-45f8-8a49-f72d3e662530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:40.822165 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233108cf-40ea-45f8-8a49-f72d3e662530 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:40.822446 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233108cf-40ea-45f8-8a49-f72d3e662530 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:40.822722 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233108cf-40ea-45f8-8a49-f72d3e662530 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:40.823409 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233108cf-40ea-45f8-8a49-f72d3e662530 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:40.823723 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233108cf-40ea-45f8-8a49-f72d3e662530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:40.825198 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233108cf-40ea-45f8-8a49-f72d3e662530 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:40.845061 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 306/594] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:20:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:40.851310 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233108cf-40ea-45f8-8a49-f72d3e662530 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:40.857476 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:40.982813 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 289/595] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:20:41.032671 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233108cf-40ea-45f8-8a49-f72d3e662530 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:41.070573 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e81b12-ef55-4742-84ab-438f88e56900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:41.071141 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e81b12-ef55-4742-84ab-438f88e56900 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:41.071422 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e81b12-ef55-4742-84ab-438f88e56900 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:41.071691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e81b12-ef55-4742-84ab-438f88e56900 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:41.084524 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e81b12-ef55-4742-84ab-438f88e56900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:41.086121 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e81b12-ef55-4742-84ab-438f88e56900 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:41.109971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-00e81b12-ef55-4742-84ab-438f88e56900 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:41.109971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:41.109971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:41.109971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:41.109971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:41.109971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:41.109971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:41.109971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:41.109971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:41.109971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:41.109971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:41.109971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:41.109971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:41.109971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:41.109971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:41.109971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:41.110959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:41.110959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:41.110959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:41.110959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:41.110959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:41.110959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:41.110959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:41.110959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:41.110959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:41.110959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:41.110959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:41.110959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:41.110959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:41.110959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:41.110959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:41.110959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:41.110959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:41.111871 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:41.111871 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:41.111871 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:41.111871 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 307/596] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:20:41.117408 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df81e5-a685-47f3-af68-5f133c89d563 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:41.242997 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:41.295756 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df81e5-a685-47f3-af68-5f133c89d563 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:41.387239 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de9a86-b54f-44f2-9e4e-cfcc91add249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:41.387868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de9a86-b54f-44f2-9e4e-cfcc91add249 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:41.388149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de9a86-b54f-44f2-9e4e-cfcc91add249 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:41.388421 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de9a86-b54f-44f2-9e4e-cfcc91add249 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:41.389078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de9a86-b54f-44f2-9e4e-cfcc91add249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:41.389407 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de9a86-b54f-44f2-9e4e-cfcc91add249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:41.390778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de9a86-b54f-44f2-9e4e-cfcc91add249 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:41.416192 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 290/597] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:41.422445 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e81b12-ef55-4742-84ab-438f88e56900 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:41.445186 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de9a86-b54f-44f2-9e4e-cfcc91add249 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:41.533577 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:41.635573 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e81b12-ef55-4742-84ab-438f88e56900 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:41.660196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de9a86-b54f-44f2-9e4e-cfcc91add249 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:41.712215 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14897bac-ee1c-4a6e-81a2-7e4b0ba955b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:41.713039 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14897bac-ee1c-4a6e-81a2-7e4b0ba955b2 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:41.714399 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14897bac-ee1c-4a6e-81a2-7e4b0ba955b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:41.714681 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14897bac-ee1c-4a6e-81a2-7e4b0ba955b2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:41.725292 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:41.732188 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14897bac-ee1c-4a6e-81a2-7e4b0ba955b2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:41.734771 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14897bac-ee1c-4a6e-81a2-7e4b0ba955b2 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:41.736136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43246509-e1c8-4de7-8579-d681fdfb37f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:41.736776 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43246509-e1c8-4de7-8579-d681fdfb37f9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:41.737058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43246509-e1c8-4de7-8579-d681fdfb37f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:41.737360 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43246509-e1c8-4de7-8579-d681fdfb37f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:41.760769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-14897bac-ee1c-4a6e-81a2-7e4b0ba955b2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 31 12:20:41.760769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:41.760769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:41.760769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:41.760769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:41.760769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:41.760769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:41.760769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:41.760769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:41.760769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:41.760769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:41.760769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:41.760769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:20:41.760769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:20:41.760769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:20:41.760769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:20:41.761834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:41.761834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:41.761834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:20:41.761834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:41.761834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:20:41.761834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:41.761834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:41.761834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:41.761834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:41.761834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:41.761834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:41.761834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:41.761834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:41.761834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:41.761834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:41.761834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:41.761834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:41.761834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:41.762839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:41.762839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:41.762839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:20:41.762839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:20:41.762839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:20:41.762839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:20:41.762839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:20:41.762839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:20:41.762839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 31 12:20:41.762839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:41.762839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 308/598] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 31 12:20:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:41.764584 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43246509-e1c8-4de7-8579-d681fdfb37f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:41.770293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-43246509-e1c8-4de7-8579-d681fdfb37f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:41.770293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:41.770293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:41.770293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:41.770293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:41.770293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:41.770293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:41.770293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:41.770293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:41.770293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:41.770293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:41.770293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:41.770293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:41.770293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:41.770293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:41.770293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:41.771217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:41.771217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:41.771217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:41.771217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:41.771217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:41.771217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:41.771217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:41.771217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:41.771217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:41.771217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:41.771217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:41.771217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:41.771217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:41.771217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:41.771217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:41.771217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:41.772059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:41.772059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:41.772059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:41.772059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:41.772059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:41.772059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:41.772059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:41.772059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:41.772059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:41.772059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:41.772059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:20:41.772059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:41.773912 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14897bac-ee1c-4a6e-81a2-7e4b0ba955b2 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:41.779171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 291/599] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 31 12:20:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:41.784545 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43246509-e1c8-4de7-8579-d681fdfb37f9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:41.952049 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43246509-e1c8-4de7-8579-d681fdfb37f9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:41.969057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14897bac-ee1c-4a6e-81a2-7e4b0ba955b2 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:41.997581 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:42.016840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b09b97-8024-449f-ab2d-e9da9028aa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:42.017472 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b09b97-8024-449f-ab2d-e9da9028aa94 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:42.017748 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b09b97-8024-449f-ab2d-e9da9028aa94 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:42.018018 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b09b97-8024-449f-ab2d-e9da9028aa94 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:42.018688 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b09b97-8024-449f-ab2d-e9da9028aa94 None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:42.018987 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b09b97-8024-449f-ab2d-e9da9028aa94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:42.020349 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b09b97-8024-449f-ab2d-e9da9028aa94 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:42.034513 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c97be-022e-4f6c-ac47-1d3941b184c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:42.035366 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c97be-022e-4f6c-ac47-1d3941b184c6 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:42.035635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c97be-022e-4f6c-ac47-1d3941b184c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:42.035901 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c97be-022e-4f6c-ac47-1d3941b184c6 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:42.036707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c97be-022e-4f6c-ac47-1d3941b184c6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:42.037008 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c97be-022e-4f6c-ac47-1d3941b184c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:42.038488 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c97be-022e-4f6c-ac47-1d3941b184c6 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:42.040370 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 292/600] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 31 12:20:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:42.042203 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b09b97-8024-449f-ab2d-e9da9028aa94 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:42.089286 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 309/601] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Oct 31 12:20:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:42.090714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c97be-022e-4f6c-ac47-1d3941b184c6 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:42.150993 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:42.225151 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b09b97-8024-449f-ab2d-e9da9028aa94 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:42.307244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c97be-022e-4f6c-ac47-1d3941b184c6 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:42.309367 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82431be-3814-4ce9-b2d5-b7d608233503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:42.312280 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82431be-3814-4ce9-b2d5-b7d608233503 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:42.312854 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82431be-3814-4ce9-b2d5-b7d608233503 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:42.313779 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82431be-3814-4ce9-b2d5-b7d608233503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:42.339644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82431be-3814-4ce9-b2d5-b7d608233503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:42.341720 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82431be-3814-4ce9-b2d5-b7d608233503 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:42.367293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9498e-a9f9-4907-9d25-18363630aad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:42.368213 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9498e-a9f9-4907-9d25-18363630aad8 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:42.368496 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9498e-a9f9-4907-9d25-18363630aad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:42.368772 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9498e-a9f9-4907-9d25-18363630aad8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:42.387701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-e82431be-3814-4ce9-b2d5-b7d608233503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:42.387701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:42.387701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:42.387701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:42.387701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:42.387701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:42.387701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:42.387701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:42.387701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:42.387701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:42.387701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:42.387701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:42.387701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:42.387701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:42.387701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:42.387701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:42.388770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:42.388770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:42.388770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:42.388770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:42.388770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:42.388770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:42.388770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:42.388770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:42.388770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:42.388770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:42.388770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:42.388770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:42.388770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:42.388770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:42.388770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:42.388770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:42.388770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:42.389797 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:42.389797 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:42.389797 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:42.390726 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 293/602] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:42.396439 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82431be-3814-4ce9-b2d5-b7d608233503 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:42.449736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:42.483291 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9498e-a9f9-4907-9d25-18363630aad8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:42.484679 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9498e-a9f9-4907-9d25-18363630aad8 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:42.525090 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82431be-3814-4ce9-b2d5-b7d608233503 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:42.534241 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:42.566146 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680958b1-125e-4fac-8e5a-629548a18c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:42.567238 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680958b1-125e-4fac-8e5a-629548a18c1c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:42.567732 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680958b1-125e-4fac-8e5a-629548a18c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:42.568230 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680958b1-125e-4fac-8e5a-629548a18c1c None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:42.569087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680958b1-125e-4fac-8e5a-629548a18c1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:42.569673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680958b1-125e-4fac-8e5a-629548a18c1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:42.571228 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680958b1-125e-4fac-8e5a-629548a18c1c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:42.585371 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 294/603] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:42.590757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f0786-56ac-4e79-a3b2-064587dd5d40 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:42.591148 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f0786-56ac-4e79-a3b2-064587dd5d40 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:42.591526 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f0786-56ac-4e79-a3b2-064587dd5d40 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:42.597157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 295/604] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:42.597157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f0786-56ac-4e79-a3b2-064587dd5d40 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:42.606217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 310/605] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:20:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 12:20:42.607778 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5582de-608e-4cf8-bf39-180bb245358f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:42.608223 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5582de-608e-4cf8-bf39-180bb245358f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:42.608656 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5582de-608e-4cf8-bf39-180bb245358f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:42.628299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ad5582de-608e-4cf8-bf39-180bb245358f None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:42.629983 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ad5582de-608e-4cf8-bf39-180bb245358f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:42.699196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f0786-56ac-4e79-a3b2-064587dd5d40 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:42.704631 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 311/606] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:20:42.705643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5582de-608e-4cf8-bf39-180bb245358f None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:42.714475 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:42.743685 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708001a8-c0a6-4a20-8688-a907af9abfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:42.744224 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708001a8-c0a6-4a20-8688-a907af9abfe7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:42.744561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708001a8-c0a6-4a20-8688-a907af9abfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:42.744838 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708001a8-c0a6-4a20-8688-a907af9abfe7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:42.752754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708001a8-c0a6-4a20-8688-a907af9abfe7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:42.754466 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708001a8-c0a6-4a20-8688-a907af9abfe7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:42.768757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-708001a8-c0a6-4a20-8688-a907af9abfe7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 12:20:42.768757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:42.768757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:42.768757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:42.768757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:42.768757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:42.768757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:42.768757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:42.768757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:42.768757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:42.768757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:42.768757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:42.768757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:20:42.768757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:20:42.768757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:20:42.768757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:20:42.769989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:42.769989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:42.769989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:20:42.769989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:42.769989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:20:42.769989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:42.769989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:42.769989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:42.769989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:42.769989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:42.769989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:42.769989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:42.769989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:42.769989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:42.769989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:42.769989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:42.769989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:42.769989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:42.771204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:42.771204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:42.771204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:20:42.771204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:20:42.771204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:20:42.771204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:20:42.771204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:20:42.771204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:20:42.771204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 12:20:42.771204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:42.775314 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 296/607] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Oct 31 12:20:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:20:42.776548 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccaadb-bf05-4211-86fb-5707670d82e7 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:42.777229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccaadb-bf05-4211-86fb-5707670d82e7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:42.777229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccaadb-bf05-4211-86fb-5707670d82e7 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:42.778678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 297/608] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:42.779392 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccaadb-bf05-4211-86fb-5707670d82e7 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:42.808359 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:42.861871 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5582de-608e-4cf8-bf39-180bb245358f None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:42.906026 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba14be-833e-4253-a40b-2ee25c26e91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:42.907012 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccaadb-bf05-4211-86fb-5707670d82e7 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:42.907265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba14be-833e-4253-a40b-2ee25c26e91b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:42.907733 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba14be-833e-4253-a40b-2ee25c26e91b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:42.908198 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba14be-833e-4253-a40b-2ee25c26e91b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:42.923211 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba14be-833e-4253-a40b-2ee25c26e91b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:42.925574 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba14be-833e-4253-a40b-2ee25c26e91b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:42.943521 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc111c2b-0f8d-4abb-a0d1-24cbe370c725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:42.944775 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc111c2b-0f8d-4abb-a0d1-24cbe370c725 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:42.945133 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc111c2b-0f8d-4abb-a0d1-24cbe370c725 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:42.945557 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc111c2b-0f8d-4abb-a0d1-24cbe370c725 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:42.946392 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc111c2b-0f8d-4abb-a0d1-24cbe370c725 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:42.946765 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc111c2b-0f8d-4abb-a0d1-24cbe370c725 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:42.948137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-13ba14be-833e-4253-a40b-2ee25c26e91b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:42.948137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:42.948137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:42.948137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:42.948137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:42.948137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:42.948137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:42.948137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:42.948137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:42.948137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:42.948137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:42.948137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:42.948137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:42.948137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:42.948137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:42.948137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:42.949042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:42.949042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:42.949042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:42.949042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:42.949042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:42.949042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:42.949042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:42.949042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:42.949042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:42.949042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:42.949042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:42.949042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:42.949042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:42.949042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:42.949042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:42.949042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:42.949042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:42.949979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:42.949979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:42.949979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:42.950152 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc111c2b-0f8d-4abb-a0d1-24cbe370c725 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:42.950641 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 312/609] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:42.951625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c9fc9-eebf-4be0-a74e-abc6d07fe340 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:42.951911 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c9fc9-eebf-4be0-a74e-abc6d07fe340 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:42.952183 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c9fc9-eebf-4be0-a74e-abc6d07fe340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:42.977488 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 298/610] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Oct 31 12:20:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:42.978618 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc111c2b-0f8d-4abb-a0d1-24cbe370c725 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:42.986144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d45c9fc9-eebf-4be0-a74e-abc6d07fe340 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:42.987466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d45c9fc9-eebf-4be0-a74e-abc6d07fe340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:43.042449 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:43.060870 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 313/611] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:20:43.070601 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c9fc9-eebf-4be0-a74e-abc6d07fe340 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:43.077475 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:43.096059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc111c2b-0f8d-4abb-a0d1-24cbe370c725 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:43.137222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca188b-2483-4c84-a7e6-9ec94f795a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:43.138077 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca188b-2483-4c84-a7e6-9ec94f795a55 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:43.138673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca188b-2483-4c84-a7e6-9ec94f795a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:43.139119 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca188b-2483-4c84-a7e6-9ec94f795a55 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:43.140321 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca188b-2483-4c84-a7e6-9ec94f795a55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:43.141083 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca188b-2483-4c84-a7e6-9ec94f795a55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:43.142869 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca188b-2483-4c84-a7e6-9ec94f795a55 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:43.158422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 299/612] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:43.160187 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca188b-2483-4c84-a7e6-9ec94f795a55 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:43.204588 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c9fc9-eebf-4be0-a74e-abc6d07fe340 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:43.239799 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8b226-a694-4d03-89af-ec4d215d91d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:43.240608 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8b226-a694-4d03-89af-ec4d215d91d1 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:43.240990 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8b226-a694-4d03-89af-ec4d215d91d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:43.241939 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8b226-a694-4d03-89af-ec4d215d91d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:43.301225 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca188b-2483-4c84-a7e6-9ec94f795a55 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:43.302027 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:43.318573 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8b226-a694-4d03-89af-ec4d215d91d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:43.320881 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8b226-a694-4d03-89af-ec4d215d91d1 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:43.351849 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82a16c-e129-49aa-b4db-af960faeee2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:43.352531 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82a16c-e129-49aa-b4db-af960faeee2b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:43.352817 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82a16c-e129-49aa-b4db-af960faeee2b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:43.353092 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82a16c-e129-49aa-b4db-af960faeee2b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:43.353700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82a16c-e129-49aa-b4db-af960faeee2b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:43.355055 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82a16c-e129-49aa-b4db-af960faeee2b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:43.364273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-2a82a16c-e129-49aa-b4db-af960faeee2b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 12:20:43.364273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:43.364273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:20:43.364273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:20:43.364273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:20:43.364273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:20:43.364273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:20:43.364273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:43.364273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 12:20:43.364273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:43.364273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:20:43.364273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:43.364273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:43.364273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:43.364273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:43.364273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:43.371032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:43.371032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:43.371032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:43.371032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:43.371032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:43.371032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:43.371032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:43.371032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:20:43.371032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:20:43.371032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:20:43.371032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:20:43.371032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:43.371032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:43.371032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:43.371032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:43.371032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:43.371032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:43.372118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:43.372118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:43.372118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:43.372118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:43.372118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:43.372118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:43.372118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:43.372118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:43.372118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:43.372118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:43.372118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:20:43.372118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:43.372118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 12:20:43.372118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:43.372118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 300/613] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Oct 31 12:20:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:43.372944 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82a16c-e129-49aa-b4db-af960faeee2b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:43.381285 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:43.437438 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 314/614] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:20:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 12:20:43.438212 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8b226-a694-4d03-89af-ec4d215d91d1 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:43.472030 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82a16c-e129-49aa-b4db-af960faeee2b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:43.505027 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf83cb-ccfe-4364-b3d4-8c5ff63aee7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:43.505675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf83cb-ccfe-4364-b3d4-8c5ff63aee7b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:43.505959 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf83cb-ccfe-4364-b3d4-8c5ff63aee7b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:43.506231 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf83cb-ccfe-4364-b3d4-8c5ff63aee7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:43.512673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf83cb-ccfe-4364-b3d4-8c5ff63aee7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:43.514130 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf83cb-ccfe-4364-b3d4-8c5ff63aee7b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:43.521971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:43.525082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-aeaf83cb-ccfe-4364-b3d4-8c5ff63aee7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:43.525082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:43.525082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:43.525082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:43.525082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:43.525082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:43.525082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:43.525082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:43.525082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:43.525082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:43.525082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:43.525082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:43.525082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:20:43.525082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:20:43.525082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:20:43.525967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:20:43.525967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:43.525967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:43.525967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:43.525967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:43.525967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:43.525967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:43.525967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:43.525967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:43.525967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:43.525967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:43.525967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:43.525967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:43.525967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:43.525967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:43.525967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:43.525967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:43.527599 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:20:43.527599 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:20:43.527599 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:20:43.527599 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:20:43.527599 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:20:43.527599 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:20:43.527599 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:43.527599 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:43.527599 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 301/615] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:43.527599 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf83cb-ccfe-4364-b3d4-8c5ff63aee7b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:43.539960 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8b226-a694-4d03-89af-ec4d215d91d1 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:43.574233 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f7c88-b6f7-4e77-8509-5e5e3384ff96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:43.574789 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f7c88-b6f7-4e77-8509-5e5e3384ff96 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:43.575066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f7c88-b6f7-4e77-8509-5e5e3384ff96 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:43.575333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f7c88-b6f7-4e77-8509-5e5e3384ff96 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:43.575905 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f7c88-b6f7-4e77-8509-5e5e3384ff96 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:43.577298 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f7c88-b6f7-4e77-8509-5e5e3384ff96 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:43.585843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-a64f7c88-b6f7-4e77-8509-5e5e3384ff96 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 12:20:43.585843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:43.585843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:20:43.585843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:20:43.585843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:20:43.585843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:20:43.585843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:20:43.585843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:43.585843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 12:20:43.585843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:43.585843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:20:43.585843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:43.585843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:43.585843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:43.585843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:43.585843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:43.585843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:43.587021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:43.587021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:43.587021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:43.587021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:43.587021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:43.587021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:43.587021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:20:43.587021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:20:43.587021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:20:43.587021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:20:43.587021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:43.587021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:43.587021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:43.587021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:43.587021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:43.587021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:43.587875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:43.587875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:43.587875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:43.587875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:43.587875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:43.587875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:43.587875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:43.587875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:43.587875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:43.587875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:43.587875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:20:43.587875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:43.587875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 12:20:43.587875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:43.587875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 315/616] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Oct 31 12:20:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:43.588763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83130726-7b5f-4fa3-b476-2290deecfa93 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:43.588763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83130726-7b5f-4fa3-b476-2290deecfa93 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:43.588898 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83130726-7b5f-4fa3-b476-2290deecfa93 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:43.590041 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 316/617] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:43.590724 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83130726-7b5f-4fa3-b476-2290deecfa93 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:43.598959 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:43.633912 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf83cb-ccfe-4364-b3d4-8c5ff63aee7b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:43.667794 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ddf91-3cf6-4478-be45-e136c59c7289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:43.668397 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ddf91-3cf6-4478-be45-e136c59c7289 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:43.668679 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ddf91-3cf6-4478-be45-e136c59c7289 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:43.668956 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ddf91-3cf6-4478-be45-e136c59c7289 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:43.669617 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ddf91-3cf6-4478-be45-e136c59c7289 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:43.670025 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ddf91-3cf6-4478-be45-e136c59c7289 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:43.671270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ddf91-3cf6-4478-be45-e136c59c7289 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:43.675561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 302/618] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Oct 31 12:20:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:43.676328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ddf91-3cf6-4478-be45-e136c59c7289 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:43.691177 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83130726-7b5f-4fa3-b476-2290deecfa93 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:43.724410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183514c-e3f8-4198-bf5c-197f7f8ad1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:43.725028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183514c-e3f8-4198-bf5c-197f7f8ad1b6 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:43.725337 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183514c-e3f8-4198-bf5c-197f7f8ad1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:43.726148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183514c-e3f8-4198-bf5c-197f7f8ad1b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:43.736279 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183514c-e3f8-4198-bf5c-197f7f8ad1b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:43.737730 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183514c-e3f8-4198-bf5c-197f7f8ad1b6 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:43.752580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-8183514c-e3f8-4198-bf5c-197f7f8ad1b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:43.752580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:43.752580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:43.752580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:43.752580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:43.752580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:43.752580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:43.752580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:43.752580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:43.752580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:43.752580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:43.752580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:43.752580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:43.752580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:43.752580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:43.752580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:43.753614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:43.753614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:43.753614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:43.753614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:43.753614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:43.753614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:43.753614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:43.753614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:43.753614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:43.753614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:43.753614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:43.753614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:43.753614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:43.753614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:43.753614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:43.753614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:43.753614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:43.754514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:43.754514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:43.754514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:43.754514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 317/619] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:43.754768 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183514c-e3f8-4198-bf5c-197f7f8ad1b6 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:43.757541 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:43.777454 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ddf91-3cf6-4478-be45-e136c59c7289 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:43.809847 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:43.815243 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ef692-84cf-4cd2-8e44-da629784e8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:43.815847 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ef692-84cf-4cd2-8e44-da629784e8ab None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:43.816133 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ef692-84cf-4cd2-8e44-da629784e8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:43.816403 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ef692-84cf-4cd2-8e44-da629784e8ab None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:43.817087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ef692-84cf-4cd2-8e44-da629784e8ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:43.817422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ef692-84cf-4cd2-8e44-da629784e8ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:43.818837 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ef692-84cf-4cd2-8e44-da629784e8ab None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:43.831136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 303/620] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:20:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:43.832238 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c37de-1862-458d-bbea-de34554d3196 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:43.832530 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c37de-1862-458d-bbea-de34554d3196 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:43.832795 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c37de-1862-458d-bbea-de34554d3196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:43.850404 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-622c37de-1862-458d-bbea-de34554d3196 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:43.852117 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-622c37de-1862-458d-bbea-de34554d3196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:43.857877 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183514c-e3f8-4198-bf5c-197f7f8ad1b6 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:43.891664 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f6264-7568-4810-a81c-1a76849583ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:43.892267 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f6264-7568-4810-a81c-1a76849583ac None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:43.892556 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f6264-7568-4810-a81c-1a76849583ac None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:43.892823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f6264-7568-4810-a81c-1a76849583ac None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:43.893480 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f6264-7568-4810-a81c-1a76849583ac None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:43.893781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f6264-7568-4810-a81c-1a76849583ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:43.895127 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f6264-7568-4810-a81c-1a76849583ac None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:43.899956 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 318/621] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Oct 31 12:20:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:43.900729 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f6264-7568-4810-a81c-1a76849583ac None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:43.917987 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 304/622] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:20:43.918808 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c37de-1862-458d-bbea-de34554d3196 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:43.968316 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:44.002709 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f6264-7568-4810-a81c-1a76849583ac None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:44.032087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c37de-1862-458d-bbea-de34554d3196 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:44.035413 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496ff6c-9b15-4386-919e-808103b94e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:44.036012 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496ff6c-9b15-4386-919e-808103b94e37 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:44.036293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496ff6c-9b15-4386-919e-808103b94e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:44.036564 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496ff6c-9b15-4386-919e-808103b94e37 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:44.037218 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496ff6c-9b15-4386-919e-808103b94e37 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:44.037521 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496ff6c-9b15-4386-919e-808103b94e37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:44.039559 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496ff6c-9b15-4386-919e-808103b94e37 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:44.043941 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 319/623] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Oct 31 12:20:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:44.044709 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496ff6c-9b15-4386-919e-808103b94e37 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:44.072130 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:44.094068 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea04d72-ab1f-40c0-83bb-18911bf94100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:44.094820 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea04d72-ab1f-40c0-83bb-18911bf94100 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:44.095175 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea04d72-ab1f-40c0-83bb-18911bf94100 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:44.095522 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea04d72-ab1f-40c0-83bb-18911bf94100 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:44.096274 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea04d72-ab1f-40c0-83bb-18911bf94100 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:44.096637 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea04d72-ab1f-40c0-83bb-18911bf94100 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:44.098171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea04d72-ab1f-40c0-83bb-18911bf94100 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:44.116674 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 305/624] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:44.117780 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea04d72-ab1f-40c0-83bb-18911bf94100 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:44.203285 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496ff6c-9b15-4386-919e-808103b94e37 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:44.231886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea04d72-ab1f-40c0-83bb-18911bf94100 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:44.237945 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:44.245148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8ac8e-370f-4fc5-bfef-f5c8fc248517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:44.245843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8ac8e-370f-4fc5-bfef-f5c8fc248517 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:44.247034 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8ac8e-370f-4fc5-bfef-f5c8fc248517 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:44.247034 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8ac8e-370f-4fc5-bfef-f5c8fc248517 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:44.247240 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8ac8e-370f-4fc5-bfef-f5c8fc248517 None admin] RBAC: Adding query filter params (role.id=e1b3a811029244d2a7e2664cd3246eec, scope.project.id=786ee416a639447ab3698d1f56d04e9a, user.id=188c4989dcfb4f99a04c3349e1a882d1) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:44.247470 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8ac8e-370f-4fc5-bfef-f5c8fc248517 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:44.248928 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8ac8e-370f-4fc5-bfef-f5c8fc248517 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:44.262515 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 320/625] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:20:44 2022] GET /identity/v3/role_assignments?user.id=188c4989dcfb4f99a04c3349e1a882d1&scope.project.id=786ee416a639447ab3698d1f56d04e9a&role.id=e1b3a811029244d2a7e2664cd3246eec => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:44.262515 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8ac8e-370f-4fc5-bfef-f5c8fc248517 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:44.275086 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2c1f8-7fcf-49cc-a7a1-409f90a90584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:44.275747 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2c1f8-7fcf-49cc-a7a1-409f90a90584 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:44.276100 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2c1f8-7fcf-49cc-a7a1-409f90a90584 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:44.276457 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2c1f8-7fcf-49cc-a7a1-409f90a90584 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:44.277517 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2c1f8-7fcf-49cc-a7a1-409f90a90584 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:44.277901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2c1f8-7fcf-49cc-a7a1-409f90a90584 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:44.279879 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2c1f8-7fcf-49cc-a7a1-409f90a90584 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:44.287421 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 306/626] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Oct 31 12:20:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:44.288718 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2c1f8-7fcf-49cc-a7a1-409f90a90584 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:44.350773 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:44.402753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8ac8e-370f-4fc5-bfef-f5c8fc248517 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:44.417642 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2c1f8-7fcf-49cc-a7a1-409f90a90584 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:44.451614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b6a29-4751-40c5-98e4-bbd1eec9df70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:44.452249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b6a29-4751-40c5-98e4-bbd1eec9df70 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:44.452529 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b6a29-4751-40c5-98e4-bbd1eec9df70 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:44.453067 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b6a29-4751-40c5-98e4-bbd1eec9df70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:44.460802 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70863b8d-e7bc-4258-ad78-ff8640e401e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:44.461597 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70863b8d-e7bc-4258-ad78-ff8640e401e0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:44.461713 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b6a29-4751-40c5-98e4-bbd1eec9df70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:44.462076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70863b8d-e7bc-4258-ad78-ff8640e401e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:44.462451 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70863b8d-e7bc-4258-ad78-ff8640e401e0 None admin] PATH_INFO: `/v3/services/network` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:44.463136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70863b8d-e7bc-4258-ad78-ff8640e401e0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:44.463246 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b6a29-4751-40c5-98e4-bbd1eec9df70 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:44.464705 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70863b8d-e7bc-4258-ad78-ff8640e401e0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:44.476819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-cb8b6a29-4751-40c5-98e4-bbd1eec9df70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:44.476819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:44.476819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:44.476819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:44.476819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:44.476819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:44.476819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:44.476819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:44.476819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:44.476819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:44.476819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:44.476819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:44.476819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:20:44.476819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:20:44.476819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:20:44.478015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:20:44.478015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:44.478015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:44.478015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:44.478015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:44.478015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:44.478015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:44.478015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:44.478015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:44.478015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:44.478015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:44.478015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:44.478015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:44.478015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:44.478015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:44.478015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:44.478015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:44.479148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:20:44.479148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:20:44.479148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:20:44.479148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:20:44.479148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:20:44.479148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:20:44.479148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:44.479148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:44.479695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-70863b8d-e7bc-4258-ad78-ff8640e401e0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 12:20:44.479695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:44.479695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:20:44.479695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:20:44.479695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:20:44.479695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:20:44.479695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:20:44.479695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:44.479695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 12:20:44.479695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:44.479695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:20:44.479695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:44.479695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:44.479695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:44.479695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:44.479695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:44.479695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:44.480990 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:44.480990 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:44.480990 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:44.480990 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:44.480990 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:44.480990 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:44.480990 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:20:44.480990 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:20:44.480990 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:20:44.480990 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:20:44.480990 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:44.480990 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:44.480990 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:44.480990 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:44.480990 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:44.480990 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:44.482149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:44.482149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:44.482149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:44.482149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:44.482149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:44.482149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:44.482149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:44.482149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:44.482149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:44.482149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:44.482149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:20:44.482149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:44.482149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 12:20:44.482149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:44.482149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 307/627] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:44 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:44.483961 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70863b8d-e7bc-4258-ad78-ff8640e401e0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:44.484108 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 321/628] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:44.486932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b6a29-4751-40c5-98e4-bbd1eec9df70 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:44.563454 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:44.603147 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70863b8d-e7bc-4258-ad78-ff8640e401e0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:44.614992 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:44.619114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b6a29-4751-40c5-98e4-bbd1eec9df70 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:44.642386 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8751dff-1c7b-4d65-921a-89e8a024c2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:44.643350 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8751dff-1c7b-4d65-921a-89e8a024c2a6 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:44.643834 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8751dff-1c7b-4d65-921a-89e8a024c2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:44.644311 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8751dff-1c7b-4d65-921a-89e8a024c2a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:44.645355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8751dff-1c7b-4d65-921a-89e8a024c2a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:44.646960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8751dff-1c7b-4d65-921a-89e8a024c2a6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:44.656624 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452a6f4-e452-4ffb-9234-2fcada26dfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:44.657493 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452a6f4-e452-4ffb-9234-2fcada26dfed None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:44.657729 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452a6f4-e452-4ffb-9234-2fcada26dfed None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:44.658007 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452a6f4-e452-4ffb-9234-2fcada26dfed None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:44.658690 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452a6f4-e452-4ffb-9234-2fcada26dfed None admin] RBAC: Adding query filter params (name=network) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:44.659002 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452a6f4-e452-4ffb-9234-2fcada26dfed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:44.660629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452a6f4-e452-4ffb-9234-2fcada26dfed None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:44.667186 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 322/629] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 31 12:20:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:44.668218 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452a6f4-e452-4ffb-9234-2fcada26dfed None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:44.681271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 308/630] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:20:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:20:44.685394 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8751dff-1c7b-4d65-921a-89e8a024c2a6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:44.785849 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452a6f4-e452-4ffb-9234-2fcada26dfed None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:44.825317 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:44.848882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31a82e-3bb8-4507-b3aa-a098c6a06d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:44.849532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31a82e-3bb8-4507-b3aa-a098c6a06d1a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:44.849812 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31a82e-3bb8-4507-b3aa-a098c6a06d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:44.850084 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31a82e-3bb8-4507-b3aa-a098c6a06d1a None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:44.850898 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31a82e-3bb8-4507-b3aa-a098c6a06d1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:44.851204 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31a82e-3bb8-4507-b3aa-a098c6a06d1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:44.852724 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31a82e-3bb8-4507-b3aa-a098c6a06d1a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:44.884430 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 323/631] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:20:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:44.894205 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31a82e-3bb8-4507-b3aa-a098c6a06d1a None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:44.898945 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8751dff-1c7b-4d65-921a-89e8a024c2a6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:44.940491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be71d6e-d6e2-41be-9137-b319e8b1f241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:44.941257 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be71d6e-d6e2-41be-9137-b319e8b1f241 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:44.941481 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be71d6e-d6e2-41be-9137-b319e8b1f241 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:44.941759 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be71d6e-d6e2-41be-9137-b319e8b1f241 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:44.942403 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be71d6e-d6e2-41be-9137-b319e8b1f241 None admin] RBAC: Adding query filter params (type=network) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:44.942704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be71d6e-d6e2-41be-9137-b319e8b1f241 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:44.944183 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be71d6e-d6e2-41be-9137-b319e8b1f241 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:44.950138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 309/632] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 31 12:20:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:44.955494 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be71d6e-d6e2-41be-9137-b319e8b1f241 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:44.992899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:45.044506 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31a82e-3bb8-4507-b3aa-a098c6a06d1a None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:45.095521 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be71d6e-d6e2-41be-9137-b319e8b1f241 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:45.097660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1caa78c-a506-4bc3-9558-2591a4ee92c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:45.098418 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1caa78c-a506-4bc3-9558-2591a4ee92c5 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:45.099790 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1caa78c-a506-4bc3-9558-2591a4ee92c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:45.100038 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1caa78c-a506-4bc3-9558-2591a4ee92c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:45.101506 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1caa78c-a506-4bc3-9558-2591a4ee92c5 None admin] RBAC: Adding query filter params (role.id=df935cf8a7f24352ba94fe83718280ea, scope.project.id=786ee416a639447ab3698d1f56d04e9a, user.id=912693f459f147a5a479ad01e2e8387a) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:45.101918 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1caa78c-a506-4bc3-9558-2591a4ee92c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:45.103532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1caa78c-a506-4bc3-9558-2591a4ee92c5 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:45.111914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 324/633] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:20:44 2022] GET /identity/v3/role_assignments?user.id=912693f459f147a5a479ad01e2e8387a&scope.project.id=786ee416a639447ab3698d1f56d04e9a&role.id=df935cf8a7f24352ba94fe83718280ea => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:45.140788 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d1d5e-1351-4493-ab7d-3380d11aacd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:45.141713 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d1d5e-1351-4493-ab7d-3380d11aacd3 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:45.142147 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d1d5e-1351-4493-ab7d-3380d11aacd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:45.142577 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d1d5e-1351-4493-ab7d-3380d11aacd3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:45.143425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d1d5e-1351-4493-ab7d-3380d11aacd3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:45.144998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d1d5e-1351-4493-ab7d-3380d11aacd3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:45.170163 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 310/634] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:20:44 2022] POST /identity/v3/endpoints => generated 337 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:20:46.363680 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e545aba-6843-4617-be85-236879e7b937 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:46.364198 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e545aba-6843-4617-be85-236879e7b937 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:46.364276 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e545aba-6843-4617-be85-236879e7b937 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:46.365907 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 325/635] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:46.371126 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5d2b7-20b9-43a7-a998-8cf8e80d8952 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:46.371523 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5d2b7-20b9-43a7-a998-8cf8e80d8952 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:46.371682 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5d2b7-20b9-43a7-a998-8cf8e80d8952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:46.390321 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-eae5d2b7-20b9-43a7-a998-8cf8e80d8952 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:46.391529 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-eae5d2b7-20b9-43a7-a998-8cf8e80d8952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:46.481304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 311/636] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:20:46.600742 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e01907-19dc-4646-9a01-77899bfedf94 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:46.601067 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e01907-19dc-4646-9a01-77899bfedf94 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:46.601336 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e01907-19dc-4646-9a01-77899bfedf94 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:46.602959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 326/637] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:46.608288 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd723f-e091-462a-8492-8616100c407a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:46.608818 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd723f-e091-462a-8492-8616100c407a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:46.609346 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd723f-e091-462a-8492-8616100c407a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:46.628121 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7abd723f-e091-462a-8492-8616100c407a None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:46.629604 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7abd723f-e091-462a-8492-8616100c407a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:46.638052 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:46.701482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 312/638] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:20:46.750254 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e01907-19dc-4646-9a01-77899bfedf94 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:46.798564 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:46.864752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e01907-19dc-4646-9a01-77899bfedf94 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:46.901190 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825f82d-8b4c-45f8-9887-d4944ed23995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:46.901724 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825f82d-8b4c-45f8-9887-d4944ed23995 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:46.902007 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825f82d-8b4c-45f8-9887-d4944ed23995 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:46.902284 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825f82d-8b4c-45f8-9887-d4944ed23995 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:46.902939 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825f82d-8b4c-45f8-9887-d4944ed23995 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:46.904318 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825f82d-8b4c-45f8-9887-d4944ed23995 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:46.921225 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 327/639] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 31 12:20:46 2022] POST /identity/v3/services => generated 269 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:20:46.994736 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd723f-e091-462a-8492-8616100c407a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:47.117095 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd723f-e091-462a-8492-8616100c407a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:47.159021 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df371860-75f4-41c9-9c44-a983f9ffd888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:47.159581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df371860-75f4-41c9-9c44-a983f9ffd888 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:47.160116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df371860-75f4-41c9-9c44-a983f9ffd888 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:47.160389 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df371860-75f4-41c9-9c44-a983f9ffd888 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:47.160975 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df371860-75f4-41c9-9c44-a983f9ffd888 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:47.162375 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df371860-75f4-41c9-9c44-a983f9ffd888 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:47.171861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-df371860-75f4-41c9-9c44-a983f9ffd888 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 12:20:47.171861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:47.171861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:20:47.171861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:20:47.171861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:20:47.171861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:20:47.171861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:20:47.171861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:47.171861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 12:20:47.171861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:47.171861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:20:47.171861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:47.171861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:47.171861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:47.171861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:47.171861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:47.171861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:47.172937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:47.172937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:47.172937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:47.172937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:47.172937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:47.172937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:47.172937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:20:47.172937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:20:47.172937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:20:47.172937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:20:47.172937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:47.172937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:47.172937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:47.172937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:47.172937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:47.172937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:47.173833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:47.173833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:47.173833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:47.173833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:47.173833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:47.173833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:47.173833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:47.173833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:47.173833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:47.173833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:47.173833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:20:47.173833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:47.173833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 12:20:47.173833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:47.173833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 313/640] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Oct 31 12:20:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:47.181742 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825f82d-8b4c-45f8-9887-d4944ed23995 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:47.289062 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:47.293660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825f82d-8b4c-45f8-9887-d4944ed23995 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:47.321688 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2eb794-cf88-41bf-ad8f-78803515ba0a None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:47.322061 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2eb794-cf88-41bf-ad8f-78803515ba0a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:47.322413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2eb794-cf88-41bf-ad8f-78803515ba0a None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:47.323951 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 314/641] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:20:47.330427 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2ec56-1f8a-4458-b135-7eeaee456600 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:47.330992 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2ec56-1f8a-4458-b135-7eeaee456600 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:47.331471 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2ec56-1f8a-4458-b135-7eeaee456600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:47.338064 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d02659-f8f1-4351-8efe-bf4ac1a5bdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:47.338669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d02659-f8f1-4351-8efe-bf4ac1a5bdde None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:47.338953 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d02659-f8f1-4351-8efe-bf4ac1a5bdde None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:47.339228 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d02659-f8f1-4351-8efe-bf4ac1a5bdde None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:47.339891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d02659-f8f1-4351-8efe-bf4ac1a5bdde None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:47.340197 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d02659-f8f1-4351-8efe-bf4ac1a5bdde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:47.341676 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d02659-f8f1-4351-8efe-bf4ac1a5bdde None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:47.342156 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:47.349164 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 328/642] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 31 12:20:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:47.354752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d02659-f8f1-4351-8efe-bf4ac1a5bdde None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:47.359505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-edb2ec56-1f8a-4458-b135-7eeaee456600 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:47.361173 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-edb2ec56-1f8a-4458-b135-7eeaee456600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:47.433325 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 315/643] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:47 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:20:47.465451 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ee44b-7038-4c13-96ce-b16cd239f550 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:47.466557 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ee44b-7038-4c13-96ce-b16cd239f550 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:47.467129 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ee44b-7038-4c13-96ce-b16cd239f550 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:47.469651 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 316/644] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:20:47.474293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156e0ab-b92c-40e0-807e-de2f534a49d6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:47.477165 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156e0ab-b92c-40e0-807e-de2f534a49d6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:47.477165 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156e0ab-b92c-40e0-807e-de2f534a49d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:47.483250 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d02659-f8f1-4351-8efe-bf4ac1a5bdde None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:47.494536 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6156e0ab-b92c-40e0-807e-de2f534a49d6 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:47.495721 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6156e0ab-b92c-40e0-807e-de2f534a49d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:47.518334 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf03a0-9a1e-4830-9df5-3fa8edf9455a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:47.518937 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf03a0-9a1e-4830-9df5-3fa8edf9455a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:47.519212 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf03a0-9a1e-4830-9df5-3fa8edf9455a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:47.519479 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf03a0-9a1e-4830-9df5-3fa8edf9455a None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:47.520105 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf03a0-9a1e-4830-9df5-3fa8edf9455a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:47.520400 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf03a0-9a1e-4830-9df5-3fa8edf9455a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:47.521783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf03a0-9a1e-4830-9df5-3fa8edf9455a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:47.526720 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 329/645] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 31 12:20:47 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:47.578682 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 317/646] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:47 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:20:47.714407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf03a0-9a1e-4830-9df5-3fa8edf9455a None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:47.743639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:47.821664 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf03a0-9a1e-4830-9df5-3fa8edf9455a None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:47.856694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97117eb-b3f0-4105-a92a-9e0399f6c590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:47.857746 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97117eb-b3f0-4105-a92a-9e0399f6c590 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:47.858252 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97117eb-b3f0-4105-a92a-9e0399f6c590 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:47.858729 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97117eb-b3f0-4105-a92a-9e0399f6c590 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:47.859611 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97117eb-b3f0-4105-a92a-9e0399f6c590 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:47.860565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156e0ab-b92c-40e0-807e-de2f534a49d6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:47.861440 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97117eb-b3f0-4105-a92a-9e0399f6c590 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:47.870943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-c97117eb-b3f0-4105-a92a-9e0399f6c590 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 12:20:47.870943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:47.870943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:20:47.870943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:20:47.870943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:20:47.870943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:20:47.870943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:20:47.870943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:47.870943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 12:20:47.870943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:47.870943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:20:47.870943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:47.870943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:47.870943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:47.870943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:47.870943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:47.870943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:47.871961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:47.871961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:47.871961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:47.871961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:47.871961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:47.871961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:47.871961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:20:47.871961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:20:47.871961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:20:47.871961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:20:47.871961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:47.871961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:47.871961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:47.871961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:47.871961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:47.871961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:47.872810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:47.872810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:47.872810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:47.872810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:47.872810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:47.872810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:47.872810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:47.872810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:47.872810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:47.872810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:47.872810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:20:47.872810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:47.872810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 12:20:47.872810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:47.875572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 330/647] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 31 12:20:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:47.881979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97117eb-b3f0-4105-a92a-9e0399f6c590 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:47.929499 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:47.973031 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156e0ab-b92c-40e0-807e-de2f534a49d6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:47.980816 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:47.991020 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97117eb-b3f0-4105-a92a-9e0399f6c590 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:48.012331 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c459cac-e96a-45a9-8508-846c908a9e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:48.013373 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c459cac-e96a-45a9-8508-846c908a9e7e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:48.013878 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c459cac-e96a-45a9-8508-846c908a9e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:48.014393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c459cac-e96a-45a9-8508-846c908a9e7e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:48.026698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c459cac-e96a-45a9-8508-846c908a9e7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:48.027073 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d780d-6eb9-4917-ae70-703534c62082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:48.027737 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d780d-6eb9-4917-ae70-703534c62082 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:48.028016 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d780d-6eb9-4917-ae70-703534c62082 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:48.028285 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d780d-6eb9-4917-ae70-703534c62082 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:48.028916 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d780d-6eb9-4917-ae70-703534c62082 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:48.029258 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d780d-6eb9-4917-ae70-703534c62082 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:48.030606 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d780d-6eb9-4917-ae70-703534c62082 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:48.033631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-4c459cac-e96a-45a9-8508-846c908a9e7e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 12:20:48.033631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:48.033631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:48.033631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:48.033631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:48.033631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:48.033631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:48.033631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:48.033631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:48.033631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:48.033631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:48.033631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:48.033631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:48.033631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:48.033631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:48.033631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:48.034568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:48.034568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:48.034568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:48.034568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:48.034568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:48.034568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:48.034568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:48.034568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:48.034568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:48.034568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:48.034568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:48.034568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:48.034568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:48.034568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:48.034568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:48.034568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:48.035689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:48.035689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:48.035689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:48.035689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:48.035689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:48.035689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:48.035689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:48.035689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:48.035689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:48.035689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:48.035689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 12:20:48.035689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:48.036348 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 331/648] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 31 12:20:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:48.042978 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d780d-6eb9-4917-ae70-703534c62082 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:48.043248 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 318/649] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Oct 31 12:20:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:20:48.044279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c459cac-e96a-45a9-8508-846c908a9e7e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:48.162779 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c459cac-e96a-45a9-8508-846c908a9e7e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:48.172805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d780d-6eb9-4917-ae70-703534c62082 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:48.186182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:48.200267 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc6560-fd3d-47d1-8c94-1f91ca356eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:48.200967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc6560-fd3d-47d1-8c94-1f91ca356eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:48.201473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc6560-fd3d-47d1-8c94-1f91ca356eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:48.201757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc6560-fd3d-47d1-8c94-1f91ca356eb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:48.202457 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc6560-fd3d-47d1-8c94-1f91ca356eb1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:48.202730 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc6560-fd3d-47d1-8c94-1f91ca356eb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:48.204131 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc6560-fd3d-47d1-8c94-1f91ca356eb1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:48.214041 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 319/650] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Oct 31 12:20:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:48.219608 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc6560-fd3d-47d1-8c94-1f91ca356eb1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:48.219841 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf7be3-3053-4385-97d5-60e10ff115be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:48.220744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf7be3-3053-4385-97d5-60e10ff115be None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:48.221237 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf7be3-3053-4385-97d5-60e10ff115be None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:48.221690 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf7be3-3053-4385-97d5-60e10ff115be None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:48.222712 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf7be3-3053-4385-97d5-60e10ff115be None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:48.223272 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf7be3-3053-4385-97d5-60e10ff115be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:48.225748 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf7be3-3053-4385-97d5-60e10ff115be None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:48.237699 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 332/651] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 31 12:20:48 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:48.343066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc6560-fd3d-47d1-8c94-1f91ca356eb1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:48.381032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2d270-7ece-4d97-b1aa-c04b7629d822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:48.382761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2d270-7ece-4d97-b1aa-c04b7629d822 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:48.383257 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2d270-7ece-4d97-b1aa-c04b7629d822 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:48.383757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2d270-7ece-4d97-b1aa-c04b7629d822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:48.396693 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2d270-7ece-4d97-b1aa-c04b7629d822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:48.398734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2d270-7ece-4d97-b1aa-c04b7629d822 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:48.415351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-6ea2d270-7ece-4d97-b1aa-c04b7629d822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:48.415351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:48.415351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:48.415351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:48.415351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:48.415351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:48.415351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:48.415351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:48.415351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:48.415351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:48.415351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:48.415351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:48.415351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:48.415351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:48.415351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:48.415351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:48.416393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:48.416393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:48.416393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:48.416393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:48.416393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:48.416393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:48.416393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:48.416393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:48.416393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:48.416393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:48.416393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:48.416393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:48.416393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:48.416393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:48.416393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:48.416393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:48.416393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:48.417352 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:48.417352 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:48.417352 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:48.419515 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 320/652] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:48.426154 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf7be3-3053-4385-97d5-60e10ff115be None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:48.448198 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:48.538144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf7be3-3053-4385-97d5-60e10ff115be None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:48.573690 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133ce3d-573a-4118-bf84-70fa2031abde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:48.574300 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133ce3d-573a-4118-bf84-70fa2031abde None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:48.574579 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133ce3d-573a-4118-bf84-70fa2031abde None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:48.574854 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133ce3d-573a-4118-bf84-70fa2031abde None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:48.575493 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133ce3d-573a-4118-bf84-70fa2031abde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:48.575794 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133ce3d-573a-4118-bf84-70fa2031abde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:48.577188 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133ce3d-573a-4118-bf84-70fa2031abde None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:48.590017 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 333/653] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:48.595767 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2d270-7ece-4d97-b1aa-c04b7629d822 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:48.633420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:48.701801 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2d270-7ece-4d97-b1aa-c04b7629d822 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:48.742464 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f994e86-59b7-4b7b-9eb2-a5b1e4eaac42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:48.743092 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f994e86-59b7-4b7b-9eb2-a5b1e4eaac42 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:48.743379 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f994e86-59b7-4b7b-9eb2-a5b1e4eaac42 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:48.743657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f994e86-59b7-4b7b-9eb2-a5b1e4eaac42 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:48.751633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f994e86-59b7-4b7b-9eb2-a5b1e4eaac42 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:48.753216 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f994e86-59b7-4b7b-9eb2-a5b1e4eaac42 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:48.765886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-7f994e86-59b7-4b7b-9eb2-a5b1e4eaac42 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 12:20:48.765886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:48.765886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:48.765886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:48.765886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:48.765886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:48.765886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:48.765886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:48.765886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:48.765886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:48.765886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:48.765886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:48.765886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:20:48.765886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:20:48.765886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:20:48.765886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:20:48.766871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:48.766871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:48.766871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:20:48.766871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:48.766871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:20:48.766871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:48.766871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:48.766871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:48.766871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:48.766871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:48.766871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:48.766871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:48.766871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:48.766871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:48.766871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:48.766871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:48.766871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:48.766871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:48.768104 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:48.768104 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:48.768104 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:20:48.768104 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:20:48.768104 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:20:48.768104 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:20:48.768104 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:20:48.768104 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:20:48.768104 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 12:20:48.768104 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:48.768104 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 321/654] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Oct 31 12:20:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:48.774953 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133ce3d-573a-4118-bf84-70fa2031abde None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:48.859300 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:48.883496 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133ce3d-573a-4118-bf84-70fa2031abde None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:48.919956 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d6cbc-606a-4507-82c8-cd5429e2ec61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:48.920625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d6cbc-606a-4507-82c8-cd5429e2ec61 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:48.920904 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d6cbc-606a-4507-82c8-cd5429e2ec61 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:48.921241 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d6cbc-606a-4507-82c8-cd5429e2ec61 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:48.921986 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d6cbc-606a-4507-82c8-cd5429e2ec61 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:48.922287 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d6cbc-606a-4507-82c8-cd5429e2ec61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:48.923729 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d6cbc-606a-4507-82c8-cd5429e2ec61 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:48.946093 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 334/655] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Oct 31 12:20:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:48.948336 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f994e86-59b7-4b7b-9eb2-a5b1e4eaac42 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:49.047031 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:49.054330 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f994e86-59b7-4b7b-9eb2-a5b1e4eaac42 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:49.094886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45e6ee-10d3-4270-bd9c-9bea613bea99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:49.095543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45e6ee-10d3-4270-bd9c-9bea613bea99 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:49.095829 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45e6ee-10d3-4270-bd9c-9bea613bea99 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:49.096107 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45e6ee-10d3-4270-bd9c-9bea613bea99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:49.109097 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45e6ee-10d3-4270-bd9c-9bea613bea99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:49.110656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45e6ee-10d3-4270-bd9c-9bea613bea99 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:49.125678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-9c45e6ee-10d3-4270-bd9c-9bea613bea99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:49.125678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:49.125678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:49.125678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:49.125678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:49.125678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:49.125678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:49.125678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:49.125678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:49.125678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:49.125678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:49.125678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:49.125678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:49.125678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:49.125678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:49.125678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:49.126633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:49.126633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:49.126633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:49.126633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:49.126633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:49.126633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:49.126633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:49.126633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:49.126633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:49.126633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:49.126633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:49.126633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:49.126633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:49.126633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:49.126633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:49.126633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:49.126633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:49.127537 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:49.127537 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:49.127537 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:49.127537 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 322/656] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:49.132655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d6cbc-606a-4507-82c8-cd5429e2ec61 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:49.199082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0baf56-04b1-4c69-9ea6-02f87864bbee None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:49.199409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0baf56-04b1-4c69-9ea6-02f87864bbee None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:49.199639 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0baf56-04b1-4c69-9ea6-02f87864bbee None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:49.201280 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 323/657] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:49.206063 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05012200-7d16-46e6-81a8-030f53999d4c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:49.206346 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05012200-7d16-46e6-81a8-030f53999d4c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:49.206675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05012200-7d16-46e6-81a8-030f53999d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:49.228060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-05012200-7d16-46e6-81a8-030f53999d4c None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:49.229424 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-05012200-7d16-46e6-81a8-030f53999d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:49.250440 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d6cbc-606a-4507-82c8-cd5429e2ec61 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:49.315774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 324/658] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:49 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 12:20:49.321888 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac5c0e-8c6f-4b34-b056-49586e0c256e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:49.322510 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac5c0e-8c6f-4b34-b056-49586e0c256e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:49.322795 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac5c0e-8c6f-4b34-b056-49586e0c256e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:49.323068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac5c0e-8c6f-4b34-b056-49586e0c256e None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:49.323724 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac5c0e-8c6f-4b34-b056-49586e0c256e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:49.324132 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac5c0e-8c6f-4b34-b056-49586e0c256e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:49.325637 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac5c0e-8c6f-4b34-b056-49586e0c256e None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:49.329630 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:49.348676 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 335/659] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:49.350035 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05012200-7d16-46e6-81a8-030f53999d4c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:49.436996 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:49.462851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05012200-7d16-46e6-81a8-030f53999d4c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:49.501128 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7fa61-b12e-459f-838c-c12c2e85e175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:49.502331 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7fa61-b12e-459f-838c-c12c2e85e175 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:49.503068 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7fa61-b12e-459f-838c-c12c2e85e175 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:49.503725 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7fa61-b12e-459f-838c-c12c2e85e175 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:49.511585 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7fa61-b12e-459f-838c-c12c2e85e175 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:49.513251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7fa61-b12e-459f-838c-c12c2e85e175 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:49.525745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-13f7fa61-b12e-459f-838c-c12c2e85e175 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:49.525745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:49.525745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:49.525745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:49.525745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:49.525745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:49.525745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:49.525745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:49.525745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:49.525745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:49.525745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:49.525745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:49.525745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:20:49.525745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:20:49.525745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:20:49.526671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:20:49.526671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:49.526671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:49.526671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:49.526671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:49.526671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:49.526671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:49.526671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:49.526671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:49.526671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:49.526671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:49.526671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:49.526671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:49.526671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:49.526671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:49.526671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:49.526671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:49.527563 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:20:49.527563 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:20:49.527563 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:20:49.527563 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:20:49.527563 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:20:49.527563 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:20:49.527563 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:49.527563 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:49.533246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 325/660] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:49.535826 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac5c0e-8c6f-4b34-b056-49586e0c256e None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:49.589149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7fa61-b12e-459f-838c-c12c2e85e175 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:49.647744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac5c0e-8c6f-4b34-b056-49586e0c256e None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:49.684711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa4266-25a7-46e9-8323-633fe5266218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:49.685733 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa4266-25a7-46e9-8323-633fe5266218 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:49.685880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa4266-25a7-46e9-8323-633fe5266218 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:49.686255 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa4266-25a7-46e9-8323-633fe5266218 None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:49.687113 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa4266-25a7-46e9-8323-633fe5266218 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:49.687465 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa4266-25a7-46e9-8323-633fe5266218 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:49.689086 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa4266-25a7-46e9-8323-633fe5266218 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:49.705188 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 336/661] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:20:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:49.711082 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa4266-25a7-46e9-8323-633fe5266218 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:49.722457 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7fa61-b12e-459f-838c-c12c2e85e175 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:49.769173 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f252a0-7f84-4e30-b6ec-9539eb63e845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:49.769809 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f252a0-7f84-4e30-b6ec-9539eb63e845 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:49.770090 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f252a0-7f84-4e30-b6ec-9539eb63e845 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:49.770362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f252a0-7f84-4e30-b6ec-9539eb63e845 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:49.771040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f252a0-7f84-4e30-b6ec-9539eb63e845 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:49.773058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f252a0-7f84-4e30-b6ec-9539eb63e845 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:49.785307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-13f252a0-7f84-4e30-b6ec-9539eb63e845 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 12:20:49.785307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:49.785307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:20:49.785307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:20:49.785307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:20:49.785307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:20:49.785307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:20:49.785307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:49.785307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 12:20:49.785307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:49.785307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:20:49.785307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:49.785307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:49.785307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:49.785307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:49.785307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:49.786275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:49.786275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:49.786275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:49.786275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:49.786275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:49.786275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:49.786275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:49.786275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:20:49.786275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:20:49.786275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:20:49.786275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:20:49.786275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:49.786275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:49.786275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:49.786275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:49.786275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:49.786275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:49.787246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:49.787246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:49.787246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:49.787246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:49.787246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:49.787246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:49.787246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:49.787246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:49.787246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:49.787246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:49.787246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:20:49.787246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:49.787246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 12:20:49.787246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:49.791896 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 326/662] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Oct 31 12:20:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:49.793513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f252a0-7f84-4e30-b6ec-9539eb63e845 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:49.797883 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:49.800899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:49.854722 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa4266-25a7-46e9-8323-633fe5266218 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:49.889725 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388f22a-7616-4f11-9d99-fd7eb0fa4364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:49.890407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388f22a-7616-4f11-9d99-fd7eb0fa4364 None admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:49.890689 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388f22a-7616-4f11-9d99-fd7eb0fa4364 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:49.890961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388f22a-7616-4f11-9d99-fd7eb0fa4364 None admin] PATH_INFO: `/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/912693f459f147a5a479ad01e2e8387a/roles/b18fbffdad824f8eb970f02bff1f2a62` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:49.893884 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388f22a-7616-4f11-9d99-fd7eb0fa4364 None admin] RBAC: Authorizing `identity:create_grant(project_id=786ee416a639447ab3698d1f56d04e9a, user_id=912693f459f147a5a479ad01e2e8387a, role_id=b18fbffdad824f8eb970f02bff1f2a62)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:49.895334 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388f22a-7616-4f11-9d99-fd7eb0fa4364 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:49.910603 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 337/663] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:20:49 2022] PUT /identity/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/912693f459f147a5a479ad01e2e8387a/roles/b18fbffdad824f8eb970f02bff1f2a62 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:20:49.911875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820facd-bfb1-4886-852f-4c1987795157 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:49.912162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820facd-bfb1-4886-852f-4c1987795157 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:49.912431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820facd-bfb1-4886-852f-4c1987795157 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:49.914564 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 338/664] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:49.923184 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e691dd4-f94d-4099-8876-afe86464e6ec None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:49.923505 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e691dd4-f94d-4099-8876-afe86464e6ec None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:49.924222 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e691dd4-f94d-4099-8876-afe86464e6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:49.927399 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f252a0-7f84-4e30-b6ec-9539eb63e845 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:49.949071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-7e691dd4-f94d-4099-8876-afe86464e6ec None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:49.950611 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7e691dd4-f94d-4099-8876-afe86464e6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:49.980714 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731dbcf-4ab9-42ea-98ed-6fe048af45ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:49.981827 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731dbcf-4ab9-42ea-98ed-6fe048af45ac None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:49.982926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731dbcf-4ab9-42ea-98ed-6fe048af45ac None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:49.983429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731dbcf-4ab9-42ea-98ed-6fe048af45ac None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:49.984668 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731dbcf-4ab9-42ea-98ed-6fe048af45ac None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:49.985262 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731dbcf-4ab9-42ea-98ed-6fe048af45ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:49.987837 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731dbcf-4ab9-42ea-98ed-6fe048af45ac None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:50.000577 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 327/665] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Oct 31 12:20:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:50.002010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731dbcf-4ab9-42ea-98ed-6fe048af45ac None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:50.057491 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 339/666] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:49 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 12:20:50.105852 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:50.143106 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731dbcf-4ab9-42ea-98ed-6fe048af45ac None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:50.179910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ef1ad-3eae-4319-b77d-160273b5403e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:50.180518 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ef1ad-3eae-4319-b77d-160273b5403e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:50.180853 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ef1ad-3eae-4319-b77d-160273b5403e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:50.181144 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ef1ad-3eae-4319-b77d-160273b5403e None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:50.181838 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ef1ad-3eae-4319-b77d-160273b5403e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:50.182143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ef1ad-3eae-4319-b77d-160273b5403e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:50.183489 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ef1ad-3eae-4319-b77d-160273b5403e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:50.189168 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 328/667] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Oct 31 12:20:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:50.195514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e691dd4-f94d-4099-8876-afe86464e6ec None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:50.243962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:50.299712 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e691dd4-f94d-4099-8876-afe86464e6ec None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:50.335201 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c09ce5-4255-4018-a9d2-a09986f614fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:50.335812 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c09ce5-4255-4018-a9d2-a09986f614fe None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:50.336093 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c09ce5-4255-4018-a9d2-a09986f614fe None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:50.336364 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c09ce5-4255-4018-a9d2-a09986f614fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:50.337040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ef1ad-3eae-4319-b77d-160273b5403e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:50.337252 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c09ce5-4255-4018-a9d2-a09986f614fe None admin] RBAC: Adding query filter params (interface=public, service_id=134c904c110340a08e614a869406d876, region_id=RegionOne) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:50.337402 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c09ce5-4255-4018-a9d2-a09986f614fe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:50.338874 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c09ce5-4255-4018-a9d2-a09986f614fe None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:50.345732 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 340/668] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Oct 31 12:20:50 2022] GET /identity/v3/endpoints?service_id=134c904c110340a08e614a869406d876&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:50.351316 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c09ce5-4255-4018-a9d2-a09986f614fe None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:50.449678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ef1ad-3eae-4319-b77d-160273b5403e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:50.454497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c09ce5-4255-4018-a9d2-a09986f614fe None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:50.466189 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:50.483415 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:50.490604 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942588e-500b-4db9-8bb0-46b1242043d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:50.491250 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942588e-500b-4db9-8bb0-46b1242043d7 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:50.491532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942588e-500b-4db9-8bb0-46b1242043d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:50.491767 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498d826-b31e-4f80-bbe0-e787d4d5bc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:50.491903 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942588e-500b-4db9-8bb0-46b1242043d7 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:50.492425 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942588e-500b-4db9-8bb0-46b1242043d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:50.492930 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498d826-b31e-4f80-bbe0-e787d4d5bc5f None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:50.493398 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498d826-b31e-4f80-bbe0-e787d4d5bc5f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:50.493880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498d826-b31e-4f80-bbe0-e787d4d5bc5f None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:50.494044 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942588e-500b-4db9-8bb0-46b1242043d7 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:50.494963 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498d826-b31e-4f80-bbe0-e787d4d5bc5f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:50.496686 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498d826-b31e-4f80-bbe0-e787d4d5bc5f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:50.509474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 341/669] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Oct 31 12:20:50 2022] GET /identity/v3/services => generated 1029 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:20:50.517645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 329/670] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 31 12:20:50 2022] POST /identity/v3/services => generated 241 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:20:50.633621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657cb55-2e37-46fd-8b81-32cc6d4a9387 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:50.633936 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657cb55-2e37-46fd-8b81-32cc6d4a9387 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:50.634172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657cb55-2e37-46fd-8b81-32cc6d4a9387 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:50.635876 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 342/671] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:50.643160 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b5cf5-9a24-4b4c-9f91-6ca869da6fdc None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:50.643453 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b5cf5-9a24-4b4c-9f91-6ca869da6fdc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:50.643899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b5cf5-9a24-4b4c-9f91-6ca869da6fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:50.665054 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a37b5cf5-9a24-4b4c-9f91-6ca869da6fdc None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:50.666370 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a37b5cf5-9a24-4b4c-9f91-6ca869da6fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:50.749228 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 330/672] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:50 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:20:51.021125 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657cb55-2e37-46fd-8b81-32cc6d4a9387 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:51.138837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657cb55-2e37-46fd-8b81-32cc6d4a9387 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:51.173884 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ef722-03b3-46c1-9b20-ff3646804783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:51.174492 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ef722-03b3-46c1-9b20-ff3646804783 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:51.174772 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ef722-03b3-46c1-9b20-ff3646804783 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:51.175109 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ef722-03b3-46c1-9b20-ff3646804783 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:51.175767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ef722-03b3-46c1-9b20-ff3646804783 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:51.177142 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ef722-03b3-46c1-9b20-ff3646804783 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:51.195869 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 343/673] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 31 12:20:51 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:20:52.195764 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef8b64-3caa-48b2-8f30-7cfa9eff760a None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:52.196799 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef8b64-3caa-48b2-8f30-7cfa9eff760a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:52.197328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef8b64-3caa-48b2-8f30-7cfa9eff760a None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:52.199171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 331/674] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:52.204806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d8dd4-9a0c-4531-824f-1cc850dacb18 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:52.205693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d8dd4-9a0c-4531-824f-1cc850dacb18 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:52.206206 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d8dd4-9a0c-4531-824f-1cc850dacb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:52.224702 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-768d8dd4-9a0c-4531-824f-1cc850dacb18 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:52.226296 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-768d8dd4-9a0c-4531-824f-1cc850dacb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:52.254266 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:52.309231 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 344/675] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:20:52.579323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef8b64-3caa-48b2-8f30-7cfa9eff760a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:52.697196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef8b64-3caa-48b2-8f30-7cfa9eff760a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:52.713980 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:52.731783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ad913-196e-477a-a153-778962d6f371 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:52.732073 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ad913-196e-477a-a153-778962d6f371 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:52.732360 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ad913-196e-477a-a153-778962d6f371 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:52.733987 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 345/676] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:52.734822 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5f14e-2dcf-4bf7-9ad2-6e77260ce1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:52.735694 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5f14e-2dcf-4bf7-9ad2-6e77260ce1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:52.736193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5f14e-2dcf-4bf7-9ad2-6e77260ce1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:52.736696 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5f14e-2dcf-4bf7-9ad2-6e77260ce1f7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:52.739092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed248f-6941-46a9-b0bb-beec101eb68d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:52.739382 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed248f-6941-46a9-b0bb-beec101eb68d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:52.739662 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed248f-6941-46a9-b0bb-beec101eb68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:52.748148 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5f14e-2dcf-4bf7-9ad2-6e77260ce1f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:20:52.753259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-5ab5f14e-2dcf-4bf7-9ad2-6e77260ce1f7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 12:20:52.753259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:52.753259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:52.753259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:52.753259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:52.753259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:52.753259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:52.753259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:52.753259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:52.753259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:52.753259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:52.753259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:52.753259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:20:52.753259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:20:52.753259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:20:52.753259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:20:52.754220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:20:52.754220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:20:52.754220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:20:52.754220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:20:52.754220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:52.754220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:52.754220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:52.754220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:52.754220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:52.754220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:52.754220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:52.754220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:52.754220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:52.754220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:52.754220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:52.754220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:52.755073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:52.755073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:52.755073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:52.755073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:52.755073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:20:52.755073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:20:52.755073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:20:52.755073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:20:52.755073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:20:52.755073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:20:52.755073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 12:20:52.755073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:52.758020 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 332/677] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Oct 31 12:20:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:52.765175 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-16ed248f-6941-46a9-b0bb-beec101eb68d None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:52.765175 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-16ed248f-6941-46a9-b0bb-beec101eb68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:52.766407 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5f14e-2dcf-4bf7-9ad2-6e77260ce1f7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:52.848434 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 346/678] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 12:20:52.850500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f2d9d-9acc-48c8-8b17-e5558a25b2d0 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:52.850943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f2d9d-9acc-48c8-8b17-e5558a25b2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:52.851735 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f2d9d-9acc-48c8-8b17-e5558a25b2d0 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:52.853635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 347/679] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:52.859131 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1994e-f32b-485f-85b0-e134533f346d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:52.859414 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1994e-f32b-485f-85b0-e134533f346d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:52.859686 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1994e-f32b-485f-85b0-e134533f346d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:52.878712 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d4b1994e-f32b-485f-85b0-e134533f346d None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:52.879684 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5f14e-2dcf-4bf7-9ad2-6e77260ce1f7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:52.879903 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d4b1994e-f32b-485f-85b0-e134533f346d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:52.920559 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63107c-df09-45ed-8cd9-8545674c4518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:52.921259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63107c-df09-45ed-8cd9-8545674c4518 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:52.921543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63107c-df09-45ed-8cd9-8545674c4518 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:52.921865 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63107c-df09-45ed-8cd9-8545674c4518 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:52.922956 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63107c-df09-45ed-8cd9-8545674c4518 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:52.923315 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63107c-df09-45ed-8cd9-8545674c4518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:52.924748 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63107c-df09-45ed-8cd9-8545674c4518 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:52.939509 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 333/680] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Oct 31 12:20:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:52.942054 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63107c-df09-45ed-8cd9-8545674c4518 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:52.961624 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 348/681] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 12:20:52.984776 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:53.047084 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63107c-df09-45ed-8cd9-8545674c4518 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:53.081963 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842efa9-a837-4b22-b89e-86e409bbb9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:53.082596 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842efa9-a837-4b22-b89e-86e409bbb9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:53.082875 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842efa9-a837-4b22-b89e-86e409bbb9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:53.083147 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842efa9-a837-4b22-b89e-86e409bbb9a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:53.095381 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842efa9-a837-4b22-b89e-86e409bbb9a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:53.096844 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842efa9-a837-4b22-b89e-86e409bbb9a9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:53.111491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-d842efa9-a837-4b22-b89e-86e409bbb9a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:53.111491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:53.111491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:53.111491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:53.111491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:53.111491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:53.111491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:53.111491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:53.111491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:53.111491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:53.111491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:53.111491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:53.111491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:53.111491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:53.111491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:53.111491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:53.112433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:53.112433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:53.112433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:53.112433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:53.112433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:53.112433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:53.112433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:53.112433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:53.112433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:53.112433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:53.112433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:53.112433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:53.112433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:53.112433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:53.112433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:53.112433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:53.112433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:53.113392 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:53.113392 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:53.113392 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:53.117231 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 334/682] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:53.119239 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1994e-f32b-485f-85b0-e134533f346d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:53.125276 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842efa9-a837-4b22-b89e-86e409bbb9a9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:53.145870 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:53.223326 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:53.242684 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842efa9-a837-4b22-b89e-86e409bbb9a9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:53.243925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1994e-f32b-485f-85b0-e134533f346d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:53.282806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409b0d7-d348-42ef-a1ab-c80d27de8703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:53.283438 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409b0d7-d348-42ef-a1ab-c80d27de8703 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:53.283711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409b0d7-d348-42ef-a1ab-c80d27de8703 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:53.283989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409b0d7-d348-42ef-a1ab-c80d27de8703 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:53.284905 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409b0d7-d348-42ef-a1ab-c80d27de8703 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:53.285246 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409b0d7-d348-42ef-a1ab-c80d27de8703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:53.286651 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409b0d7-d348-42ef-a1ab-c80d27de8703 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:53.288245 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67747631-0cb0-4465-90de-9788b8acb678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:53.289068 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67747631-0cb0-4465-90de-9788b8acb678 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:53.289521 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67747631-0cb0-4465-90de-9788b8acb678 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:53.289963 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67747631-0cb0-4465-90de-9788b8acb678 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:53.290550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67747631-0cb0-4465-90de-9788b8acb678 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:53.291912 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67747631-0cb0-4465-90de-9788b8acb678 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:53.299684 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 349/683] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:53.300347 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409b0d7-d348-42ef-a1ab-c80d27de8703 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:53.307627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-67747631-0cb0-4465-90de-9788b8acb678 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 12:20:53.307627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:53.307627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:20:53.307627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:20:53.307627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:20:53.307627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:20:53.307627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:20:53.307627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:53.307627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 12:20:53.307627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:53.307627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:20:53.307627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:53.307627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:53.307627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:53.307627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:53.307627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:53.308551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:53.308551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:53.308551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:53.308551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:53.308551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:53.308551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:53.308551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:53.308551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:20:53.308551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:20:53.308551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:20:53.308551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:20:53.308551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:53.308551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:53.308551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:53.308551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:53.308551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:53.308551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:53.309830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:53.309830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:53.309830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:53.309830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:53.309830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:53.309830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:53.309830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:53.309830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:53.309830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:53.309830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:53.309830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:20:53.309830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:53.309830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 12:20:53.309830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:53.309830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 335/684] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Oct 31 12:20:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:20:53.310632 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67747631-0cb0-4465-90de-9788b8acb678 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:53.393172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:53.414470 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409b0d7-d348-42ef-a1ab-c80d27de8703 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:53.417508 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67747631-0cb0-4465-90de-9788b8acb678 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:53.447061 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825b7b0-00b4-42a5-ab43-aa7c09a08097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:53.447676 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825b7b0-00b4-42a5-ab43-aa7c09a08097 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:53.447953 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825b7b0-00b4-42a5-ab43-aa7c09a08097 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:53.448220 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825b7b0-00b4-42a5-ab43-aa7c09a08097 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:53.448799 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825b7b0-00b4-42a5-ab43-aa7c09a08097 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:53.449873 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd4ad2-a431-4f9f-a888-07219cbbe288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:53.450178 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825b7b0-00b4-42a5-ab43-aa7c09a08097 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:53.450540 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd4ad2-a431-4f9f-a888-07219cbbe288 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:53.450765 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd4ad2-a431-4f9f-a888-07219cbbe288 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:53.451032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd4ad2-a431-4f9f-a888-07219cbbe288 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:53.458283 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd4ad2-a431-4f9f-a888-07219cbbe288 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:53.459244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-c825b7b0-00b4-42a5-ab43-aa7c09a08097 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 12:20:53.459244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:53.459244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:20:53.459244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:20:53.459244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:20:53.459244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:20:53.459244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:20:53.459244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:53.459244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 12:20:53.459244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:53.459244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:20:53.459244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:53.459244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:53.459244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:53.459244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:53.459244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:53.459244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:53.460333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:53.460333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:53.460333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:53.460333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:53.460333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:53.460333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:53.460333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:20:53.460333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:20:53.460333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:20:53.460333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:20:53.460333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:53.460333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:53.460333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:53.460333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:53.460333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:53.460333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:53.461261 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:53.461261 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:53.461261 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:53.461261 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:53.461261 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:53.461261 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:53.461261 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:53.461261 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:53.461261 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:53.461261 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:53.461261 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:20:53.461261 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:53.461261 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 12:20:53.461261 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:53.462058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd4ad2-a431-4f9f-a888-07219cbbe288 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:53.462129 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 350/685] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Oct 31 12:20:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:53.462129 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825b7b0-00b4-42a5-ab43-aa7c09a08097 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:53.472271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-56bd4ad2-a431-4f9f-a888-07219cbbe288 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 12:20:53.472271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:53.472271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:53.472271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:53.472271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:53.472271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:53.472271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:53.472271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:53.472271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:53.472271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:53.472271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:53.472271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:53.472271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:20:53.472271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:20:53.472271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:20:53.472271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:20:53.473450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:53.473450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:53.473450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:20:53.473450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:53.473450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:20:53.473450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:20:53.473450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:53.473450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:53.473450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:53.473450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:53.473450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:53.473450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:53.473450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:53.473450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:53.473450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:53.473450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:53.473450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:53.473450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:53.474422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:53.474422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:53.474422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:20:53.474422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:20:53.474422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:20:53.474422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:20:53.474422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:20:53.474422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:20:53.474422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 12:20:53.474422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:53.474422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 336/686] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Oct 31 12:20:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:53.475537 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17693215-7e43-4cfa-a2ef-f2b6d82c9b06 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:53.475537 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17693215-7e43-4cfa-a2ef-f2b6d82c9b06 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:53.475670 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17693215-7e43-4cfa-a2ef-f2b6d82c9b06 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:53.476820 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 337/687] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:53.477528 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17693215-7e43-4cfa-a2ef-f2b6d82c9b06 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:53.494274 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:53.564758 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825b7b0-00b4-42a5-ab43-aa7c09a08097 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:53.577427 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17693215-7e43-4cfa-a2ef-f2b6d82c9b06 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:53.597255 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81862bdd-2a06-4db6-ba68-eaf1db594019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:53.597855 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81862bdd-2a06-4db6-ba68-eaf1db594019 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:53.598193 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81862bdd-2a06-4db6-ba68-eaf1db594019 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:53.598470 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81862bdd-2a06-4db6-ba68-eaf1db594019 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:53.599104 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81862bdd-2a06-4db6-ba68-eaf1db594019 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:53.599407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81862bdd-2a06-4db6-ba68-eaf1db594019 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:53.601337 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81862bdd-2a06-4db6-ba68-eaf1db594019 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:53.605934 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 351/688] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Oct 31 12:20:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:53.606697 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81862bdd-2a06-4db6-ba68-eaf1db594019 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:53.615385 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296777a-1d90-4451-ae3c-8341b1aeaf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:53.615980 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296777a-1d90-4451-ae3c-8341b1aeaf64 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:53.616265 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296777a-1d90-4451-ae3c-8341b1aeaf64 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:53.616541 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296777a-1d90-4451-ae3c-8341b1aeaf64 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:53.616967 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:53.617202 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296777a-1d90-4451-ae3c-8341b1aeaf64 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:53.617507 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296777a-1d90-4451-ae3c-8341b1aeaf64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:53.619063 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296777a-1d90-4451-ae3c-8341b1aeaf64 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:53.624244 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 338/689] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 31 12:20:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:53.625399 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33e617-2a68-41af-bc48-9f22849cbf56 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:53.625688 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33e617-2a68-41af-bc48-9f22849cbf56 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:53.625964 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33e617-2a68-41af-bc48-9f22849cbf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:53.643098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-df33e617-2a68-41af-bc48-9f22849cbf56 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:53.644328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-df33e617-2a68-41af-bc48-9f22849cbf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:53.708692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81862bdd-2a06-4db6-ba68-eaf1db594019 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:53.710498 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 339/690] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:20:53.711379 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33e617-2a68-41af-bc48-9f22849cbf56 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:53.730089 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:53.748069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b362e8-986f-4f29-a454-f3542b151cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:53.748875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b362e8-986f-4f29-a454-f3542b151cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:53.749183 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b362e8-986f-4f29-a454-f3542b151cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:53.749469 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b362e8-986f-4f29-a454-f3542b151cb4 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:53.750195 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b362e8-986f-4f29-a454-f3542b151cb4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:53.750499 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b362e8-986f-4f29-a454-f3542b151cb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:53.752031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b362e8-986f-4f29-a454-f3542b151cb4 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:53.770567 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 352/691] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Oct 31 12:20:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:53.772218 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b362e8-986f-4f29-a454-f3542b151cb4 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:53.829147 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33e617-2a68-41af-bc48-9f22849cbf56 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:53.838649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:53.867470 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2608f4-4a68-4973-8173-7265a25fbe67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:53.868236 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2608f4-4a68-4973-8173-7265a25fbe67 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:53.868667 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2608f4-4a68-4973-8173-7265a25fbe67 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:53.868989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2608f4-4a68-4973-8173-7265a25fbe67 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:53.869657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2608f4-4a68-4973-8173-7265a25fbe67 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:53.869960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2608f4-4a68-4973-8173-7265a25fbe67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:53.871317 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2608f4-4a68-4973-8173-7265a25fbe67 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:53.874324 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b362e8-986f-4f29-a454-f3542b151cb4 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:53.876336 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 340/692] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Oct 31 12:20:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:53.877344 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2608f4-4a68-4973-8173-7265a25fbe67 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:53.918362 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26104e-04bb-4db0-8352-cda01c861c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:53.918889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26104e-04bb-4db0-8352-cda01c861c36 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:53.919167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26104e-04bb-4db0-8352-cda01c861c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:53.919436 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26104e-04bb-4db0-8352-cda01c861c36 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:53.920065 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26104e-04bb-4db0-8352-cda01c861c36 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:53.920369 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26104e-04bb-4db0-8352-cda01c861c36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:53.921896 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26104e-04bb-4db0-8352-cda01c861c36 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:53.931397 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 353/693] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 31 12:20:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:53.931397 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26104e-04bb-4db0-8352-cda01c861c36 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:53.959877 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:53.992119 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2608f4-4a68-4973-8173-7265a25fbe67 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:54.026290 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1888389-43f7-4480-b869-f0b65fc528e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:54.026898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1888389-43f7-4480-b869-f0b65fc528e9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:54.027190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1888389-43f7-4480-b869-f0b65fc528e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:54.027450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1888389-43f7-4480-b869-f0b65fc528e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:54.031215 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26104e-04bb-4db0-8352-cda01c861c36 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:54.058849 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:54.065070 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e204f-d0ac-41fc-889e-bb0f57a97780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:54.065712 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e204f-d0ac-41fc-889e-bb0f57a97780 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:54.065995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e204f-d0ac-41fc-889e-bb0f57a97780 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:54.066268 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e204f-d0ac-41fc-889e-bb0f57a97780 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:54.066932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e204f-d0ac-41fc-889e-bb0f57a97780 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:54.068321 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e204f-d0ac-41fc-889e-bb0f57a97780 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:54.091687 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 354/694] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:20:53 2022] POST /identity/v3/endpoints => generated 347 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:20:54.092502 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e204f-d0ac-41fc-889e-bb0f57a97780 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:54.098745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1888389-43f7-4480-b869-f0b65fc528e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:54.100266 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1888389-43f7-4480-b869-f0b65fc528e9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:54.179495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:54.215146 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 341/695] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:20:53 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 12:20:54.216527 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1888389-43f7-4480-b869-f0b65fc528e9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:54.231762 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e204f-d0ac-41fc-889e-bb0f57a97780 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:54.273028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debaa85-bc16-4c50-8059-2356ed795d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:54.273028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debaa85-bc16-4c50-8059-2356ed795d51 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:54.273748 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debaa85-bc16-4c50-8059-2356ed795d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:54.273748 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debaa85-bc16-4c50-8059-2356ed795d51 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:54.274120 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debaa85-bc16-4c50-8059-2356ed795d51 None admin] RBAC: Adding query filter params (interface=public, service_id=fa672803a9fb405290e6d02d7dacee2d, region_id=RegionOne) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:54.274359 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debaa85-bc16-4c50-8059-2356ed795d51 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:54.275804 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debaa85-bc16-4c50-8059-2356ed795d51 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:54.282010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 355/696] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Oct 31 12:20:54 2022] GET /identity/v3/endpoints?service_id=fa672803a9fb405290e6d02d7dacee2d&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:54.282010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debaa85-bc16-4c50-8059-2356ed795d51 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:54.335164 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:54.341348 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1888389-43f7-4480-b869-f0b65fc528e9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:54.378599 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350376f0-af51-4c2f-a738-fd964c35c521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:54.379235 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350376f0-af51-4c2f-a738-fd964c35c521 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:54.379973 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350376f0-af51-4c2f-a738-fd964c35c521 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:54.380253 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350376f0-af51-4c2f-a738-fd964c35c521 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:54.380838 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350376f0-af51-4c2f-a738-fd964c35c521 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:54.382912 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350376f0-af51-4c2f-a738-fd964c35c521 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:54.391775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debaa85-bc16-4c50-8059-2356ed795d51 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:54.392731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-350376f0-af51-4c2f-a738-fd964c35c521 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 12:20:54.392731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:54.392731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:20:54.392731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:20:54.392731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:20:54.392731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:20:54.392731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:20:54.392731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:54.392731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 12:20:54.392731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:54.392731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:20:54.392731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:54.392731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:54.392731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:54.392731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:54.392731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:54.392731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:54.393740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:54.393740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:54.393740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:54.393740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:54.393740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:54.393740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:54.393740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:20:54.393740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:20:54.393740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:20:54.393740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:20:54.393740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:54.393740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:54.393740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:54.393740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:54.393740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:54.393740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:54.394581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:54.394581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:54.394581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:54.394581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:54.394581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:54.394581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:54.394581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:54.394581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:54.394581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:54.394581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:54.394581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:20:54.394581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:54.394581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 12:20:54.394581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:54.394581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 342/697] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 31 12:20:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:54.395364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350376f0-af51-4c2f-a738-fd964c35c521 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:54.432511 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e2ed8-4ccc-4cc3-ac2c-fd188f1e3f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:54.432869 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:54.433044 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e2ed8-4ccc-4cc3-ac2c-fd188f1e3f4f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:54.433353 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e2ed8-4ccc-4cc3-ac2c-fd188f1e3f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:54.433780 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e2ed8-4ccc-4cc3-ac2c-fd188f1e3f4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:54.445465 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e2ed8-4ccc-4cc3-ac2c-fd188f1e3f4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:54.446924 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e2ed8-4ccc-4cc3-ac2c-fd188f1e3f4f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:54.461497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-f53e2ed8-4ccc-4cc3-ac2c-fd188f1e3f4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:54.461497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:54.461497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:54.461497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:54.461497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:54.461497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:54.461497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:54.461497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:54.461497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:54.461497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:54.461497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:54.461497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:54.461497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:20:54.461497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:20:54.461497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:20:54.461497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:20:54.462441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:54.462441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:54.462441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:54.462441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:54.462441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:54.462441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:54.462441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:54.462441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:54.462441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:54.462441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:54.462441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:54.462441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:54.462441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:54.462441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:54.462441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:54.462441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:54.462441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:20:54.463353 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:20:54.463353 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:20:54.463353 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:54.463353 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 356/698] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:54.463585 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e2ed8-4ccc-4cc3-ac2c-fd188f1e3f4f None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:54.508071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350376f0-af51-4c2f-a738-fd964c35c521 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:54.546426 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cff97-cb03-4fd4-9c0c-8d78e476af31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:54.547068 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cff97-cb03-4fd4-9c0c-8d78e476af31 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:54.547351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cff97-cb03-4fd4-9c0c-8d78e476af31 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:54.547626 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cff97-cb03-4fd4-9c0c-8d78e476af31 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:54.548237 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cff97-cb03-4fd4-9c0c-8d78e476af31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:54.549663 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28cff97-cb03-4fd4-9c0c-8d78e476af31 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:54.556838 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 343/699] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Oct 31 12:20:54 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:20:54.557659 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cff97-cb03-4fd4-9c0c-8d78e476af31 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:54.577523 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:54.583349 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e2ed8-4ccc-4cc3-ac2c-fd188f1e3f4f None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:54.627273 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa01eb-397f-4f38-956a-ecd41c8b3db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:54.627896 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa01eb-397f-4f38-956a-ecd41c8b3db8 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:54.628176 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa01eb-397f-4f38-956a-ecd41c8b3db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:54.628446 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa01eb-397f-4f38-956a-ecd41c8b3db8 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:54.629082 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa01eb-397f-4f38-956a-ecd41c8b3db8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:54.629420 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa01eb-397f-4f38-956a-ecd41c8b3db8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:54.630829 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa01eb-397f-4f38-956a-ecd41c8b3db8 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:54.641576 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 357/700] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 31 12:20:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:54.643320 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa01eb-397f-4f38-956a-ecd41c8b3db8 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:54.697652 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:54.700636 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cff97-cb03-4fd4-9c0c-8d78e476af31 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:54.743402 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3423c-2969-48e9-879e-d7af243a1c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:54.745127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3423c-2969-48e9-879e-d7af243a1c1c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:54.745412 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3423c-2969-48e9-879e-d7af243a1c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:54.745687 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3423c-2969-48e9-879e-d7af243a1c1c None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:54.746662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3423c-2969-48e9-879e-d7af243a1c1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:54.746966 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3423c-2969-48e9-879e-d7af243a1c1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:54.748623 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3423c-2969-48e9-879e-d7af243a1c1c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:54.762428 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 344/701] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:54.768670 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3423c-2969-48e9-879e-d7af243a1c1c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:54.771719 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa01eb-397f-4f38-956a-ecd41c8b3db8 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:54.810355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd25e78-9c09-4111-a84a-59658aa14d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:54.810966 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd25e78-9c09-4111-a84a-59658aa14d5e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:54.811414 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd25e78-9c09-4111-a84a-59658aa14d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:54.811694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd25e78-9c09-4111-a84a-59658aa14d5e None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:54.812650 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd25e78-9c09-4111-a84a-59658aa14d5e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:54.813246 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd25e78-9c09-4111-a84a-59658aa14d5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:54.814611 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd25e78-9c09-4111-a84a-59658aa14d5e None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:54.821077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 358/702] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 31 12:20:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:54.830453 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd25e78-9c09-4111-a84a-59658aa14d5e None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:54.868182 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:54.903233 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3423c-2969-48e9-879e-d7af243a1c1c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:54.942040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a66308-d297-4db4-b23f-5d04a47ee2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:54.942916 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a66308-d297-4db4-b23f-5d04a47ee2c6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:54.943383 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a66308-d297-4db4-b23f-5d04a47ee2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:54.943839 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a66308-d297-4db4-b23f-5d04a47ee2c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:54.951767 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a66308-d297-4db4-b23f-5d04a47ee2c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:54.953396 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a66308-d297-4db4-b23f-5d04a47ee2c6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:54.958275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd25e78-9c09-4111-a84a-59658aa14d5e None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:54.965948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-25a66308-d297-4db4-b23f-5d04a47ee2c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:54.965948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:54.965948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:54.965948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:54.965948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:54.965948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:54.965948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:54.965948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:54.965948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:54.965948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:54.965948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:54.965948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:54.965948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:20:54.965948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:20:54.965948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:20:54.967028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:20:54.967028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:54.967028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:54.967028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:54.967028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:54.967028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:54.967028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:54.967028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:54.967028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:54.967028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:54.967028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:54.967028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:54.967028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:54.967028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:54.967028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:54.967028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:54.967028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:54.968131 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:20:54.968131 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:20:54.968131 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:20:54.968131 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:20:54.968131 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:20:54.968131 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:20:54.968131 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:20:54.968131 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:54.970143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 345/703] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:20:54.980869 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a66308-d297-4db4-b23f-5d04a47ee2c6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:55.000418 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b839228-0162-44cf-af98-c856be1f7b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:55.001242 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b839228-0162-44cf-af98-c856be1f7b6a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:55.001696 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b839228-0162-44cf-af98-c856be1f7b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:55.002106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b839228-0162-44cf-af98-c856be1f7b6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:55.002870 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:55.002987 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b839228-0162-44cf-af98-c856be1f7b6a None admin] RBAC: Adding query filter params (interface=public, service_id=68e2b9a315f245eab8a5b97d127d88ad, region_id=RegionOne) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:55.003732 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b839228-0162-44cf-af98-c856be1f7b6a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:55.005347 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b839228-0162-44cf-af98-c856be1f7b6a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:55.015947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 359/704] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Oct 31 12:20:54 2022] GET /identity/v3/endpoints?service_id=68e2b9a315f245eab8a5b97d127d88ad&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:55.018056 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b839228-0162-44cf-af98-c856be1f7b6a None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:55.099064 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a66308-d297-4db4-b23f-5d04a47ee2c6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:55.120691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:55.136323 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b839228-0162-44cf-af98-c856be1f7b6a None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:55.141334 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87752262-d02f-44c5-8b0e-e2e540a29feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:55.142052 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87752262-d02f-44c5-8b0e-e2e540a29feb None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:55.142438 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87752262-d02f-44c5-8b0e-e2e540a29feb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:55.142892 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87752262-d02f-44c5-8b0e-e2e540a29feb None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:55.143687 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87752262-d02f-44c5-8b0e-e2e540a29feb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:55.144123 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87752262-d02f-44c5-8b0e-e2e540a29feb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:55.145670 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87752262-d02f-44c5-8b0e-e2e540a29feb None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:55.163328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 346/705] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:20:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:55.166594 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87752262-d02f-44c5-8b0e-e2e540a29feb None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:55.179305 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22d6bd-45c2-4b92-9852-0659ef3d40fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:55.180083 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22d6bd-45c2-4b92-9852-0659ef3d40fe None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:55.180481 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22d6bd-45c2-4b92-9852-0659ef3d40fe None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:55.180856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22d6bd-45c2-4b92-9852-0659ef3d40fe None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:55.181631 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22d6bd-45c2-4b92-9852-0659ef3d40fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:55.183133 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22d6bd-45c2-4b92-9852-0659ef3d40fe None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:55.197392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 360/706] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Oct 31 12:20:55 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:20:55.273903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:55.297482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87752262-d02f-44c5-8b0e-e2e540a29feb None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:55.336749 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfaba5c-3d08-460e-9afb-e916d40b5b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:55.337785 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfaba5c-3d08-460e-9afb-e916d40b5b6b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:55.338311 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfaba5c-3d08-460e-9afb-e916d40b5b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:55.338787 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfaba5c-3d08-460e-9afb-e916d40b5b6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:55.339848 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfaba5c-3d08-460e-9afb-e916d40b5b6b None admin] RBAC: Adding query filter params (role.id=b18fbffdad824f8eb970f02bff1f2a62, scope.project.id=786ee416a639447ab3698d1f56d04e9a, user.id=912693f459f147a5a479ad01e2e8387a) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:55.340369 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfaba5c-3d08-460e-9afb-e916d40b5b6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:55.342043 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfaba5c-3d08-460e-9afb-e916d40b5b6b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:55.350672 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 347/707] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:20:55 2022] GET /identity/v3/role_assignments?user.id=912693f459f147a5a479ad01e2e8387a&scope.project.id=786ee416a639447ab3698d1f56d04e9a&role.id=b18fbffdad824f8eb970f02bff1f2a62 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:56.338855 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3764f-a39f-4131-ad7e-df7494d9c5fe None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:56.339350 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3764f-a39f-4131-ad7e-df7494d9c5fe None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:56.339350 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3764f-a39f-4131-ad7e-df7494d9c5fe None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:56.340922 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 361/708] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:56.346182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b06a6-f868-4795-b6bc-b32063a7efe2 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:56.346579 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b06a6-f868-4795-b6bc-b32063a7efe2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:56.346763 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b06a6-f868-4795-b6bc-b32063a7efe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:56.366443 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-058b06a6-f868-4795-b6bc-b32063a7efe2 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:56.367631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-058b06a6-f868-4795-b6bc-b32063a7efe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:56.441501 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 348/709] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:20:56.718467 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3764f-a39f-4131-ad7e-df7494d9c5fe None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:56.803219 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b543f38-d515-465d-8925-20273ed39182 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:56.803553 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b543f38-d515-465d-8925-20273ed39182 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:56.803781 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b543f38-d515-465d-8925-20273ed39182 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:56.805368 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 349/710] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:56.810359 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e3244-ac2f-48f0-b8dc-2d6bc181fffb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:56.810647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e3244-ac2f-48f0-b8dc-2d6bc181fffb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:56.810923 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e3244-ac2f-48f0-b8dc-2d6bc181fffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:56.830113 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b05e3244-ac2f-48f0-b8dc-2d6bc181fffb None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:56.831290 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b05e3244-ac2f-48f0-b8dc-2d6bc181fffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:56.831720 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3764f-a39f-4131-ad7e-df7494d9c5fe None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:56.880420 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed899adb-c41c-47c9-bdd4-661465a194ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:56.881624 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed899adb-c41c-47c9-bdd4-661465a194ac None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:56.882479 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed899adb-c41c-47c9-bdd4-661465a194ac None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:56.883090 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed899adb-c41c-47c9-bdd4-661465a194ac None admin] PATH_INFO: `/v3/services/compute` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:56.883914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed899adb-c41c-47c9-bdd4-661465a194ac None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:56.886073 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed899adb-c41c-47c9-bdd4-661465a194ac None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:56.898554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-ed899adb-c41c-47c9-bdd4-661465a194ac None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 12:20:56.898554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:56.898554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:20:56.898554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:20:56.898554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:20:56.898554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:20:56.898554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:20:56.898554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:56.898554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 12:20:56.898554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:56.898554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:20:56.898554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:56.898554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:56.898554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:56.898554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:56.898554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:56.898554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:56.899751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:56.899751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:56.899751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:56.899751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:56.899751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:56.899751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:56.899751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:20:56.899751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:20:56.899751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:20:56.899751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:20:56.899751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:56.899751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:56.899751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:56.899751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:56.899751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:56.899751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:56.900786 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:56.900786 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:56.900786 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:56.900786 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:56.900786 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:56.900786 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:56.900786 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:56.900786 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:56.900786 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:56.900786 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:56.900786 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:20:56.900786 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:56.900786 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 12:20:56.900786 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:56.903827 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 362/711] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:20:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:20:56.913128 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 350/712] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 12:20:56.914315 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed899adb-c41c-47c9-bdd4-661465a194ac None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:56.934389 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:57.018974 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed899adb-c41c-47c9-bdd4-661465a194ac None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:57.054759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c37b1-b81c-47ef-a89e-d10f9ed20e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:57.055367 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c37b1-b81c-47ef-a89e-d10f9ed20e0d None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:57.055647 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c37b1-b81c-47ef-a89e-d10f9ed20e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:57.055919 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c37b1-b81c-47ef-a89e-d10f9ed20e0d None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:57.056546 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c37b1-b81c-47ef-a89e-d10f9ed20e0d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:57.056846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c37b1-b81c-47ef-a89e-d10f9ed20e0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:57.058226 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c37b1-b81c-47ef-a89e-d10f9ed20e0d None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:57.063377 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 363/713] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 31 12:20:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:57.069672 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e3244-ac2f-48f0-b8dc-2d6bc181fffb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:57.074627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:57.177926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e3244-ac2f-48f0-b8dc-2d6bc181fffb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:57.193288 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c37b1-b81c-47ef-a89e-d10f9ed20e0d None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:57.219757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8867eb5-4166-4a9c-bb05-1a034d0ad8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:57.220382 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8867eb5-4166-4a9c-bb05-1a034d0ad8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:57.220660 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8867eb5-4166-4a9c-bb05-1a034d0ad8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:57.220935 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8867eb5-4166-4a9c-bb05-1a034d0ad8c0 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:57.221607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8867eb5-4166-4a9c-bb05-1a034d0ad8c0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:57.221910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8867eb5-4166-4a9c-bb05-1a034d0ad8c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:57.223269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8867eb5-4166-4a9c-bb05-1a034d0ad8c0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:57.228375 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 351/714] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 31 12:20:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:57.296083 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:57.324829 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c37b1-b81c-47ef-a89e-d10f9ed20e0d None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:57.363599 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d5c3f-1b32-45ae-b28c-4523f4cb38a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:57.365058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d5c3f-1b32-45ae-b28c-4523f4cb38a6 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:57.366108 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d5c3f-1b32-45ae-b28c-4523f4cb38a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:57.366613 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d5c3f-1b32-45ae-b28c-4523f4cb38a6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:57.367451 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d5c3f-1b32-45ae-b28c-4523f4cb38a6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:57.369092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d5c3f-1b32-45ae-b28c-4523f4cb38a6 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:57.379346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-1f0d5c3f-1b32-45ae-b28c-4523f4cb38a6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 12:20:57.379346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:57.379346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:20:57.379346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:20:57.379346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:20:57.379346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:20:57.379346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:20:57.379346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:57.379346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 12:20:57.379346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:57.379346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:20:57.379346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:57.379346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:57.379346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:57.379346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:57.379346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:57.379346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:57.380431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:57.380431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:57.380431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:57.380431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:57.380431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:57.380431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:57.380431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:20:57.380431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:20:57.380431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:20:57.380431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:20:57.380431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:57.380431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:57.380431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:57.380431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:57.380431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:57.380431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:57.381891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:57.381891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:57.381891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:57.381891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:57.381891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:57.381891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:57.381891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:57.381891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:57.381891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:57.381891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:57.381891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:20:57.381891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:57.381891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 12:20:57.381891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:57.384872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 364/715] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Oct 31 12:20:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:20:57.390800 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8867eb5-4166-4a9c-bb05-1a034d0ad8c0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:57.412834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a646eb-3039-4111-a353-6c1ff86c14f1 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:57.413509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a646eb-3039-4111-a353-6c1ff86c14f1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:57.414007 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a646eb-3039-4111-a353-6c1ff86c14f1 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:57.415822 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 365/716] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:57.421902 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f497984-7249-41af-9ba2-f402058a1a4b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:57.422198 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f497984-7249-41af-9ba2-f402058a1a4b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:57.422461 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f497984-7249-41af-9ba2-f402058a1a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:57.445587 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-8f497984-7249-41af-9ba2-f402058a1a4b None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:57.447454 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8f497984-7249-41af-9ba2-f402058a1a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:57.468218 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:57.513901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8867eb5-4166-4a9c-bb05-1a034d0ad8c0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:57.553372 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 366/717] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:20:57.561505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab14110-570d-4e81-b1f6-32da848765bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:57.562115 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab14110-570d-4e81-b1f6-32da848765bb None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:57.562391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab14110-570d-4e81-b1f6-32da848765bb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:57.562709 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab14110-570d-4e81-b1f6-32da848765bb None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:57.563344 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab14110-570d-4e81-b1f6-32da848765bb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:57.563638 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab14110-570d-4e81-b1f6-32da848765bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:57.564983 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab14110-570d-4e81-b1f6-32da848765bb None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:57.570898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 352/718] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 31 12:20:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:57.580337 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f497984-7249-41af-9ba2-f402058a1a4b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:57.628951 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79756a8-9489-49f1-b9f2-71f0141b860b None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:57.629423 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79756a8-9489-49f1-b9f2-71f0141b860b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:57.629810 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79756a8-9489-49f1-b9f2-71f0141b860b None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:57.632273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 353/719] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:20:57.637310 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a54f2-ea19-4d0a-90c0-7574d83bb120 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:57.637666 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a54f2-ea19-4d0a-90c0-7574d83bb120 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:57.638009 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a54f2-ea19-4d0a-90c0-7574d83bb120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:57.656902 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-619a54f2-ea19-4d0a-90c0-7574d83bb120 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:57.658189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-619a54f2-ea19-4d0a-90c0-7574d83bb120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:57.662561 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:57.695137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f497984-7249-41af-9ba2-f402058a1a4b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:57.737472 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 354/720] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:20:57.739329 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744fbad-f1b4-4196-8624-cfbe5669d21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:57.740178 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744fbad-f1b4-4196-8624-cfbe5669d21d None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:57.741269 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744fbad-f1b4-4196-8624-cfbe5669d21d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:57.741727 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744fbad-f1b4-4196-8624-cfbe5669d21d None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:57.742534 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744fbad-f1b4-4196-8624-cfbe5669d21d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:57.743029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744fbad-f1b4-4196-8624-cfbe5669d21d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:57.744572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744fbad-f1b4-4196-8624-cfbe5669d21d None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:57.750193 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 367/721] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 31 12:20:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:20:57.756037 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a54f2-ea19-4d0a-90c0-7574d83bb120 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:57.819887 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:57.834143 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744fbad-f1b4-4196-8624-cfbe5669d21d None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:57.866638 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a54f2-ea19-4d0a-90c0-7574d83bb120 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:57.912034 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623f1b9-a1ef-4dc5-80c7-680778b49543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:57.913746 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623f1b9-a1ef-4dc5-80c7-680778b49543 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:57.914211 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623f1b9-a1ef-4dc5-80c7-680778b49543 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:57.914893 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623f1b9-a1ef-4dc5-80c7-680778b49543 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:57.916708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623f1b9-a1ef-4dc5-80c7-680778b49543 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:57.918278 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623f1b9-a1ef-4dc5-80c7-680778b49543 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:57.957375 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 355/722] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:20:57 2022] POST /identity/v3/endpoints => generated 349 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:20:57.959980 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744fbad-f1b4-4196-8624-cfbe5669d21d None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:58.006476 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623f1b9-a1ef-4dc5-80c7-680778b49543 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:58.007921 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee7a21-f095-4a52-a0f5-bf0a46cceea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:58.008565 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee7a21-f095-4a52-a0f5-bf0a46cceea2 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:58.008843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee7a21-f095-4a52-a0f5-bf0a46cceea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:58.009467 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee7a21-f095-4a52-a0f5-bf0a46cceea2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:58.011141 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee7a21-f095-4a52-a0f5-bf0a46cceea2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:58.012571 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee7a21-f095-4a52-a0f5-bf0a46cceea2 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:58.016801 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:58.027085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-f7ee7a21-f095-4a52-a0f5-bf0a46cceea2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 12:20:58.027085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:58.027085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:20:58.027085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:20:58.027085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:20:58.027085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:20:58.027085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:20:58.027085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:58.027085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 12:20:58.027085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:58.027085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:20:58.027085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:58.027085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:58.027085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:58.027085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:58.027085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:58.027085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:58.028162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:58.028162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:58.028162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:58.028162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:58.028162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:58.028162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:58.028162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:20:58.028162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:20:58.028162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:20:58.028162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:20:58.028162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:58.028162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:58.028162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:58.028162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:58.028162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:58.028162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:58.029006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:58.029006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:58.029006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:58.029006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:58.029006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:58.029006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:58.029006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:58.029006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:58.029006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:58.029006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:58.029006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:20:58.029006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:58.029006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 12:20:58.029006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:20:58.029006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 368/723] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 31 12:20:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:20:58.034763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee7a21-f095-4a52-a0f5-bf0a46cceea2 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:58.128114 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623f1b9-a1ef-4dc5-80c7-680778b49543 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:58.149624 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:58.181319 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee7a21-f095-4a52-a0f5-bf0a46cceea2 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:58.183884 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92865094-63cb-47a1-a9ee-854276b18db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:58.184531 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92865094-63cb-47a1-a9ee-854276b18db5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:58.184811 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92865094-63cb-47a1-a9ee-854276b18db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:58.185088 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92865094-63cb-47a1-a9ee-854276b18db5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:58.185706 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92865094-63cb-47a1-a9ee-854276b18db5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:58.187089 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92865094-63cb-47a1-a9ee-854276b18db5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:58.197888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-92865094-63cb-47a1-a9ee-854276b18db5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 12:20:58.197888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:58.197888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:20:58.197888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:20:58.197888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:20:58.197888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:20:58.197888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:20:58.197888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:58.197888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 12:20:58.197888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:58.197888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:20:58.197888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:58.197888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:20:58.197888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:20:58.197888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:20:58.197888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:20:58.197888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:20:58.198872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:20:58.198872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:20:58.198872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:20:58.198872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:20:58.198872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:20:58.198872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:20:58.198872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:20:58.198872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:20:58.198872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:20:58.198872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:20:58.198872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:20:58.198872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:20:58.198872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:20:58.198872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:20:58.198872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:20:58.198872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:20:58.199701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:20:58.199701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:20:58.199701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:20:58.199701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:20:58.199701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:20:58.199701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:20:58.199701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:20:58.199701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:20:58.199701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:20:58.199701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:20:58.199701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:20:58.199701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:20:58.199701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 12:20:58.199701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:20:58.200490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 356/724] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Oct 31 12:20:58 2022] GET /identity/v3/services/image => generated 86 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:20:58.207204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92865094-63cb-47a1-a9ee-854276b18db5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:58.227472 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c88baf-0804-4569-8700-eb071db3b2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:58.228235 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c88baf-0804-4569-8700-eb071db3b2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:58.228526 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c88baf-0804-4569-8700-eb071db3b2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:58.228802 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c88baf-0804-4569-8700-eb071db3b2d3 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:58.229596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c88baf-0804-4569-8700-eb071db3b2d3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:58.230509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c88baf-0804-4569-8700-eb071db3b2d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:58.231443 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c88baf-0804-4569-8700-eb071db3b2d3 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:58.241158 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 369/725] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 31 12:20:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:58.243805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c88baf-0804-4569-8700-eb071db3b2d3 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:58.317648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:58.317848 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92865094-63cb-47a1-a9ee-854276b18db5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:58.352474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c88baf-0804-4569-8700-eb071db3b2d3 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:58.353515 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2c0f9-2638-40e1-b13d-4e77d8d6e82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:58.354137 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2c0f9-2638-40e1-b13d-4e77d8d6e82c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:58.354420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2c0f9-2638-40e1-b13d-4e77d8d6e82c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:58.354691 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2c0f9-2638-40e1-b13d-4e77d8d6e82c None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:58.355345 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2c0f9-2638-40e1-b13d-4e77d8d6e82c None admin] RBAC: Adding query filter params (name=image) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:58.355765 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2c0f9-2638-40e1-b13d-4e77d8d6e82c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:58.357136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2c0f9-2638-40e1-b13d-4e77d8d6e82c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:58.366694 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 357/726] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:58.367731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2c0f9-2638-40e1-b13d-4e77d8d6e82c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:58.401461 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec69ab2-c366-42cc-a9c3-b1a9e62bccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:58.402125 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec69ab2-c366-42cc-a9c3-b1a9e62bccf3 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:58.402434 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec69ab2-c366-42cc-a9c3-b1a9e62bccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:58.402837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec69ab2-c366-42cc-a9c3-b1a9e62bccf3 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:58.403541 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec69ab2-c366-42cc-a9c3-b1a9e62bccf3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:58.404179 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec69ab2-c366-42cc-a9c3-b1a9e62bccf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:58.405851 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec69ab2-c366-42cc-a9c3-b1a9e62bccf3 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:58.418193 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 370/727] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Oct 31 12:20:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:58.419520 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec69ab2-c366-42cc-a9c3-b1a9e62bccf3 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:58.435126 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:58.498840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2c0f9-2638-40e1-b13d-4e77d8d6e82c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:58.535079 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f570c5f-ce7b-4a5d-9c27-f98aa2195349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:58.535740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f570c5f-ce7b-4a5d-9c27-f98aa2195349 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:58.536019 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f570c5f-ce7b-4a5d-9c27-f98aa2195349 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:58.536287 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f570c5f-ce7b-4a5d-9c27-f98aa2195349 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:58.536908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f570c5f-ce7b-4a5d-9c27-f98aa2195349 None admin] RBAC: Adding query filter params (type=image) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:20:58.537280 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f570c5f-ce7b-4a5d-9c27-f98aa2195349 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:58.538626 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f570c5f-ce7b-4a5d-9c27-f98aa2195349 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:58.543526 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 358/728] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:20:58 2022] GET /identity/v3/services?type=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:20:58.561410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec69ab2-c366-42cc-a9c3-b1a9e62bccf3 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:58.593789 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:20:58.603940 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59139b-3433-430a-ab99-43ff7ac5edf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:20:58.604485 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59139b-3433-430a-ab99-43ff7ac5edf3 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:58.604766 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59139b-3433-430a-ab99-43ff7ac5edf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:58.605038 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59139b-3433-430a-ab99-43ff7ac5edf3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:58.605761 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59139b-3433-430a-ab99-43ff7ac5edf3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:20:58.607242 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59139b-3433-430a-ab99-43ff7ac5edf3 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:20:58.632717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 371/729] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:20:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:20:59.471310 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a490ed6-8a95-49d2-85dd-f8dce1a87cc0 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:59.472376 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a490ed6-8a95-49d2-85dd-f8dce1a87cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:59.472870 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a490ed6-8a95-49d2-85dd-f8dce1a87cc0 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:59.475418 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 359/730] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:20:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:20:59.481729 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513db8a-a5d6-4338-9a22-f8c04d8d3d23 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:20:59.482683 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513db8a-a5d6-4338-9a22-f8c04d8d3d23 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:20:59.483172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513db8a-a5d6-4338-9a22-f8c04d8d3d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:20:59.503190 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d513db8a-a5d6-4338-9a22-f8c04d8d3d23 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:20:59.504682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d513db8a-a5d6-4338-9a22-f8c04d8d3d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:20:59.587040 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 372/731] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:20:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 12:20:59.860082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a490ed6-8a95-49d2-85dd-f8dce1a87cc0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:20:59.965846 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a490ed6-8a95-49d2-85dd-f8dce1a87cc0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:20:59.999617 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838da26-81ae-4535-999d-1e910a462f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:00.000375 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838da26-81ae-4535-999d-1e910a462f08 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:00.000769 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838da26-81ae-4535-999d-1e910a462f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:00.001187 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838da26-81ae-4535-999d-1e910a462f08 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:00.001947 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838da26-81ae-4535-999d-1e910a462f08 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:00.003459 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838da26-81ae-4535-999d-1e910a462f08 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:00.009321 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:00.024118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 360/732] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 31 12:20:59 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:21:00.228457 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70d6a5-193a-4cdc-86e2-83b4946568ef None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:00.228753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70d6a5-193a-4cdc-86e2-83b4946568ef None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:00.228924 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70d6a5-193a-4cdc-86e2-83b4946568ef None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:00.230595 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 373/733] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:00.236076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8da661-8dc6-4a54-a7b9-d3597abaf1d3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:00.236366 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8da661-8dc6-4a54-a7b9-d3597abaf1d3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:00.236648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8da661-8dc6-4a54-a7b9-d3597abaf1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:00.256903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3d8da661-8dc6-4a54-a7b9-d3597abaf1d3 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:00.258118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3d8da661-8dc6-4a54-a7b9-d3597abaf1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:00.339315 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 361/734] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:21:00.607995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70d6a5-193a-4cdc-86e2-83b4946568ef None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:00.721441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70d6a5-193a-4cdc-86e2-83b4946568ef None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:00.735392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:00.765492 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcec2b3-39e3-4c2c-bc5e-6f3784959870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:00.766154 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcec2b3-39e3-4c2c-bc5e-6f3784959870 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:00.766435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcec2b3-39e3-4c2c-bc5e-6f3784959870 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:00.766708 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcec2b3-39e3-4c2c-bc5e-6f3784959870 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:00.767318 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcec2b3-39e3-4c2c-bc5e-6f3784959870 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:00.768733 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcec2b3-39e3-4c2c-bc5e-6f3784959870 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:00.778777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-5bcec2b3-39e3-4c2c-bc5e-6f3784959870 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 12:21:00.778777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:00.778777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:21:00.778777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:21:00.778777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:21:00.778777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:21:00.778777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:21:00.778777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:21:00.778777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 12:21:00.778777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:00.778777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:21:00.778777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:00.778777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:00.778777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:00.778777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:00.778777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:00.778777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:00.779887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:00.779887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:00.779887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:00.779887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:00.779887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:00.779887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:00.779887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:21:00.779887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:21:00.779887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:21:00.779887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:21:00.779887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:00.779887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:00.779887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:00.779887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:00.779887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:00.779887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:00.780759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:00.780759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:00.780759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:00.780759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:00.780759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:00.780759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:00.780759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:00.780759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:00.780759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:00.780759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:00.780759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:21:00.780759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:21:00.780759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 12:21:00.780759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:00.780759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 374/735] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Oct 31 12:21:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:21:00.786572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8da661-8dc6-4a54-a7b9-d3597abaf1d3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:00.835168 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e707e-8dc3-408a-855b-04761aed4e37 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:00.835445 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e707e-8dc3-408a-855b-04761aed4e37 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:00.835879 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e707e-8dc3-408a-855b-04761aed4e37 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:00.837645 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 375/736] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:21:00.842657 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631ebcf-2171-452c-bb6c-ff75fc88c20a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:00.842938 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631ebcf-2171-452c-bb6c-ff75fc88c20a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:00.843209 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631ebcf-2171-452c-bb6c-ff75fc88c20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:00.866532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-9631ebcf-2171-452c-bb6c-ff75fc88c20a None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:00.869194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9631ebcf-2171-452c-bb6c-ff75fc88c20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:00.896325 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:00.902738 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8da661-8dc6-4a54-a7b9-d3597abaf1d3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:00.937244 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc870b7-fb16-4fe7-b210-b0cb82fc371a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:00.937855 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc870b7-fb16-4fe7-b210-b0cb82fc371a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:00.938132 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc870b7-fb16-4fe7-b210-b0cb82fc371a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:00.938409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc870b7-fb16-4fe7-b210-b0cb82fc371a None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:00.939028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc870b7-fb16-4fe7-b210-b0cb82fc371a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:00.939332 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc870b7-fb16-4fe7-b210-b0cb82fc371a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:00.940689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc870b7-fb16-4fe7-b210-b0cb82fc371a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:00.949622 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 362/737] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 31 12:21:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:00.949622 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c980168-0dea-4228-886d-b7e71141fd2f None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:00.949622 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c980168-0dea-4228-886d-b7e71141fd2f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:00.949622 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c980168-0dea-4228-886d-b7e71141fd2f None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:00.949622 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 363/738] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:00.953255 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c980168-0dea-4228-886d-b7e71141fd2f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:00.961077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 376/739] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 12:21:00.963224 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90339e6a-7ced-424a-91e5-c5983141af3f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:00.964086 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90339e6a-7ced-424a-91e5-c5983141af3f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:00.964568 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90339e6a-7ced-424a-91e5-c5983141af3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:00.986631 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-90339e6a-7ced-424a-91e5-c5983141af3f None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:00.987891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-90339e6a-7ced-424a-91e5-c5983141af3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:01.065767 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c980168-0dea-4228-886d-b7e71141fd2f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:01.083211 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 377/740] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:21:01.104508 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7c27c-2eb2-4108-9ae6-4d5d0b27cb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:01.105133 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7c27c-2eb2-4108-9ae6-4d5d0b27cb9f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:01.105469 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7c27c-2eb2-4108-9ae6-4d5d0b27cb9f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:01.105742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7c27c-2eb2-4108-9ae6-4d5d0b27cb9f None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:01.106369 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7c27c-2eb2-4108-9ae6-4d5d0b27cb9f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:01.106717 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7c27c-2eb2-4108-9ae6-4d5d0b27cb9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:01.108117 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7c27c-2eb2-4108-9ae6-4d5d0b27cb9f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:01.113413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 364/741] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 31 12:21:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:21:01.119340 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90339e6a-7ced-424a-91e5-c5983141af3f None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:01.154949 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:01.226044 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90339e6a-7ced-424a-91e5-c5983141af3f None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:01.260711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2d3b6-5e83-436b-9cb6-785746dedd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:01.261353 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2d3b6-5e83-436b-9cb6-785746dedd08 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:01.261637 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2d3b6-5e83-436b-9cb6-785746dedd08 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:01.261908 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2d3b6-5e83-436b-9cb6-785746dedd08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:01.262623 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2d3b6-5e83-436b-9cb6-785746dedd08 None admin] RBAC: Adding query filter params (interface=admin, service_id=fa672803a9fb405290e6d02d7dacee2d, region_id=RegionOne) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:01.262936 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2d3b6-5e83-436b-9cb6-785746dedd08 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:01.264303 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2d3b6-5e83-436b-9cb6-785746dedd08 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:01.269836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 378/742] 10.222.0.18 () {56 vars in 1249 bytes} [Mon Oct 31 12:21:01 2022] GET /identity/v3/endpoints?service_id=fa672803a9fb405290e6d02d7dacee2d&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:01.274358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7c27c-2eb2-4108-9ae6-4d5d0b27cb9f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:01.276703 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2d3b6-5e83-436b-9cb6-785746dedd08 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:01.301716 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:01.388632 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7c27c-2eb2-4108-9ae6-4d5d0b27cb9f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:01.401766 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:01.405939 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2d3b6-5e83-436b-9cb6-785746dedd08 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:01.424427 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b14b29-ccf3-4736-a839-27b896eef6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:01.425260 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b14b29-ccf3-4736-a839-27b896eef6d8 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:01.425718 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b14b29-ccf3-4736-a839-27b896eef6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:01.426145 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b14b29-ccf3-4736-a839-27b896eef6d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:01.426785 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b14b29-ccf3-4736-a839-27b896eef6d8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:01.428223 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b14b29-ccf3-4736-a839-27b896eef6d8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:01.430839 dv-cinder-796170-6-smb devstack@keystone.service[81458]: WARNING keystone.server.flask.common [None req-17b14b29-ccf3-4736-a839-27b896eef6d8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 31 12:21:01.446826 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81011bc1-7a2c-4ff0-be5d-6991128a967e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:01.447462 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81011bc1-7a2c-4ff0-be5d-6991128a967e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:01.447745 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81011bc1-7a2c-4ff0-be5d-6991128a967e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:01.448020 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81011bc1-7a2c-4ff0-be5d-6991128a967e None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:01.448627 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81011bc1-7a2c-4ff0-be5d-6991128a967e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:01.449330 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.sql.core [None req-17b14b29-ccf3-4736-a839-27b896eef6d8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 31 12:21:01.449330 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 12:21:01.449330 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [parameters: {'id': '4986a65680a143b39a98145147ab26e0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 31 12:21:01.449330 dv-cinder-796170-6-smb devstack@keystone.service[81458]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81458) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 12:21:01.450009 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81011bc1-7a2c-4ff0-be5d-6991128a967e None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:01.456201 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 379/743] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Oct 31 12:21:01 2022] GET /identity/v3/services => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:21:01.456960 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81011bc1-7a2c-4ff0-be5d-6991128a967e None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:01.459460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-17b14b29-ccf3-4736-a839-27b896eef6d8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4986a65680a143b39a98145147ab26e0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4986a65680a143b39a98145147ab26e0. Oct 31 12:21:01.459460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:01.459460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 12:21:01.459460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 12:21:01.459460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 12:21:01.459460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 12:21:01.459460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 12:21:01.459460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 12:21:01.459460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 12:21:01.459460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application conn.query(q) Oct 31 12:21:01.459460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 12:21:01.459460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 12:21:01.459460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 12:21:01.460304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result.read() Oct 31 12:21:01.460304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 12:21:01.460304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 12:21:01.460304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 12:21:01.460304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 12:21:01.460304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 12:21:01.460304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 12:21:01.460304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 12:21:01.460304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 12:21:01.460304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 31 12:21:01.460304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:21:01.460304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 12:21:01.460304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:21:01.460304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:01.460304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 12:21:01.460304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 12:21:01.460304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 31 12:21:01.460304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 31 12:21:01.461297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 12:21:01.461297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application next(self.gen) Oct 31 12:21:01.461297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 12:21:01.461297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application yield resource Oct 31 12:21:01.461297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 12:21:01.461297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application next(self.gen) Oct 31 12:21:01.461297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 12:21:01.461297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 12:21:01.461297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 12:21:01.461297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 12:21:01.461297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 12:21:01.461297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise self.value Oct 31 12:21:01.461297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 12:21:01.461297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 12:21:01.461297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 12:21:01.461297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application session.commit() Oct 31 12:21:01.461297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 12:21:01.462222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 12:21:01.462222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 12:21:01.462222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 12:21:01.462222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 12:21:01.462222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.session.flush() Oct 31 12:21:01.462222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 12:21:01.462222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 12:21:01.462222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 12:21:01.462222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 12:21:01.462222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 12:21:01.462222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application compat.raise_( Oct 31 12:21:01.462222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 12:21:01.462222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception Oct 31 12:21:01.462222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 12:21:01.462222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 12:21:01.462222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 12:21:01.462222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 12:21:01.463155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 12:21:01.463155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 12:21:01.463155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 12:21:01.463155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 12:21:01.463155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 12:21:01.463155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 12:21:01.463155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 12:21:01.463155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 12:21:01.463155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 12:21:01.463155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 12:21:01.463155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 12:21:01.463155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 12:21:01.463155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 12:21:01.463155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 12:21:01.463155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 12:21:01.463960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 12:21:01.463960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 12:21:01.463960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception Oct 31 12:21:01.463960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 12:21:01.463960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 12:21:01.463960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 12:21:01.463960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 12:21:01.463960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 12:21:01.463960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 12:21:01.463960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 12:21:01.463960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application conn.query(q) Oct 31 12:21:01.463960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 12:21:01.463960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 12:21:01.463960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 12:21:01.463960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result.read() Oct 31 12:21:01.463960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 12:21:01.463960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 12:21:01.464868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 12:21:01.464868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 12:21:01.464868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 12:21:01.464868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 12:21:01.464868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 12:21:01.464868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 12:21:01.464868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 31 12:21:01.464868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 12:21:01.464868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [parameters: {'id': '4986a65680a143b39a98145147ab26e0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 31 12:21:01.464868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 12:21:01.464868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:21:01.464868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:21:01.464868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:21:01.464868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:01.464868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 31 12:21:01.468976 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 31 12:21:01.468976 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 12:21:01.468976 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 12:21:01.468976 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 31 12:21:01.468976 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:21:01.468976 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:21:01.468976 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:21:01.468976 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:01.468976 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:01.468976 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:01.468976 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:01.468976 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:01.468976 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:01.468976 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:01.468976 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:01.468976 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:01.468976 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:01.471215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:01.471215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 31 12:21:01.471215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 31 12:21:01.471215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:01.471215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:01.471215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 31 12:21:01.471215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 31 12:21:01.471215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4986a65680a143b39a98145147ab26e0. Oct 31 12:21:01.471215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:21:01.471215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 365/744] 10.222.0.18 () {60 vars in 1140 bytes} [Mon Oct 31 12:21:01 2022] POST /identity/v3/projects => generated 262 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:21:01.475417 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b14b29-ccf3-4736-a839-27b896eef6d8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:01.583576 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81011bc1-7a2c-4ff0-be5d-6991128a967e None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:01.593233 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:01.619789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b14b29-ccf3-4736-a839-27b896eef6d8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:01.628073 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a770262-91f6-420c-bdba-683090b0cd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:01.629633 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a770262-91f6-420c-bdba-683090b0cd19 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:01.630147 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a770262-91f6-420c-bdba-683090b0cd19 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:01.631249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a770262-91f6-420c-bdba-683090b0cd19 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:01.632125 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a770262-91f6-420c-bdba-683090b0cd19 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:01.633849 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a770262-91f6-420c-bdba-683090b0cd19 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:01.652262 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 380/745] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 31 12:21:01 2022] POST /identity/v3/services => generated 242 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:21:01.676108 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2769c-3997-4cc1-a38b-edf3b5205a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:01.677205 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2769c-3997-4cc1-a38b-edf3b5205a24 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:01.677782 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2769c-3997-4cc1-a38b-edf3b5205a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:01.678271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2769c-3997-4cc1-a38b-edf3b5205a24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:01.688792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2769c-3997-4cc1-a38b-edf3b5205a24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:01.690819 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2769c-3997-4cc1-a38b-edf3b5205a24 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:01.705006 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-b7f2769c-3997-4cc1-a38b-edf3b5205a24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:21:01.705006 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:01.705006 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:01.705006 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:01.705006 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:01.705006 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:01.705006 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:01.705006 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:01.705006 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:01.705006 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:01.705006 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:01.705006 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:01.705006 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:21:01.705006 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:21:01.705006 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:21:01.706200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:21:01.706200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:01.706200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:01.706200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:01.706200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:01.706200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:01.706200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:01.706200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:01.706200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:01.706200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:01.706200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:01.706200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:01.706200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:01.706200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:01.706200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:01.706200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:01.706200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:01.707333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:21:01.707333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:21:01.707333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:21:01.707333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:21:01.707333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:21:01.707333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:21:01.707333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:21:01.707333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:21:01.710046 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 366/746] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:21:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:21:01.717152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a770262-91f6-420c-bdba-683090b0cd19 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:01.750998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:01.833238 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a770262-91f6-420c-bdba-683090b0cd19 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:01.870143 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456cbb01-cb67-4e44-8cf2-4ee9067083c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:01.871005 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cbb01-cb67-4e44-8cf2-4ee9067083c7 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:01.871500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cbb01-cb67-4e44-8cf2-4ee9067083c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:01.872023 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cbb01-cb67-4e44-8cf2-4ee9067083c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:01.873411 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456cbb01-cb67-4e44-8cf2-4ee9067083c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:01.874216 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456cbb01-cb67-4e44-8cf2-4ee9067083c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:01.876931 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456cbb01-cb67-4e44-8cf2-4ee9067083c7 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:01.896377 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 381/747] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 31 12:21:01 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:02.284727 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d0797-68a9-4b68-b812-3ad1538ee1aa None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:02.285268 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d0797-68a9-4b68-b812-3ad1538ee1aa None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:02.285345 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d0797-68a9-4b68-b812-3ad1538ee1aa None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:02.287437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 367/748] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:02.292749 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8f127-dc02-40b2-adc3-49ca955d0e09 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:02.293048 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8f127-dc02-40b2-adc3-49ca955d0e09 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:02.293358 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8f127-dc02-40b2-adc3-49ca955d0e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:02.312567 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-80d8f127-dc02-40b2-adc3-49ca955d0e09 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:02.313803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-80d8f127-dc02-40b2-adc3-49ca955d0e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:02.384213 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 382/749] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:02 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:21:02.653287 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d0797-68a9-4b68-b812-3ad1538ee1aa None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:02.758716 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d0797-68a9-4b68-b812-3ad1538ee1aa None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:02.794373 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30530b4a-d328-466b-8a58-012fbce3e7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:02.795003 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30530b4a-d328-466b-8a58-012fbce3e7ea None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:02.795284 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30530b4a-d328-466b-8a58-012fbce3e7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:02.795555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30530b4a-d328-466b-8a58-012fbce3e7ea None admin] PATH_INFO: `/v3/services/compute` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:02.796187 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30530b4a-d328-466b-8a58-012fbce3e7ea None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:02.797634 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30530b4a-d328-466b-8a58-012fbce3e7ea None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:02.806616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-30530b4a-d328-466b-8a58-012fbce3e7ea None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 12:21:02.806616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:02.806616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:21:02.806616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:21:02.806616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:21:02.806616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:21:02.806616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:21:02.806616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:21:02.806616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 12:21:02.806616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:21:02.806616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:21:02.806616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:21:02.806616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:02.806616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:02.806616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:02.806616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:02.806616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:02.807588 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:02.807588 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:02.807588 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:02.807588 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:02.807588 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:02.807588 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:02.807588 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:21:02.807588 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:21:02.807588 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:21:02.807588 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:21:02.807588 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:02.807588 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:02.807588 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:02.807588 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:02.807588 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:02.807588 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:02.808425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:02.808425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:02.808425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:02.808425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:02.808425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:02.808425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:02.808425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:02.808425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:02.808425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:02.808425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:02.808425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:21:02.808425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:21:02.808425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 12:21:02.808425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:21:02.808425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:02.808425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 368/750] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:21:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:21:02.814632 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8f127-dc02-40b2-adc3-49ca955d0e09 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:02.850118 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:02.921771 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8f127-dc02-40b2-adc3-49ca955d0e09 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:02.957258 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59f938-dedc-4e7e-bf14-e51a7db4c89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:02.957865 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59f938-dedc-4e7e-bf14-e51a7db4c89f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:02.958147 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59f938-dedc-4e7e-bf14-e51a7db4c89f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:02.958423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59f938-dedc-4e7e-bf14-e51a7db4c89f None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:02.959601 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59f938-dedc-4e7e-bf14-e51a7db4c89f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:02.959903 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59f938-dedc-4e7e-bf14-e51a7db4c89f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:02.961285 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59f938-dedc-4e7e-bf14-e51a7db4c89f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:02.966579 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 383/751] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 31 12:21:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:02.972148 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30530b4a-d328-466b-8a58-012fbce3e7ea None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:03.078240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30530b4a-d328-466b-8a58-012fbce3e7ea None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:03.112867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0ba82-2f06-4b93-8e75-0bbc2bafb9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:03.113505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0ba82-2f06-4b93-8e75-0bbc2bafb9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:03.113788 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0ba82-2f06-4b93-8e75-0bbc2bafb9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:03.114065 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0ba82-2f06-4b93-8e75-0bbc2bafb9b4 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:03.114693 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0ba82-2f06-4b93-8e75-0bbc2bafb9b4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:03.115020 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0ba82-2f06-4b93-8e75-0bbc2bafb9b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:03.116378 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0ba82-2f06-4b93-8e75-0bbc2bafb9b4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:03.121926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 369/752] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 31 12:21:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:03.127334 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59f938-dedc-4e7e-bf14-e51a7db4c89f None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:03.212967 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:03.237711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59f938-dedc-4e7e-bf14-e51a7db4c89f None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:03.274574 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a971a5-7394-4e95-8fc1-2e33fa8bb09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:03.275580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a971a5-7394-4e95-8fc1-2e33fa8bb09c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:03.276085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a971a5-7394-4e95-8fc1-2e33fa8bb09c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:03.276562 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a971a5-7394-4e95-8fc1-2e33fa8bb09c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:03.277503 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a971a5-7394-4e95-8fc1-2e33fa8bb09c None admin] RBAC: Adding query filter params (interface=public, service_id=8c1430bcbf9b42e9813e5843ab59858c, region_id=RegionOne) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:03.278027 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a971a5-7394-4e95-8fc1-2e33fa8bb09c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:03.279568 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a971a5-7394-4e95-8fc1-2e33fa8bb09c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:03.285566 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 384/753] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Oct 31 12:21:03 2022] GET /identity/v3/endpoints?service_id=8c1430bcbf9b42e9813e5843ab59858c&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:03.293880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0ba82-2f06-4b93-8e75-0bbc2bafb9b4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:03.356269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:03.396153 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0ba82-2f06-4b93-8e75-0bbc2bafb9b4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:03.432364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cfc18-297a-4e5d-a1fc-9a4ef7766160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:03.432974 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cfc18-297a-4e5d-a1fc-9a4ef7766160 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:03.433291 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cfc18-297a-4e5d-a1fc-9a4ef7766160 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:03.433565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cfc18-297a-4e5d-a1fc-9a4ef7766160 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:03.434172 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cfc18-297a-4e5d-a1fc-9a4ef7766160 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:03.435527 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cfc18-297a-4e5d-a1fc-9a4ef7766160 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:03.442759 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 370/754] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Oct 31 12:21:03 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:21:03.751823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780ac2b-05ed-4e38-b3c9-d8913be07445 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:03.752200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780ac2b-05ed-4e38-b3c9-d8913be07445 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:03.752383 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780ac2b-05ed-4e38-b3c9-d8913be07445 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:03.753985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 385/755] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:03.759707 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ee7a9-d334-4ca9-9591-f1e584960f44 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:03.760015 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ee7a9-d334-4ca9-9591-f1e584960f44 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:03.760300 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ee7a9-d334-4ca9-9591-f1e584960f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:03.779315 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fe5ee7a9-d334-4ca9-9591-f1e584960f44 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:03.780850 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fe5ee7a9-d334-4ca9-9591-f1e584960f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:03.852391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 371/756] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:03 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:21:03.966825 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cef54-7424-48bd-889a-fca62f830d83 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:03.967783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cef54-7424-48bd-889a-fca62f830d83 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:03.968257 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cef54-7424-48bd-889a-fca62f830d83 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:03.970088 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 386/757] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:03.975983 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aafd54-d21e-4cc1-83f1-28c0a463163c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:03.976509 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aafd54-d21e-4cc1-83f1-28c0a463163c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:03.976992 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aafd54-d21e-4cc1-83f1-28c0a463163c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:03.995933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-01aafd54-d21e-4cc1-83f1-28c0a463163c None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:03.997434 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-01aafd54-d21e-4cc1-83f1-28c0a463163c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:04.050816 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:04.073636 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 372/758] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:03 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:21:04.132146 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cef54-7424-48bd-889a-fca62f830d83 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:04.245438 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cef54-7424-48bd-889a-fca62f830d83 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:04.261568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbd0a8-b307-4f28-a392-3d2e760a87f1 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:04.261878 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbd0a8-b307-4f28-a392-3d2e760a87f1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:04.262130 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbd0a8-b307-4f28-a392-3d2e760a87f1 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:04.265091 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 373/759] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:04.268907 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62083ba2-1a23-4660-9892-053fc78f7cb2 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:04.269222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62083ba2-1a23-4660-9892-053fc78f7cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:04.269499 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62083ba2-1a23-4660-9892-053fc78f7cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:04.284731 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a715101-6e94-4134-a604-88cc4e01516a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:04.285715 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a715101-6e94-4134-a604-88cc4e01516a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:04.286220 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a715101-6e94-4134-a604-88cc4e01516a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:04.286714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a715101-6e94-4134-a604-88cc4e01516a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:04.288214 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a715101-6e94-4134-a604-88cc4e01516a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:04.288911 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-62083ba2-1a23-4660-9892-053fc78f7cb2 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:04.290016 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a715101-6e94-4134-a604-88cc4e01516a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:04.290126 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-62083ba2-1a23-4660-9892-053fc78f7cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:04.299648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-8a715101-6e94-4134-a604-88cc4e01516a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 12:21:04.299648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:04.299648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:21:04.299648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:21:04.299648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:21:04.299648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:21:04.299648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:21:04.299648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:21:04.299648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 12:21:04.299648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:04.299648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:21:04.299648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:04.299648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:04.299648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:04.299648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:04.299648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:04.299648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:04.300674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:04.300674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:04.300674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:04.300674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:04.300674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:04.300674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:04.300674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:21:04.300674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:21:04.300674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:21:04.300674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:21:04.300674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:04.300674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:04.300674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:04.300674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:04.300674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:04.300674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:04.301621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:04.301621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:04.301621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:04.301621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:04.301621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:04.301621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:04.301621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:04.301621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:04.301621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:04.301621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:04.301621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:21:04.301621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:21:04.301621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 12:21:04.301621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:04.304450 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 387/760] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Oct 31 12:21:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:21:04.310527 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a715101-6e94-4134-a604-88cc4e01516a None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:04.314520 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:04.370669 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 374/761] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:04 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 12:21:04.371714 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62083ba2-1a23-4660-9892-053fc78f7cb2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:04.431387 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a715101-6e94-4134-a604-88cc4e01516a None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:04.468216 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61606477-f7d2-4def-969d-8f5f88e2271f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:04.469276 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61606477-f7d2-4def-969d-8f5f88e2271f None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:04.469892 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61606477-f7d2-4def-969d-8f5f88e2271f None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:04.470392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61606477-f7d2-4def-969d-8f5f88e2271f None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:04.471220 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61606477-f7d2-4def-969d-8f5f88e2271f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:04.471728 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61606477-f7d2-4def-969d-8f5f88e2271f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:04.472619 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62083ba2-1a23-4660-9892-053fc78f7cb2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:04.473581 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61606477-f7d2-4def-969d-8f5f88e2271f None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:04.483952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 388/762] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 31 12:21:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:21:04.485033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61606477-f7d2-4def-969d-8f5f88e2271f None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:04.489865 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:04.507870 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c66686-f0aa-4390-be19-5ad185d8772c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:04.508548 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c66686-f0aa-4390-be19-5ad185d8772c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:04.508829 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c66686-f0aa-4390-be19-5ad185d8772c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:04.509100 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c66686-f0aa-4390-be19-5ad185d8772c None admin] PATH_INFO: `/v3/services/image` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:04.509743 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c66686-f0aa-4390-be19-5ad185d8772c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:04.511155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c66686-f0aa-4390-be19-5ad185d8772c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:04.520196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-c7c66686-f0aa-4390-be19-5ad185d8772c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 12:21:04.520196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:04.520196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:21:04.520196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:21:04.520196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:21:04.520196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:21:04.520196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:21:04.520196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:21:04.520196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 12:21:04.520196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:21:04.520196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:21:04.520196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:21:04.520196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:04.520196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:04.520196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:04.520196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:04.520196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:04.522045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:04.522045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:04.522045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:04.522045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:04.522045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:04.522045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:04.522045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:21:04.522045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:21:04.522045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:21:04.522045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:21:04.522045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:04.522045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:04.522045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:04.522045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:04.522045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:04.522045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:04.523039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:04.523039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:04.523039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:04.523039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:04.523039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:04.523039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:04.523039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:04.523039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:04.523039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:04.523039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:04.523039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:21:04.523039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:21:04.523039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 12:21:04.523039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:21:04.526932 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 375/763] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Oct 31 12:21:04 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:21:04.527752 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c66686-f0aa-4390-be19-5ad185d8772c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:04.569625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:04.616509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61606477-f7d2-4def-969d-8f5f88e2271f None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:04.632205 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c66686-f0aa-4390-be19-5ad185d8772c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:04.660656 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca38947-dc05-4e14-8d0a-74076b35b34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:04.661391 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca38947-dc05-4e14-8d0a-74076b35b34a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:04.661673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca38947-dc05-4e14-8d0a-74076b35b34a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:04.661978 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca38947-dc05-4e14-8d0a-74076b35b34a None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:04.662610 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca38947-dc05-4e14-8d0a-74076b35b34a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:04.662912 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca38947-dc05-4e14-8d0a-74076b35b34a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:04.664272 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca38947-dc05-4e14-8d0a-74076b35b34a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:04.669136 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 389/764] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Oct 31 12:21:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:04.669882 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c59cf-4a04-4c70-b021-d09797a6293d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:04.670021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca38947-dc05-4e14-8d0a-74076b35b34a None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:04.670988 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c59cf-4a04-4c70-b021-d09797a6293d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:04.671448 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c59cf-4a04-4c70-b021-d09797a6293d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:04.671896 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c59cf-4a04-4c70-b021-d09797a6293d None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:04.672707 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c59cf-4a04-4c70-b021-d09797a6293d None admin] RBAC: Adding query filter params (name=image) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:04.673018 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c59cf-4a04-4c70-b021-d09797a6293d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:04.674698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c59cf-4a04-4c70-b021-d09797a6293d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:04.681149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 376/765] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:21:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:04.681149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c59cf-4a04-4c70-b021-d09797a6293d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:04.732272 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:04.790410 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c59cf-4a04-4c70-b021-d09797a6293d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:04.790812 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca38947-dc05-4e14-8d0a-74076b35b34a None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:04.823119 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:04.828592 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acc8e6-1ff7-470a-8437-595060e6dc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:04.828863 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d3766-4855-4610-af04-20395b14900a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:04.829230 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acc8e6-1ff7-470a-8437-595060e6dc17 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:04.829486 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d3766-4855-4610-af04-20395b14900a None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:04.829590 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acc8e6-1ff7-470a-8437-595060e6dc17 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:04.829768 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d3766-4855-4610-af04-20395b14900a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:04.829882 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acc8e6-1ff7-470a-8437-595060e6dc17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:04.830051 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d3766-4855-4610-af04-20395b14900a None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:04.830457 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acc8e6-1ff7-470a-8437-595060e6dc17 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:04.830659 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d3766-4855-4610-af04-20395b14900a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:04.831839 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acc8e6-1ff7-470a-8437-595060e6dc17 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:04.832047 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d3766-4855-4610-af04-20395b14900a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:04.834589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: WARNING keystone.server.flask.common [None req-117d3766-4855-4610-af04-20395b14900a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 31 12:21:04.848049 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.sql.core [None req-117d3766-4855-4610-af04-20395b14900a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 31 12:21:04.848049 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 31 12:21:04.848049 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [parameters: {'user_id': '2152da07c4bb468aa733db539ede8cfa', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 31 12:21:04.848049 dv-cinder-796170-6-smb devstack@keystone.service[81457]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81457) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 12:21:04.857513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 377/766] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:21:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:21:04.857513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acc8e6-1ff7-470a-8437-595060e6dc17 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:04.866629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-117d3766-4855-4610-af04-20395b14900a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 31 12:21:04.866629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:04.866629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 12:21:04.866629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 12:21:04.866629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 12:21:04.866629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 12:21:04.866629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 12:21:04.866629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 12:21:04.866629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 12:21:04.866629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application conn.query(q) Oct 31 12:21:04.866629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 12:21:04.866629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 12:21:04.866629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 12:21:04.866629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application result.read() Oct 31 12:21:04.866629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 12:21:04.867589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 12:21:04.867589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 12:21:04.867589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 12:21:04.867589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 12:21:04.867589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 12:21:04.867589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 12:21:04.867589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 12:21:04.867589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 31 12:21:04.867589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:04.867589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 12:21:04.867589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:04.867589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:04.867589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 12:21:04.867589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 12:21:04.867589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 31 12:21:04.867589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 31 12:21:04.867589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 12:21:04.867589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application next(self.gen) Oct 31 12:21:04.868557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 12:21:04.868557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application yield resource Oct 31 12:21:04.868557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 12:21:04.868557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application next(self.gen) Oct 31 12:21:04.868557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 12:21:04.868557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 12:21:04.868557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 12:21:04.868557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 12:21:04.868557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 12:21:04.868557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise self.value Oct 31 12:21:04.868557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 12:21:04.868557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 12:21:04.868557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 12:21:04.868557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application session.commit() Oct 31 12:21:04.868557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 12:21:04.868557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 12:21:04.868557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 12:21:04.869932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 12:21:04.869932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 12:21:04.869932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.session.flush() Oct 31 12:21:04.869932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 12:21:04.869932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 12:21:04.869932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 12:21:04.869932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 12:21:04.869932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 12:21:04.869932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application compat.raise_( Oct 31 12:21:04.869932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 12:21:04.869932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception Oct 31 12:21:04.869932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 12:21:04.869932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 12:21:04.869932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 12:21:04.869932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 12:21:04.869932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 12:21:04.869932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 12:21:04.871019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 12:21:04.871019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 12:21:04.871019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 31 12:21:04.871019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 31 12:21:04.871019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 12:21:04.871019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 12:21:04.871019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 12:21:04.871019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 12:21:04.871019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 12:21:04.871019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 12:21:04.871019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 12:21:04.871019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 12:21:04.871019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 12:21:04.871019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 12:21:04.871019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 12:21:04.871019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception Oct 31 12:21:04.872235 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 12:21:04.872235 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 12:21:04.872235 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 12:21:04.872235 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 12:21:04.872235 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 12:21:04.872235 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 12:21:04.872235 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 12:21:04.872235 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application conn.query(q) Oct 31 12:21:04.872235 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 12:21:04.872235 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 12:21:04.872235 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 12:21:04.872235 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application result.read() Oct 31 12:21:04.872235 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 12:21:04.872235 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 12:21:04.872235 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 12:21:04.872235 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 12:21:04.873314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 12:21:04.873314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 12:21:04.873314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 12:21:04.873314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 12:21:04.873314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 31 12:21:04.873314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 31 12:21:04.873314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [parameters: {'user_id': '2152da07c4bb468aa733db539ede8cfa', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 31 12:21:04.873314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 12:21:04.873314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:04.873314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:21:04.873314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:04.873314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:04.873314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:04.873314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:04.873314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:04.874507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:04.874507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:04.874507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:04.874507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:04.874507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:04.874507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:04.874507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:04.874507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 31 12:21:04.874507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 31 12:21:04.874507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:04.874507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:04.874507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:21:04.874507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:21:04.874507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:21:04.874507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:21:04.874507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 31 12:21:04.874507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 31 12:21:04.875615 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 31 12:21:04.875615 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 31 12:21:04.875615 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 12:21:04.875615 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 12:21:04.875615 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 31 12:21:04.875615 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:04.875615 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 390/767] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Oct 31 12:21:04 2022] POST /identity/v3/users => generated 160 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:21:04.884640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d3766-4855-4610-af04-20395b14900a None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:04.993055 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acc8e6-1ff7-470a-8437-595060e6dc17 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:04.994251 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d3766-4855-4610-af04-20395b14900a None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:04.994930 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:05.035518 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8629f-3c71-46e1-b943-f8d5abb4fc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:05.035826 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda427f2-9bd0-4562-baad-f3ce731c698a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:05.036307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8629f-3c71-46e1-b943-f8d5abb4fc97 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:05.036608 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda427f2-9bd0-4562-baad-f3ce731c698a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:05.036714 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8629f-3c71-46e1-b943-f8d5abb4fc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:05.037581 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda427f2-9bd0-4562-baad-f3ce731c698a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:05.037688 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8629f-3c71-46e1-b943-f8d5abb4fc97 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:05.037968 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda427f2-9bd0-4562-baad-f3ce731c698a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:05.038496 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8629f-3c71-46e1-b943-f8d5abb4fc97 None admin] RBAC: Adding query filter params (type=image) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:05.038857 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8629f-3c71-46e1-b943-f8d5abb4fc97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:05.040511 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8629f-3c71-46e1-b943-f8d5abb4fc97 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:05.046824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 378/768] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:21:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:05.052169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda427f2-9bd0-4562-baad-f3ce731c698a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:05.053963 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda427f2-9bd0-4562-baad-f3ce731c698a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:05.055783 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8629f-3c71-46e1-b943-f8d5abb4fc97 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:05.081660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-fda427f2-9bd0-4562-baad-f3ce731c698a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 12:21:05.081660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:05.081660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:05.081660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:05.081660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:05.081660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:05.081660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:05.081660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:05.081660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:05.081660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:05.081660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:05.081660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:05.081660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:21:05.081660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:21:05.081660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:21:05.081660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:21:05.082649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:05.082649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:05.082649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:21:05.082649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:21:05.082649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:21:05.082649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:21:05.082649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:05.082649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:05.082649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:05.082649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:05.082649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:05.082649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:05.082649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:05.082649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:05.082649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:05.082649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:05.082649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:05.082649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:05.083616 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:05.083616 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:05.083616 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:21:05.083616 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:21:05.083616 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:21:05.083616 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:21:05.083616 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:21:05.083616 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:21:05.083616 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 12:21:05.083616 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:05.088134 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 391/769] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:21:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:21:05.089864 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda427f2-9bd0-4562-baad-f3ce731c698a None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:05.168605 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8629f-3c71-46e1-b943-f8d5abb4fc97 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:05.171178 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:05.206867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0219e-c64e-46c8-b196-7e915c8525fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:05.207497 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0219e-c64e-46c8-b196-7e915c8525fc None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:05.207763 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0219e-c64e-46c8-b196-7e915c8525fc None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:05.208038 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0219e-c64e-46c8-b196-7e915c8525fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:05.209326 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0219e-c64e-46c8-b196-7e915c8525fc None admin] RBAC: Adding query filter params (interface=public, service_id=706b7978c51a4032a97668d60e49aaa6, region_id=RegionOne) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:05.209646 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0219e-c64e-46c8-b196-7e915c8525fc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:05.211372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0219e-c64e-46c8-b196-7e915c8525fc None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:05.218933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 379/770] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Oct 31 12:21:05 2022] GET /identity/v3/endpoints?service_id=706b7978c51a4032a97668d60e49aaa6&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:21:05.224956 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda427f2-9bd0-4562-baad-f3ce731c698a None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:05.229697 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0219e-c64e-46c8-b196-7e915c8525fc None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:05.265658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:05.266002 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925ebee-51f2-4e72-9579-65f37d61559a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:05.266617 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925ebee-51f2-4e72-9579-65f37d61559a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:05.266899 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925ebee-51f2-4e72-9579-65f37d61559a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:05.267172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925ebee-51f2-4e72-9579-65f37d61559a None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:05.267906 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925ebee-51f2-4e72-9579-65f37d61559a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:05.268216 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925ebee-51f2-4e72-9579-65f37d61559a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:05.269702 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925ebee-51f2-4e72-9579-65f37d61559a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:05.321224 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 392/771] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Oct 31 12:21:05 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:21:05.347561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0219e-c64e-46c8-b196-7e915c8525fc None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:05.386712 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c96663-ab89-41ee-b806-5fc5e3254237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:05.388612 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c96663-ab89-41ee-b806-5fc5e3254237 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:05.389310 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c96663-ab89-41ee-b806-5fc5e3254237 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:05.389783 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c96663-ab89-41ee-b806-5fc5e3254237 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:05.390610 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c96663-ab89-41ee-b806-5fc5e3254237 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:05.392259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c96663-ab89-41ee-b806-5fc5e3254237 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:05.401087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 380/772] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Oct 31 12:21:05 2022] GET /identity/v3/services => generated 1957 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:21:05.672565 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167e9bc-42c3-4500-b28e-c94e349e7e9d None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:05.672907 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167e9bc-42c3-4500-b28e-c94e349e7e9d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:05.673085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167e9bc-42c3-4500-b28e-c94e349e7e9d None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:05.674573 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 393/773] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:05.680251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c579c-d883-4087-ba96-cc3f674ff5cc None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:05.680548 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c579c-d883-4087-ba96-cc3f674ff5cc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:05.680829 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c579c-d883-4087-ba96-cc3f674ff5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:05.699894 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-457c579c-d883-4087-ba96-cc3f674ff5cc None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:05.701091 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-457c579c-d883-4087-ba96-cc3f674ff5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:05.770314 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 381/774] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:05 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:21:06.041334 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167e9bc-42c3-4500-b28e-c94e349e7e9d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:06.149559 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167e9bc-42c3-4500-b28e-c94e349e7e9d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:06.163456 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:06.185600 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0241bd-0845-4256-8ef4-47b09d6745a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:06.186224 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0241bd-0845-4256-8ef4-47b09d6745a3 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:06.186501 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0241bd-0845-4256-8ef4-47b09d6745a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:06.186776 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0241bd-0845-4256-8ef4-47b09d6745a3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:06.187437 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0241bd-0845-4256-8ef4-47b09d6745a3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:06.188703 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0241bd-0845-4256-8ef4-47b09d6745a3 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:06.197471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-dd0241bd-0845-4256-8ef4-47b09d6745a3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 12:21:06.197471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:06.197471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:21:06.197471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:21:06.197471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:21:06.197471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:21:06.197471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:21:06.197471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:21:06.197471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 12:21:06.197471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:06.197471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:21:06.197471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:06.197471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:06.197471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:06.197471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:06.197471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:06.197471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:06.198474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:06.198474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:06.198474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:06.198474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:06.198474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:06.198474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:06.198474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:21:06.198474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:21:06.198474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:21:06.198474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:21:06.198474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:06.198474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:06.198474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:06.198474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:06.198474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:06.198474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:06.202036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:06.202036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:06.202036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:06.202036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:06.202036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:06.202036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:06.202036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:06.202036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:06.202036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:06.202036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:06.202036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:21:06.202036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:21:06.202036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 12:21:06.202036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:06.202036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 394/775] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:21:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:21:06.204417 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c579c-d883-4087-ba96-cc3f674ff5cc None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:06.229249 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:06.305279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c579c-d883-4087-ba96-cc3f674ff5cc None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:06.339435 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d383a-1c55-4345-9589-77cd5cfaebb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:06.340042 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d383a-1c55-4345-9589-77cd5cfaebb6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:06.340318 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d383a-1c55-4345-9589-77cd5cfaebb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:06.340582 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d383a-1c55-4345-9589-77cd5cfaebb6 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:06.341226 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d383a-1c55-4345-9589-77cd5cfaebb6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:06.341524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d383a-1c55-4345-9589-77cd5cfaebb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:06.342876 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d383a-1c55-4345-9589-77cd5cfaebb6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:06.353040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 382/776] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 31 12:21:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:06.353898 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0241bd-0845-4256-8ef4-47b09d6745a3 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:06.451084 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0241bd-0845-4256-8ef4-47b09d6745a3 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:06.484065 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c3cc1-24b7-470f-9640-9127c0291b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:06.484656 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c3cc1-24b7-470f-9640-9127c0291b96 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:06.484934 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c3cc1-24b7-470f-9640-9127c0291b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:06.485232 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c3cc1-24b7-470f-9640-9127c0291b96 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:06.485853 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c3cc1-24b7-470f-9640-9127c0291b96 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:06.486152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c3cc1-24b7-470f-9640-9127c0291b96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:06.487489 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c3cc1-24b7-470f-9640-9127c0291b96 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:06.492754 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 395/777] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Oct 31 12:21:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:21:06.498235 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d383a-1c55-4345-9589-77cd5cfaebb6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:06.584383 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:06.597425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d383a-1c55-4345-9589-77cd5cfaebb6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:06.634192 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326b166-c423-45a6-9d3b-8067b46527c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:06.634793 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326b166-c423-45a6-9d3b-8067b46527c9 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:06.635070 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326b166-c423-45a6-9d3b-8067b46527c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:06.635341 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326b166-c423-45a6-9d3b-8067b46527c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:06.636013 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326b166-c423-45a6-9d3b-8067b46527c9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:06.637380 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326b166-c423-45a6-9d3b-8067b46527c9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:06.658738 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 383/778] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:21:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:21:07.166670 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d62a69-b28c-4e67-ac45-219b7a950226 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:07.167177 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d62a69-b28c-4e67-ac45-219b7a950226 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:07.167255 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d62a69-b28c-4e67-ac45-219b7a950226 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:07.168702 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 396/779] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:07.173782 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983aaf25-0293-4a66-bbee-b0356988eaaf None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:07.174349 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983aaf25-0293-4a66-bbee-b0356988eaaf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:07.174636 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983aaf25-0293-4a66-bbee-b0356988eaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:07.195366 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-983aaf25-0293-4a66-bbee-b0356988eaaf None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:07.196557 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-983aaf25-0293-4a66-bbee-b0356988eaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:07.269379 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 384/780] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:21:07.539007 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d62a69-b28c-4e67-ac45-219b7a950226 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:07.578203 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b50008-d61a-4fa1-8ae6-3021cfe53fb2 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:07.578718 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b50008-d61a-4fa1-8ae6-3021cfe53fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:07.578718 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b50008-d61a-4fa1-8ae6-3021cfe53fb2 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:07.580270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 385/781] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:21:07.583816 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:07.585101 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d8a92-6f53-4a7a-b52b-bc03ca65716f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:07.585390 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d8a92-6f53-4a7a-b52b-bc03ca65716f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:07.585686 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d8a92-6f53-4a7a-b52b-bc03ca65716f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:07.604420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fb1d8a92-6f53-4a7a-b52b-bc03ca65716f None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:07.605684 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fb1d8a92-6f53-4a7a-b52b-bc03ca65716f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:07.652239 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d62a69-b28c-4e67-ac45-219b7a950226 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:07.668645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:07.681245 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 386/782] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 12:21:07.692835 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833f2a0-d204-47fe-9595-8788dd42b400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:07.693760 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833f2a0-d204-47fe-9595-8788dd42b400 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:07.694192 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833f2a0-d204-47fe-9595-8788dd42b400 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:07.694632 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833f2a0-d204-47fe-9595-8788dd42b400 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:07.695890 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833f2a0-d204-47fe-9595-8788dd42b400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:07.697494 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833f2a0-d204-47fe-9595-8788dd42b400 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:07.700273 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 397/783] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:21:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:07.704786 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d8a92-6f53-4a7a-b52b-bc03ca65716f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:07.803017 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d8a92-6f53-4a7a-b52b-bc03ca65716f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:07.836110 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62ead7-0ca2-4032-b762-7262a14b5594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:07.836716 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62ead7-0ca2-4032-b762-7262a14b5594 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:07.836997 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62ead7-0ca2-4032-b762-7262a14b5594 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:07.837313 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62ead7-0ca2-4032-b762-7262a14b5594 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:07.837971 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62ead7-0ca2-4032-b762-7262a14b5594 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:07.839436 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62ead7-0ca2-4032-b762-7262a14b5594 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:07.869290 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 387/784] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 31 12:21:07 2022] POST /identity/v3/projects => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:21:07.938988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833f2a0-d204-47fe-9595-8788dd42b400 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:08.046736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833f2a0-d204-47fe-9595-8788dd42b400 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:08.055879 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:08.088908 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20eb6e-fce6-46e3-a0e6-5c16857bdbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:08.089569 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20eb6e-fce6-46e3-a0e6-5c16857bdbfc None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:08.089850 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20eb6e-fce6-46e3-a0e6-5c16857bdbfc None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:08.090156 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20eb6e-fce6-46e3-a0e6-5c16857bdbfc None admin] PATH_INFO: `/v3/services/image` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:08.090736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20eb6e-fce6-46e3-a0e6-5c16857bdbfc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:08.092095 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20eb6e-fce6-46e3-a0e6-5c16857bdbfc None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:08.101640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-ed20eb6e-fce6-46e3-a0e6-5c16857bdbfc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 12:21:08.101640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:08.101640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:21:08.101640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:21:08.101640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:21:08.101640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:21:08.101640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:21:08.101640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:21:08.101640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 12:21:08.101640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:08.101640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:21:08.101640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:08.101640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:08.101640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:08.101640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:08.101640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:08.101640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:08.102847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:08.102847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:08.102847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:08.102847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:08.102847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:08.102847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:08.102847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:21:08.102847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:21:08.102847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:21:08.102847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:21:08.102847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:08.102847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:08.102847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:08.102847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:08.102847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:08.102847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:08.103923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:08.103923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:08.103923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:08.103923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:08.103923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:08.103923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:08.103923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:08.103923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:08.103923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:08.103923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:08.103923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:21:08.103923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:21:08.103923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 12:21:08.103923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:08.103923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 398/785] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Oct 31 12:21:07 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:21:08.109832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62ead7-0ca2-4032-b762-7262a14b5594 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:08.165862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:08.215082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62ead7-0ca2-4032-b762-7262a14b5594 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:08.248256 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83396636-3310-42e9-9be4-74d71ee07d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:08.248864 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83396636-3310-42e9-9be4-74d71ee07d7a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:08.249171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83396636-3310-42e9-9be4-74d71ee07d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:08.249448 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83396636-3310-42e9-9be4-74d71ee07d7a None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:08.250076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83396636-3310-42e9-9be4-74d71ee07d7a None admin] RBAC: Adding query filter params (name=image) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:08.250380 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83396636-3310-42e9-9be4-74d71ee07d7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:08.251738 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83396636-3310-42e9-9be4-74d71ee07d7a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:08.257381 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 388/786] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:21:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:08.263045 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20eb6e-fce6-46e3-a0e6-5c16857bdbfc None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:08.365773 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20eb6e-fce6-46e3-a0e6-5c16857bdbfc None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:08.401390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971e187-2dd5-48c9-bbf1-e5936d417afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:08.401995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971e187-2dd5-48c9-bbf1-e5936d417afd None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:08.402273 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971e187-2dd5-48c9-bbf1-e5936d417afd None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:08.402544 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971e187-2dd5-48c9-bbf1-e5936d417afd None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:08.403175 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971e187-2dd5-48c9-bbf1-e5936d417afd None admin] RBAC: Adding query filter params (type=image) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:08.403475 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971e187-2dd5-48c9-bbf1-e5936d417afd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:08.404840 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971e187-2dd5-48c9-bbf1-e5936d417afd None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:08.415897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 399/787] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:21:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:08.418164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83396636-3310-42e9-9be4-74d71ee07d7a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:08.517293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83396636-3310-42e9-9be4-74d71ee07d7a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:08.533557 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:08.552042 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532e82a-c4af-4724-954e-ba85b67e6b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:08.553202 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532e82a-c4af-4724-954e-ba85b67e6b54 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:08.553487 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532e82a-c4af-4724-954e-ba85b67e6b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:08.553760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532e82a-c4af-4724-954e-ba85b67e6b54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:08.554419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532e82a-c4af-4724-954e-ba85b67e6b54 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:08.555762 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532e82a-c4af-4724-954e-ba85b67e6b54 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:08.580716 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 389/788] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:21:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:21:08.910840 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013e963-0ead-4d32-8cb6-e2ddc45890f2 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:08.911239 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013e963-0ead-4d32-8cb6-e2ddc45890f2 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:08.911441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013e963-0ead-4d32-8cb6-e2ddc45890f2 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:08.913530 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 400/789] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:08.918440 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933d573-946f-4106-9c00-e829b87cbc65 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:08.918742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933d573-946f-4106-9c00-e829b87cbc65 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:08.919025 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933d573-946f-4106-9c00-e829b87cbc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:08.936905 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f933d573-946f-4106-9c00-e829b87cbc65 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:08.938116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f933d573-946f-4106-9c00-e829b87cbc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:09.010389 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 390/790] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:21:09.280354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013e963-0ead-4d32-8cb6-e2ddc45890f2 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:09.323460 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:09.390527 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013e963-0ead-4d32-8cb6-e2ddc45890f2 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:09.423544 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d8479-86e1-4c23-aa8c-8a7ff2454089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:09.424170 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d8479-86e1-4c23-aa8c-8a7ff2454089 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:09.424449 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d8479-86e1-4c23-aa8c-8a7ff2454089 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:09.424721 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d8479-86e1-4c23-aa8c-8a7ff2454089 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:09.435247 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d8479-86e1-4c23-aa8c-8a7ff2454089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:21:09.439958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-9d0d8479-86e1-4c23-aa8c-8a7ff2454089 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 12:21:09.439958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:09.439958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:09.439958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:09.439958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:09.439958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:09.439958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:09.439958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:09.439958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:09.439958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:09.439958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:09.439958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:09.439958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:21:09.439958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:21:09.439958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:21:09.439958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:21:09.440872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:21:09.440872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:21:09.440872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:21:09.440872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:21:09.440872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:09.440872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:09.440872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:09.440872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:09.440872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:09.440872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:09.440872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:09.440872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:09.440872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:09.440872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:09.440872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:09.440872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:09.446068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:09.446068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:09.446068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:09.446068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:09.446068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:21:09.446068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:21:09.446068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:21:09.446068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:21:09.446068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:21:09.446068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:21:09.446068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 12:21:09.446068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:09.446068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 401/791] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Oct 31 12:21:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:21:09.447929 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933d573-946f-4106-9c00-e829b87cbc65 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:09.546587 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:09.551028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933d573-946f-4106-9c00-e829b87cbc65 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:09.587754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898548a-6667-4b0d-aae6-cad6beba1091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:09.588363 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898548a-6667-4b0d-aae6-cad6beba1091 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:09.588631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898548a-6667-4b0d-aae6-cad6beba1091 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:09.588905 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898548a-6667-4b0d-aae6-cad6beba1091 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:09.589604 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a898548a-6667-4b0d-aae6-cad6beba1091 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:09.589910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a898548a-6667-4b0d-aae6-cad6beba1091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:09.591265 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a898548a-6667-4b0d-aae6-cad6beba1091 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:09.599749 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 391/792] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Oct 31 12:21:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:09.605282 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d8479-86e1-4c23-aa8c-8a7ff2454089 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:09.701332 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:09.708249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d8479-86e1-4c23-aa8c-8a7ff2454089 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:09.742993 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ec3db-9880-4682-9b74-7ffd83db74e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:09.743621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ec3db-9880-4682-9b74-7ffd83db74e6 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:09.743903 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ec3db-9880-4682-9b74-7ffd83db74e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:09.744174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ec3db-9880-4682-9b74-7ffd83db74e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:09.754341 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ec3db-9880-4682-9b74-7ffd83db74e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:09.755820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ec3db-9880-4682-9b74-7ffd83db74e6 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:09.770152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-bb3ec3db-9880-4682-9b74-7ffd83db74e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:21:09.770152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:09.770152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:09.770152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:09.770152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:09.770152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:09.770152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:09.770152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:09.770152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:09.770152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:09.770152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:09.770152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:09.770152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:21:09.770152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:21:09.770152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:21:09.770152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:21:09.771124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:09.771124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:09.771124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:09.771124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:09.771124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:09.771124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:09.771124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:09.771124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:09.771124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:09.771124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:09.771124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:09.771124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:09.771124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:09.771124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:09.771124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:09.771124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:09.771124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:21:09.772029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:21:09.772029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:21:09.772029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:09.772029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 402/793] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:21:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:21:09.778329 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898548a-6667-4b0d-aae6-cad6beba1091 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:09.879581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898548a-6667-4b0d-aae6-cad6beba1091 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:09.915689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26047ad3-f7a3-470f-aa9b-116657e0c23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:09.916301 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26047ad3-f7a3-470f-aa9b-116657e0c23c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:09.916584 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26047ad3-f7a3-470f-aa9b-116657e0c23c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:09.916868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26047ad3-f7a3-470f-aa9b-116657e0c23c None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:09.917536 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26047ad3-f7a3-470f-aa9b-116657e0c23c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:09.917843 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26047ad3-f7a3-470f-aa9b-116657e0c23c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:09.919191 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26047ad3-f7a3-470f-aa9b-116657e0c23c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:09.931686 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 392/794] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:09.937133 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ec3db-9880-4682-9b74-7ffd83db74e6 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:10.043271 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ec3db-9880-4682-9b74-7ffd83db74e6 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:10.080760 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0ce5e-73e4-4e5c-b7d4-91eb94174c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:10.081427 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0ce5e-73e4-4e5c-b7d4-91eb94174c24 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:10.081708 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0ce5e-73e4-4e5c-b7d4-91eb94174c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:10.081977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0ce5e-73e4-4e5c-b7d4-91eb94174c24 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:10.090255 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0ce5e-73e4-4e5c-b7d4-91eb94174c24 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:10.091702 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0ce5e-73e4-4e5c-b7d4-91eb94174c24 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:10.092958 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4326ac-add2-477a-96e0-3df42329c79b None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:10.093286 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4326ac-add2-477a-96e0-3df42329c79b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:10.093552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4326ac-add2-477a-96e0-3df42329c79b None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:10.095006 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 393/795] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:21:10.100338 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccb872-a62e-4863-b895-548cbaf3231a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:10.100621 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccb872-a62e-4863-b895-548cbaf3231a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:10.100893 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccb872-a62e-4863-b895-548cbaf3231a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:10.104406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-c0c0ce5e-73e4-4e5c-b7d4-91eb94174c24 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 12:21:10.104406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:10.104406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:10.104406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:10.104406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:10.104406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:10.104406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:10.104406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:10.104406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:10.104406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:10.104406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:10.104406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:10.104406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:21:10.104406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:21:10.104406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:21:10.104406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:21:10.105390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:10.105390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:10.105390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:21:10.105390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:21:10.105390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:21:10.105390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:21:10.105390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:10.105390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:10.105390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:10.105390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:10.105390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:10.105390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:10.105390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:10.105390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:10.105390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:10.105390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:10.105390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:10.105390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:10.106354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:10.106354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:10.106354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:21:10.106354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:21:10.106354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:21:10.106354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:21:10.106354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:21:10.106354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:21:10.106354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 12:21:10.106354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:10.106354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 403/796] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Oct 31 12:21:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:21:10.111494 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0ce5e-73e4-4e5c-b7d4-91eb94174c24 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:10.121334 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c1ccb872-a62e-4863-b895-548cbaf3231a None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:10.122498 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c1ccb872-a62e-4863-b895-548cbaf3231a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:10.123348 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:10.137787 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:10.192314 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 394/797] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 12:21:10.219612 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0ce5e-73e4-4e5c-b7d4-91eb94174c24 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:10.253008 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7df492-777b-4330-976c-d0316ceeb6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:10.253701 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df492-777b-4330-976c-d0316ceeb6ed None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:10.253979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df492-777b-4330-976c-d0316ceeb6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:10.254249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df492-777b-4330-976c-d0316ceeb6ed None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:10.255025 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7df492-777b-4330-976c-d0316ceeb6ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:10.255362 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7df492-777b-4330-976c-d0316ceeb6ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:10.256795 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7df492-777b-4330-976c-d0316ceeb6ed None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:10.279368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 404/798] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Oct 31 12:21:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:21:10.280817 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccb872-a62e-4863-b895-548cbaf3231a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:10.380342 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccb872-a62e-4863-b895-548cbaf3231a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:10.415030 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd0763-7f67-461d-ac8d-c5ab515f5f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:10.415586 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd0763-7f67-461d-ac8d-c5ab515f5f33 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:10.415869 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd0763-7f67-461d-ac8d-c5ab515f5f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:10.416144 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd0763-7f67-461d-ac8d-c5ab515f5f33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:10.426037 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd0763-7f67-461d-ac8d-c5ab515f5f33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:10.427497 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd0763-7f67-461d-ac8d-c5ab515f5f33 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:10.441722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-4fcd0763-7f67-461d-ac8d-c5ab515f5f33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:21:10.441722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:10.441722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:10.441722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:10.441722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:10.441722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:10.441722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:10.441722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:10.441722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:10.441722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:10.441722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:10.441722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:10.441722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:21:10.441722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:21:10.441722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:21:10.441722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:21:10.442658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:10.442658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:10.442658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:10.442658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:10.442658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:10.442658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:10.442658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:10.442658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:10.442658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:10.442658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:10.442658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:10.442658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:10.442658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:10.442658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:10.442658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:10.442658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:10.442658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:21:10.449059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:21:10.449059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:21:10.449059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:21:10.449059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 395/799] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:21:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:21:10.449540 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7df492-777b-4330-976c-d0316ceeb6ed None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:10.457139 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd0763-7f67-461d-ac8d-c5ab515f5f33 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:10.460453 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:10.519837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:10.556731 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7df492-777b-4330-976c-d0316ceeb6ed None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:10.564137 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd0763-7f67-461d-ac8d-c5ab515f5f33 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:10.592947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f540400-a7c0-4f09-a40b-f40da5ce65eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:10.593643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f540400-a7c0-4f09-a40b-f40da5ce65eb None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:10.593917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f540400-a7c0-4f09-a40b-f40da5ce65eb None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:10.594182 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f540400-a7c0-4f09-a40b-f40da5ce65eb None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:10.594868 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f540400-a7c0-4f09-a40b-f40da5ce65eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:10.595169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f540400-a7c0-4f09-a40b-f40da5ce65eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:10.596513 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f540400-a7c0-4f09-a40b-f40da5ce65eb None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:10.600223 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6d379-7790-4254-a0d7-015e2952263d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:10.600857 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6d379-7790-4254-a0d7-015e2952263d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:10.601167 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6d379-7790-4254-a0d7-015e2952263d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:10.601442 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6d379-7790-4254-a0d7-015e2952263d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:10.602553 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6d379-7790-4254-a0d7-015e2952263d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:10.603950 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6d379-7790-4254-a0d7-015e2952263d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:10.605702 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 396/800] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:21:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:21:10.612467 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 405/801] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:21:10.613551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6d379-7790-4254-a0d7-015e2952263d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:10.613660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f540400-a7c0-4f09-a40b-f40da5ce65eb None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:10.694285 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:10.726594 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6d379-7790-4254-a0d7-015e2952263d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:10.727465 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f540400-a7c0-4f09-a40b-f40da5ce65eb None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:10.754879 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:10.763664 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003a7af-9591-4603-bf6a-03285a231871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:10.764273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003a7af-9591-4603-bf6a-03285a231871 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:10.764556 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003a7af-9591-4603-bf6a-03285a231871 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:10.764828 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003a7af-9591-4603-bf6a-03285a231871 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:10.765521 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003a7af-9591-4603-bf6a-03285a231871 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:10.766030 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fc634-52d3-4cde-ab23-f97f4acbd06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:10.766825 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fc634-52d3-4cde-ab23-f97f4acbd06d None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:10.766938 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003a7af-9591-4603-bf6a-03285a231871 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:10.767333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fc634-52d3-4cde-ab23-f97f4acbd06d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:10.767742 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fc634-52d3-4cde-ab23-f97f4acbd06d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:10.775346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fc634-52d3-4cde-ab23-f97f4acbd06d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:10.776768 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fc634-52d3-4cde-ab23-f97f4acbd06d None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:10.801134 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 397/802] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 31 12:21:10 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:21:10.801355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-872fc634-52d3-4cde-ab23-f97f4acbd06d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:21:10.801355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:10.801355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:10.801355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:10.801355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:10.801355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:10.801355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:10.801355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:10.801355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:10.801355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:10.801355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:10.801355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:10.801355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:21:10.801355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:21:10.801355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:21:10.802806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:21:10.802806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:10.802806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:10.802806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:10.802806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:10.802806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:10.802806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:10.802806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:10.802806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:10.802806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:10.802806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:10.802806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:10.802806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:10.802806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:10.802806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:10.802806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:10.802806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:10.803724 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:21:10.803724 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:21:10.803724 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:21:10.803724 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:21:10.803724 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:21:10.803724 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:21:10.803724 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:21:10.803724 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:10.804152 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c4f52-101a-4c4a-9f30-d8489f482a31 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:10.804222 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 406/803] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:21:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:21:10.804289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c4f52-101a-4c4a-9f30-d8489f482a31 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:10.804289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c4f52-101a-4c4a-9f30-d8489f482a31 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:10.804289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 398/804] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:10.804488 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fc634-52d3-4cde-ab23-f97f4acbd06d None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:10.804556 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f876b-361f-460f-bcdd-60ff19b580dd None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:10.804556 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f876b-361f-460f-bcdd-60ff19b580dd None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:10.804556 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f876b-361f-460f-bcdd-60ff19b580dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:10.819154 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-996f876b-361f-460f-bcdd-60ff19b580dd None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:10.820392 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-996f876b-361f-460f-bcdd-60ff19b580dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:10.901203 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 399/805] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:21:10.920840 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fc634-52d3-4cde-ab23-f97f4acbd06d None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:10.958805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1157d-ab52-4110-b1b2-785c4f571cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:10.959337 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1157d-ab52-4110-b1b2-785c4f571cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:10.960152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1157d-ab52-4110-b1b2-785c4f571cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:10.960152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1157d-ab52-4110-b1b2-785c4f571cb2 None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:10.960573 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1157d-ab52-4110-b1b2-785c4f571cb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:10.960880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1157d-ab52-4110-b1b2-785c4f571cb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:10.962356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1157d-ab52-4110-b1b2-785c4f571cb2 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:10.975992 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 407/806] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:21:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:10.981915 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f876b-361f-460f-bcdd-60ff19b580dd None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:11.041362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:11.091683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f876b-361f-460f-bcdd-60ff19b580dd None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:11.126463 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84220d-1035-4cb5-a295-e739ea7df845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:11.127122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84220d-1035-4cb5-a295-e739ea7df845 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:11.127406 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84220d-1035-4cb5-a295-e739ea7df845 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:11.127682 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84220d-1035-4cb5-a295-e739ea7df845 None admin] PATH_INFO: `/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/d93ce5759e0648a1934ff4d9c9d8fe61/roles/b18fbffdad824f8eb970f02bff1f2a62` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:11.129810 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84220d-1035-4cb5-a295-e739ea7df845 None admin] RBAC: Authorizing `identity:create_grant(project_id=786ee416a639447ab3698d1f56d04e9a, user_id=d93ce5759e0648a1934ff4d9c9d8fe61, role_id=b18fbffdad824f8eb970f02bff1f2a62)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:11.131908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84220d-1035-4cb5-a295-e739ea7df845 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:11.146356 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 400/807] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:21:10 2022] PUT /identity/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/d93ce5759e0648a1934ff4d9c9d8fe61/roles/b18fbffdad824f8eb970f02bff1f2a62 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:21:11.169906 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1157d-ab52-4110-b1b2-785c4f571cb2 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:11.225042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:11.283639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1157d-ab52-4110-b1b2-785c4f571cb2 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:11.324027 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e3643-ccd1-4f0b-9f18-37e686f7c940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:11.324749 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e3643-ccd1-4f0b-9f18-37e686f7c940 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:11.325101 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e3643-ccd1-4f0b-9f18-37e686f7c940 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:11.325474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e3643-ccd1-4f0b-9f18-37e686f7c940 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:11.326228 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e3643-ccd1-4f0b-9f18-37e686f7c940 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:11.327670 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e3643-ccd1-4f0b-9f18-37e686f7c940 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:11.336458 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.sql.core [None req-eb0e3643-ccd1-4f0b-9f18-37e686f7c940 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 12:21:11.336458 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 12:21:11.336458 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [parameters: {'id': '77b7d78c7ca74323a2b3d42253f9c4c8', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 12:21:11.336458 dv-cinder-796170-6-smb devstack@keystone.service[81457]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81457) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 12:21:11.343792 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-eb0e3643-ccd1-4f0b-9f18-37e686f7c940 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 31 12:21:11.343792 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:11.343792 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 12:21:11.343792 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 12:21:11.343792 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 12:21:11.343792 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 12:21:11.343792 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 12:21:11.343792 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 12:21:11.343792 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 12:21:11.343792 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application conn.query(q) Oct 31 12:21:11.343792 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 12:21:11.343792 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 12:21:11.343792 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 12:21:11.343792 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application result.read() Oct 31 12:21:11.344639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 12:21:11.344639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 12:21:11.344639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 12:21:11.344639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 12:21:11.344639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 12:21:11.344639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 12:21:11.344639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 12:21:11.344639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 12:21:11.344639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 12:21:11.344639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:11.344639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 12:21:11.344639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:11.344639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:11.344639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 12:21:11.344639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 12:21:11.344639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 31 12:21:11.344639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 31 12:21:11.344639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 12:21:11.345716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application next(self.gen) Oct 31 12:21:11.345716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 12:21:11.345716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application yield resource Oct 31 12:21:11.345716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 12:21:11.345716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application next(self.gen) Oct 31 12:21:11.345716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 12:21:11.345716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 12:21:11.345716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 12:21:11.345716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 12:21:11.345716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 12:21:11.345716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise self.value Oct 31 12:21:11.345716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 12:21:11.345716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 12:21:11.345716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 12:21:11.345716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application session.commit() Oct 31 12:21:11.345716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 12:21:11.345716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 12:21:11.346596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 12:21:11.346596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 12:21:11.346596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 12:21:11.346596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.session.flush() Oct 31 12:21:11.346596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 12:21:11.346596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 12:21:11.346596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 12:21:11.346596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 12:21:11.346596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 12:21:11.346596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application compat.raise_( Oct 31 12:21:11.346596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 12:21:11.346596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception Oct 31 12:21:11.346596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 12:21:11.346596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 12:21:11.346596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 12:21:11.346596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 12:21:11.346596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 12:21:11.348106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 12:21:11.348106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 12:21:11.348106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 12:21:11.348106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 12:21:11.348106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 12:21:11.348106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 12:21:11.348106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 12:21:11.348106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 12:21:11.348106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 12:21:11.348106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 12:21:11.348106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 12:21:11.348106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 12:21:11.348106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 12:21:11.348106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 12:21:11.348106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 12:21:11.348897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 12:21:11.348897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception Oct 31 12:21:11.348897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 12:21:11.348897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 12:21:11.348897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 12:21:11.348897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 12:21:11.348897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 12:21:11.348897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 12:21:11.348897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 12:21:11.348897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application conn.query(q) Oct 31 12:21:11.348897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 12:21:11.348897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 12:21:11.348897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 12:21:11.348897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application result.read() Oct 31 12:21:11.348897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 12:21:11.348897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 12:21:11.348897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 12:21:11.350356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 12:21:11.350356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 12:21:11.350356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 12:21:11.350356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 12:21:11.350356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 12:21:11.350356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 12:21:11.350356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 12:21:11.350356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [parameters: {'id': '77b7d78c7ca74323a2b3d42253f9c4c8', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 12:21:11.350356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 12:21:11.350356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:11.350356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:21:11.350356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:11.350356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:11.350356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 31 12:21:11.350356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 31 12:21:11.351144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 12:21:11.351144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 12:21:11.351144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 31 12:21:11.351144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:11.351144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:21:11.351144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:11.351144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:11.351144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:11.351144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:11.351144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:11.351144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:11.351144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:11.351144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:11.351144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:11.351144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:11.351144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:11.351144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:11.352020 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 31 12:21:11.352020 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 31 12:21:11.352020 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:11.352020 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:11.352020 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 31 12:21:11.352020 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 31 12:21:11.352020 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:11.352020 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:11.352020 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 31 12:21:11.352020 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 31 12:21:11.352020 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 31 12:21:11.352020 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:11.352020 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 408/808] 10.222.0.18 () {60 vars in 1137 bytes} [Mon Oct 31 12:21:11 2022] POST /identity/v3/domains => generated 190 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:21:11.354198 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84220d-1035-4cb5-a295-e739ea7df845 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:11.457342 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84220d-1035-4cb5-a295-e739ea7df845 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:11.473560 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:11.494863 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57249a6-664f-456d-9a98-ef9bfee1e69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:11.495422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57249a6-664f-456d-9a98-ef9bfee1e69f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:11.495702 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57249a6-664f-456d-9a98-ef9bfee1e69f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:11.495977 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57249a6-664f-456d-9a98-ef9bfee1e69f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:11.506339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57249a6-664f-456d-9a98-ef9bfee1e69f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:11.507777 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57249a6-664f-456d-9a98-ef9bfee1e69f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:11.522323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-c57249a6-664f-456d-9a98-ef9bfee1e69f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:21:11.522323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:11.522323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:11.522323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:11.522323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:11.522323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:11.522323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:11.522323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:11.522323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:11.522323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:11.522323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:11.522323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:11.522323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:21:11.522323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:21:11.522323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:21:11.522323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:21:11.523273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:11.523273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:11.523273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:11.523273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:11.523273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:11.523273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:11.523273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:11.523273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:11.523273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:11.523273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:11.523273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:11.523273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:11.523273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:11.523273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:11.523273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:11.523273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:11.523273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:21:11.529184 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:21:11.529184 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:21:11.529184 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:21:11.529184 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 401/809] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:21:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:21:11.531021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e3643-ccd1-4f0b-9f18-37e686f7c940 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:11.636582 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e3643-ccd1-4f0b-9f18-37e686f7c940 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:11.647997 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:11.674649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec5047-7739-4512-8403-425f322efc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:11.675265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec5047-7739-4512-8403-425f322efc47 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:11.675544 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec5047-7739-4512-8403-425f322efc47 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:11.675818 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec5047-7739-4512-8403-425f322efc47 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:11.676460 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec5047-7739-4512-8403-425f322efc47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:11.676822 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec5047-7739-4512-8403-425f322efc47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:11.678243 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec5047-7739-4512-8403-425f322efc47 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:11.693456 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 409/810] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:13.006752 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c19d1b-8948-4ff7-9964-2f8a80ad45c7 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:13.007394 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c19d1b-8948-4ff7-9964-2f8a80ad45c7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:13.007394 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c19d1b-8948-4ff7-9964-2f8a80ad45c7 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:13.008606 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 402/811] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:13.013717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e9be5-bf32-4e39-857d-44da7bad4699 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:13.014129 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e9be5-bf32-4e39-857d-44da7bad4699 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:13.014269 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e9be5-bf32-4e39-857d-44da7bad4699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:13.032301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e72e9be5-bf32-4e39-857d-44da7bad4699 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:13.033821 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e72e9be5-bf32-4e39-857d-44da7bad4699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:13.100150 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 410/812] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:21:13.323418 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9fc71-97ab-4f9e-b6f8-7152795fa78d None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:13.323633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9fc71-97ab-4f9e-b6f8-7152795fa78d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:13.323908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9fc71-97ab-4f9e-b6f8-7152795fa78d None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:13.325273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 403/813] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:13.330557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ac92b-9e3b-42ba-bc45-cde12f0c1345 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:13.330836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ac92b-9e3b-42ba-bc45-cde12f0c1345 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:13.331103 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ac92b-9e3b-42ba-bc45-cde12f0c1345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:13.349680 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-051ac92b-9e3b-42ba-bc45-cde12f0c1345 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:13.350842 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-051ac92b-9e3b-42ba-bc45-cde12f0c1345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:13.367138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9fc71-97ab-4f9e-b6f8-7152795fa78d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:13.416734 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 411/814] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:21:13.467693 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9fc71-97ab-4f9e-b6f8-7152795fa78d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:13.500095 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afad45-154b-41eb-96d4-3eec7d6797f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:13.500705 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afad45-154b-41eb-96d4-3eec7d6797f2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:13.500982 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afad45-154b-41eb-96d4-3eec7d6797f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:13.501278 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afad45-154b-41eb-96d4-3eec7d6797f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:13.512754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afad45-154b-41eb-96d4-3eec7d6797f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:21:13.517419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-b8afad45-154b-41eb-96d4-3eec7d6797f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:21:13.517419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:13.517419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:13.517419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:13.517419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:13.517419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:13.517419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:13.517419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:13.517419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:13.517419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:13.517419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:13.517419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:13.517419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:21:13.517419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:21:13.517419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:21:13.517419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:21:13.518671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:21:13.518671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:21:13.518671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:21:13.518671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:21:13.518671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:13.518671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:13.518671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:13.518671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:13.518671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:13.518671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:13.518671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:13.518671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:13.518671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:13.518671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:13.518671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:13.518671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:13.519773 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:13.519773 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:13.519773 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:13.519773 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:13.519773 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:21:13.519773 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:21:13.519773 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:21:13.519773 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:21:13.519773 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:21:13.519773 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:21:13.519773 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:21:13.519773 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:21:13.521565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 404/815] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 31 12:21:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:21:13.524868 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ac92b-9e3b-42ba-bc45-cde12f0c1345 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:13.553802 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:13.620228 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ac92b-9e3b-42ba-bc45-cde12f0c1345 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:13.652788 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925306a-f1a5-4d9e-b3aa-975b1582e3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:13.653410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925306a-f1a5-4d9e-b3aa-975b1582e3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:13.653688 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925306a-f1a5-4d9e-b3aa-975b1582e3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:13.653957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925306a-f1a5-4d9e-b3aa-975b1582e3d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:13.654610 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925306a-f1a5-4d9e-b3aa-975b1582e3d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:13.654905 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925306a-f1a5-4d9e-b3aa-975b1582e3d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:13.656248 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925306a-f1a5-4d9e-b3aa-975b1582e3d0 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:13.664237 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 412/816] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:21:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:13.669937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afad45-154b-41eb-96d4-3eec7d6797f2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:13.684151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925306a-f1a5-4d9e-b3aa-975b1582e3d0 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:13.697917 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:13.769915 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afad45-154b-41eb-96d4-3eec7d6797f2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:13.776742 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:13.786343 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925306a-f1a5-4d9e-b3aa-975b1582e3d0 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:13.803786 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f20c7-3ea6-4dfa-9d07-db18caa2a904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:13.804399 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f20c7-3ea6-4dfa-9d07-db18caa2a904 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:13.804675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f20c7-3ea6-4dfa-9d07-db18caa2a904 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:13.804939 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f20c7-3ea6-4dfa-9d07-db18caa2a904 None admin] PATH_INFO: `/v3/users/fcea66080f294f6bb9e18f73a02ae68e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:13.818243 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f20c7-3ea6-4dfa-9d07-db18caa2a904 None admin] RBAC: Authorizing `identity:get_user(user_id=fcea66080f294f6bb9e18f73a02ae68e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:13.819641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f20c7-3ea6-4dfa-9d07-db18caa2a904 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:13.820065 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7ab76-86fc-4c7d-949e-041cc87c55d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:13.820692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7ab76-86fc-4c7d-949e-041cc87c55d8 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:13.820971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7ab76-86fc-4c7d-949e-041cc87c55d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:13.826157 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7ab76-86fc-4c7d-949e-041cc87c55d8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:13.826313 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 405/817] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:21:13 2022] GET /identity/v3/users/fcea66080f294f6bb9e18f73a02ae68e => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:13.826980 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f20c7-3ea6-4dfa-9d07-db18caa2a904 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:13.831766 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7ab76-86fc-4c7d-949e-041cc87c55d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:21:13.836509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-6eb7ab76-86fc-4c7d-949e-041cc87c55d8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 12:21:13.836509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:13.836509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:13.836509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:13.836509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:13.836509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:13.836509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:13.836509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:13.836509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:13.836509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:13.836509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:13.836509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:13.836509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:21:13.836509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:21:13.836509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:21:13.836509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:21:13.837495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:21:13.837495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:21:13.837495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:21:13.837495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:21:13.837495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:13.837495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:13.837495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:13.837495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:13.837495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:13.837495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:13.837495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:13.837495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:13.837495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:13.837495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:13.837495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:13.837495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:13.838353 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:13.838353 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:13.838353 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:13.838353 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:13.838353 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:21:13.838353 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:21:13.838353 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:21:13.838353 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:21:13.838353 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:21:13.838353 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:21:13.838353 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 12:21:13.838353 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:13.838353 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 413/818] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Oct 31 12:21:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:21:13.843465 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7ab76-86fc-4c7d-949e-041cc87c55d8 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:13.908031 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:13.923223 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f20c7-3ea6-4dfa-9d07-db18caa2a904 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:13.945700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7ab76-86fc-4c7d-949e-041cc87c55d8 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:13.957254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e84c6c-ad91-4cf6-bb86-e11446208b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:13.957879 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e84c6c-ad91-4cf6-bb86-e11446208b1f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:13.958154 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e84c6c-ad91-4cf6-bb86-e11446208b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:13.958454 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e84c6c-ad91-4cf6-bb86-e11446208b1f None admin] PATH_INFO: `/v3/projects/95d6b664484b4e5d8d3764ebd0628eca` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:13.959560 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e84c6c-ad91-4cf6-bb86-e11446208b1f None admin] RBAC: Authorizing `identity:get_project(project_id=95d6b664484b4e5d8d3764ebd0628eca)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:13.960974 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e84c6c-ad91-4cf6-bb86-e11446208b1f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:13.962769 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 406/819] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:21:13 2022] GET /identity/v3/projects/95d6b664484b4e5d8d3764ebd0628eca => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:13.968378 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e84c6c-ad91-4cf6-bb86-e11446208b1f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:13.979186 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174fcd8-7d6a-48b2-90d5-8d8a0112fdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:13.979785 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174fcd8-7d6a-48b2-90d5-8d8a0112fdc8 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:13.980061 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174fcd8-7d6a-48b2-90d5-8d8a0112fdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:13.980330 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174fcd8-7d6a-48b2-90d5-8d8a0112fdc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:13.980985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174fcd8-7d6a-48b2-90d5-8d8a0112fdc8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:13.981309 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174fcd8-7d6a-48b2-90d5-8d8a0112fdc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:13.982647 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174fcd8-7d6a-48b2-90d5-8d8a0112fdc8 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:13.991248 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 414/820] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Oct 31 12:21:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:21:13.996889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174fcd8-7d6a-48b2-90d5-8d8a0112fdc8 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:14.012666 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:14.069397 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e84c6c-ad91-4cf6-bb86-e11446208b1f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:14.094142 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174fcd8-7d6a-48b2-90d5-8d8a0112fdc8 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:14.105456 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cacf3-1cc2-4351-b52b-1a3f8b8ae15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:14.106112 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cacf3-1cc2-4351-b52b-1a3f8b8ae15a None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:14.106393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cacf3-1cc2-4351-b52b-1a3f8b8ae15a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:14.106666 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cacf3-1cc2-4351-b52b-1a3f8b8ae15a None admin] PATH_INFO: `/v3/projects/95d6b664484b4e5d8d3764ebd0628eca/users/fcea66080f294f6bb9e18f73a02ae68e/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:14.108559 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cacf3-1cc2-4351-b52b-1a3f8b8ae15a None admin] RBAC: Authorizing `identity:create_grant(project_id=95d6b664484b4e5d8d3764ebd0628eca, user_id=fcea66080f294f6bb9e18f73a02ae68e, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:14.110007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cacf3-1cc2-4351-b52b-1a3f8b8ae15a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:14.123100 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 407/821] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:21:13 2022] PUT /identity/v3/projects/95d6b664484b4e5d8d3764ebd0628eca/users/fcea66080f294f6bb9e18f73a02ae68e/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:21:14.127792 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed41c6d-d080-4585-a24a-6d4d6f8d93ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:14.128440 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed41c6d-d080-4585-a24a-6d4d6f8d93ab None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:14.128722 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed41c6d-d080-4585-a24a-6d4d6f8d93ab None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:14.128992 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed41c6d-d080-4585-a24a-6d4d6f8d93ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:14.141707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed41c6d-d080-4585-a24a-6d4d6f8d93ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:14.143178 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed41c6d-d080-4585-a24a-6d4d6f8d93ab None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:14.159010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-1ed41c6d-d080-4585-a24a-6d4d6f8d93ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:21:14.159010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:14.159010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:14.159010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:14.159010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:14.159010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:14.159010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:14.159010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:14.159010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:14.159010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:14.159010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:14.159010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:14.159010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:21:14.159010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:21:14.159010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:21:14.159010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:21:14.160275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:14.160275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:14.160275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:14.160275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:14.160275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:14.160275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:14.160275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:14.160275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:14.160275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:14.160275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:14.160275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:14.160275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:14.160275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:14.160275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:14.160275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:14.160275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:14.160275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:21:14.161214 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:21:14.161214 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:21:14.161214 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:14.161214 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 415/822] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:21:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:21:14.166526 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cacf3-1cc2-4351-b52b-1a3f8b8ae15a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:14.183712 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:14.271900 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cacf3-1cc2-4351-b52b-1a3f8b8ae15a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:14.307251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f344ce-8df9-497f-9d1c-96236b63f8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:14.307862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f344ce-8df9-497f-9d1c-96236b63f8cb None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:14.308144 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f344ce-8df9-497f-9d1c-96236b63f8cb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:14.308419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f344ce-8df9-497f-9d1c-96236b63f8cb None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:14.309066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f344ce-8df9-497f-9d1c-96236b63f8cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:14.309399 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f344ce-8df9-497f-9d1c-96236b63f8cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:14.310763 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f344ce-8df9-497f-9d1c-96236b63f8cb None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:14.321817 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 408/823] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:14.327711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed41c6d-d080-4585-a24a-6d4d6f8d93ab None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:14.391968 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:14.427793 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed41c6d-d080-4585-a24a-6d4d6f8d93ab None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:14.459928 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348193e4-e302-4b9e-a898-2890cf3a0823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:14.460551 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348193e4-e302-4b9e-a898-2890cf3a0823 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:14.460830 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348193e4-e302-4b9e-a898-2890cf3a0823 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:14.461123 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348193e4-e302-4b9e-a898-2890cf3a0823 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:14.468542 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348193e4-e302-4b9e-a898-2890cf3a0823 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:14.470000 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348193e4-e302-4b9e-a898-2890cf3a0823 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:14.481354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-348193e4-e302-4b9e-a898-2890cf3a0823 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 12:21:14.481354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:14.481354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:14.481354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:14.481354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:14.481354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:14.481354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:14.481354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:14.481354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:14.481354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:14.481354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:14.481354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:14.481354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:21:14.481354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:21:14.481354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:21:14.481354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:21:14.482484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:14.482484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:14.482484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:21:14.482484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:21:14.482484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:21:14.482484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:21:14.482484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:14.482484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:14.482484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:14.482484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:14.482484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:14.482484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:14.482484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:14.482484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:14.482484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:14.482484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:14.482484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:14.482484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:14.483530 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:14.483530 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:14.483530 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:21:14.483530 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:21:14.483530 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:21:14.483530 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:21:14.483530 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:21:14.483530 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:21:14.483530 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 12:21:14.483530 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:14.483530 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 416/824] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Oct 31 12:21:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:21:14.488135 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f344ce-8df9-497f-9d1c-96236b63f8cb None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:14.562219 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:14.587040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f344ce-8df9-497f-9d1c-96236b63f8cb None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:14.619290 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc88a45-a66e-4f98-b23a-3fd52bfae07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:14.619888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc88a45-a66e-4f98-b23a-3fd52bfae07f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:14.620164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc88a45-a66e-4f98-b23a-3fd52bfae07f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:14.620437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc88a45-a66e-4f98-b23a-3fd52bfae07f None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:14.621190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc88a45-a66e-4f98-b23a-3fd52bfae07f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:14.621491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc88a45-a66e-4f98-b23a-3fd52bfae07f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:14.622897 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc88a45-a66e-4f98-b23a-3fd52bfae07f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:14.640156 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 409/825] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Oct 31 12:21:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:14.646407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348193e4-e302-4b9e-a898-2890cf3a0823 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:14.743337 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348193e4-e302-4b9e-a898-2890cf3a0823 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:14.768726 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:14.778359 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195eae2-7f73-4c9e-bbe7-cdd93821b250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:14.778965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195eae2-7f73-4c9e-bbe7-cdd93821b250 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:14.779248 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195eae2-7f73-4c9e-bbe7-cdd93821b250 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:14.779520 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195eae2-7f73-4c9e-bbe7-cdd93821b250 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:14.845911 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195eae2-7f73-4c9e-bbe7-cdd93821b250 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:14.847346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195eae2-7f73-4c9e-bbe7-cdd93821b250 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:14.944025 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 417/826] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:21:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 31 12:21:14.949993 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc88a45-a66e-4f98-b23a-3fd52bfae07f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:15.047538 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc88a45-a66e-4f98-b23a-3fd52bfae07f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:15.076788 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:15.082107 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe88c81-1244-40d8-88e1-86e54f866bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:15.082736 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe88c81-1244-40d8-88e1-86e54f866bbb None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:15.083017 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe88c81-1244-40d8-88e1-86e54f866bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:15.083893 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe88c81-1244-40d8-88e1-86e54f866bbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:15.093654 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe88c81-1244-40d8-88e1-86e54f866bbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:15.095061 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe88c81-1244-40d8-88e1-86e54f866bbb None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:15.108991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-ffe88c81-1244-40d8-88e1-86e54f866bbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:21:15.108991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:15.108991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:15.108991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:15.108991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:15.108991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:15.108991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:15.108991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:15.108991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:15.108991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:15.108991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:15.108991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:15.108991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:21:15.108991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:21:15.108991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:21:15.108991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:21:15.109927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:15.109927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:15.109927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:15.109927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:15.109927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:15.109927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:15.109927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:15.109927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:15.109927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:15.109927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:15.109927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:15.109927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:15.109927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:15.109927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:15.109927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:15.109927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:15.109927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:21:15.110823 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:21:15.110823 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:21:15.110823 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:21:15.110823 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 410/827] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:21:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:21:15.115886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195eae2-7f73-4c9e-bbe7-cdd93821b250 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:15.142204 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:15.213047 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195eae2-7f73-4c9e-bbe7-cdd93821b250 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:15.245008 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf24af-7292-4e67-94ee-9e5924bbef27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:15.245625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf24af-7292-4e67-94ee-9e5924bbef27 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:15.245900 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf24af-7292-4e67-94ee-9e5924bbef27 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:15.246168 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf24af-7292-4e67-94ee-9e5924bbef27 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:15.246796 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf24af-7292-4e67-94ee-9e5924bbef27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:15.247091 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf24af-7292-4e67-94ee-9e5924bbef27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:15.248428 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf24af-7292-4e67-94ee-9e5924bbef27 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:15.259693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 418/828] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:15.265416 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe88c81-1244-40d8-88e1-86e54f866bbb None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:15.362343 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe88c81-1244-40d8-88e1-86e54f866bbb None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:15.394859 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e467aa-66a7-40ea-a996-7a228d8fb37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:15.395474 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e467aa-66a7-40ea-a996-7a228d8fb37c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:15.395751 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e467aa-66a7-40ea-a996-7a228d8fb37c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:15.396019 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e467aa-66a7-40ea-a996-7a228d8fb37c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:15.402303 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e467aa-66a7-40ea-a996-7a228d8fb37c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:15.403741 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e467aa-66a7-40ea-a996-7a228d8fb37c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:15.414662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-25e467aa-66a7-40ea-a996-7a228d8fb37c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:21:15.414662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:15.414662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:15.414662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:15.414662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:15.414662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:15.414662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:15.414662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:15.414662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:15.414662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:15.414662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:15.414662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:15.414662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:21:15.414662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:21:15.414662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:21:15.415572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:21:15.415572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:15.415572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:15.415572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:15.415572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:15.415572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:15.415572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:15.415572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:15.415572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:15.415572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:15.415572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:15.415572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:15.415572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:15.415572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:15.415572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:15.415572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:15.415572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:15.416839 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:21:15.416839 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:21:15.416839 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:21:15.416839 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:21:15.416839 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:21:15.416839 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:21:15.416839 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:21:15.416839 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:21:15.416839 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 411/829] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:21:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:21:15.421483 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf24af-7292-4e67-94ee-9e5924bbef27 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:15.502666 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:15.517609 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf24af-7292-4e67-94ee-9e5924bbef27 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:15.549560 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba09e9-65e1-4c9c-a7d0-95dc7fe4da44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:15.550163 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba09e9-65e1-4c9c-a7d0-95dc7fe4da44 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:15.550443 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba09e9-65e1-4c9c-a7d0-95dc7fe4da44 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:15.550716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba09e9-65e1-4c9c-a7d0-95dc7fe4da44 None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:15.551405 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba09e9-65e1-4c9c-a7d0-95dc7fe4da44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:15.551710 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba09e9-65e1-4c9c-a7d0-95dc7fe4da44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:15.553664 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba09e9-65e1-4c9c-a7d0-95dc7fe4da44 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:15.565035 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 419/830] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:21:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:15.571830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e467aa-66a7-40ea-a996-7a228d8fb37c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:15.615511 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:15.667796 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e467aa-66a7-40ea-a996-7a228d8fb37c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:15.700336 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91027cd1-8bf7-4ae1-8c88-a1b911daed0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:15.700931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91027cd1-8bf7-4ae1-8c88-a1b911daed0a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:15.701242 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91027cd1-8bf7-4ae1-8c88-a1b911daed0a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:15.701515 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91027cd1-8bf7-4ae1-8c88-a1b911daed0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:15.702229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91027cd1-8bf7-4ae1-8c88-a1b911daed0a None admin] RBAC: Adding query filter params (role.id=b18fbffdad824f8eb970f02bff1f2a62, scope.project.id=786ee416a639447ab3698d1f56d04e9a, user.id=d93ce5759e0648a1934ff4d9c9d8fe61) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:15.702533 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91027cd1-8bf7-4ae1-8c88-a1b911daed0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:15.703946 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91027cd1-8bf7-4ae1-8c88-a1b911daed0a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:15.709603 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 412/831] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:21:15 2022] GET /identity/v3/role_assignments?user.id=d93ce5759e0648a1934ff4d9c9d8fe61&scope.project.id=786ee416a639447ab3698d1f56d04e9a&role.id=b18fbffdad824f8eb970f02bff1f2a62 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:16.241948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4719b-5018-47d8-8b47-0cb11950e6d8 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:16.242479 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4719b-5018-47d8-8b47-0cb11950e6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:16.242479 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4719b-5018-47d8-8b47-0cb11950e6d8 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:16.243909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 420/832] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:16.249050 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2a180-f497-4600-87cf-7e697952d01a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:16.249493 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2a180-f497-4600-87cf-7e697952d01a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:16.249638 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2a180-f497-4600-87cf-7e697952d01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:16.267843 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2af2a180-f497-4600-87cf-7e697952d01a None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:16.269056 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2af2a180-f497-4600-87cf-7e697952d01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:16.338665 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 413/833] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:21:16.605468 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4719b-5018-47d8-8b47-0cb11950e6d8 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:16.703436 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4719b-5018-47d8-8b47-0cb11950e6d8 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:16.736037 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f5ebb-e235-4e3f-b579-18519bb450ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:16.736643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f5ebb-e235-4e3f-b579-18519bb450ec None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:16.736923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f5ebb-e235-4e3f-b579-18519bb450ec None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:16.737219 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f5ebb-e235-4e3f-b579-18519bb450ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:16.746929 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f5ebb-e235-4e3f-b579-18519bb450ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:21:16.751635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-b85f5ebb-e235-4e3f-b579-18519bb450ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:21:16.751635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:16.751635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:16.751635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:16.751635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:16.751635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:16.751635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:16.751635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:16.751635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:16.751635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:16.751635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:16.751635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:16.751635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:21:16.751635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:21:16.751635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:21:16.751635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:21:16.752753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:21:16.752753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:21:16.752753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:21:16.752753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:21:16.752753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:16.752753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:16.752753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:16.752753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:16.752753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:16.752753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:16.752753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:16.752753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:16.752753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:16.752753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:16.752753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:16.752753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:16.753798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:16.753798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:16.753798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:16.753798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:16.753798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:21:16.753798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:21:16.753798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:21:16.753798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:21:16.753798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:21:16.753798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:21:16.753798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:21:16.753798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:16.753798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 421/834] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 31 12:21:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:21:16.759492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2a180-f497-4600-87cf-7e697952d01a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:16.797444 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:16.853909 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2a180-f497-4600-87cf-7e697952d01a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:16.886982 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacfaae-49da-471e-a788-9ee172605f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:16.887516 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacfaae-49da-471e-a788-9ee172605f0d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:16.887793 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacfaae-49da-471e-a788-9ee172605f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:16.888063 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacfaae-49da-471e-a788-9ee172605f0d None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:16.888719 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacfaae-49da-471e-a788-9ee172605f0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:16.889016 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacfaae-49da-471e-a788-9ee172605f0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:16.890405 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacfaae-49da-471e-a788-9ee172605f0d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:16.898068 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 414/835] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:21:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:16.903818 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f5ebb-e235-4e3f-b579-18519bb450ec None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:16.913061 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:17.000397 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f5ebb-e235-4e3f-b579-18519bb450ec None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:17.032690 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7324c3-d107-413e-92e2-a1ccc2a02eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:17.033320 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7324c3-d107-413e-92e2-a1ccc2a02eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:17.033598 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7324c3-d107-413e-92e2-a1ccc2a02eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:17.033867 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7324c3-d107-413e-92e2-a1ccc2a02eb9 None admin] PATH_INFO: `/v3/users/fcea66080f294f6bb9e18f73a02ae68e` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:17.035213 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7324c3-d107-413e-92e2-a1ccc2a02eb9 None admin] RBAC: Authorizing `identity:get_user(user_id=fcea66080f294f6bb9e18f73a02ae68e)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:17.036644 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7324c3-d107-413e-92e2-a1ccc2a02eb9 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:17.038205 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 422/836] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:21:16 2022] GET /identity/v3/users/fcea66080f294f6bb9e18f73a02ae68e => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:17.043734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacfaae-49da-471e-a788-9ee172605f0d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:17.137876 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:17.140754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacfaae-49da-471e-a788-9ee172605f0d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:17.172722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c31d7-f360-4f6a-94a5-3fd38f600004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:17.173341 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c31d7-f360-4f6a-94a5-3fd38f600004 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:17.173618 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c31d7-f360-4f6a-94a5-3fd38f600004 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:17.173885 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c31d7-f360-4f6a-94a5-3fd38f600004 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:17.237350 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c31d7-f360-4f6a-94a5-3fd38f600004 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:17.238764 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c31d7-f360-4f6a-94a5-3fd38f600004 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:17.328358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:17.336513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 415/837] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:21:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 12:21:17.337876 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7324c3-d107-413e-92e2-a1ccc2a02eb9 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:17.409473 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:17.434296 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7324c3-d107-413e-92e2-a1ccc2a02eb9 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:17.465993 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564e501-871f-442c-b957-acec4ec4ea8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:17.466597 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564e501-871f-442c-b957-acec4ec4ea8e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:17.466878 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564e501-871f-442c-b957-acec4ec4ea8e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:17.467144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564e501-871f-442c-b957-acec4ec4ea8e None admin] PATH_INFO: `/v3/projects/95d6b664484b4e5d8d3764ebd0628eca` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:17.468227 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564e501-871f-442c-b957-acec4ec4ea8e None admin] RBAC: Authorizing `identity:get_project(project_id=95d6b664484b4e5d8d3764ebd0628eca)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:17.469674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564e501-871f-442c-b957-acec4ec4ea8e None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:17.471248 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 423/838] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:21:17 2022] GET /identity/v3/projects/95d6b664484b4e5d8d3764ebd0628eca => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:17.477653 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c31d7-f360-4f6a-94a5-3fd38f600004 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:17.570896 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c31d7-f360-4f6a-94a5-3fd38f600004 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:17.603591 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5241e9e-3e39-4e18-8a04-09ad45afc7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:17.604181 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5241e9e-3e39-4e18-8a04-09ad45afc7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:17.604460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5241e9e-3e39-4e18-8a04-09ad45afc7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:17.604730 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5241e9e-3e39-4e18-8a04-09ad45afc7d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:17.605465 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5241e9e-3e39-4e18-8a04-09ad45afc7d5 None admin] RBAC: Adding query filter params (role.id=e1b3a811029244d2a7e2664cd3246eec, scope.project.id=95d6b664484b4e5d8d3764ebd0628eca, user.id=fcea66080f294f6bb9e18f73a02ae68e) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:17.605770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5241e9e-3e39-4e18-8a04-09ad45afc7d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:17.607160 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5241e9e-3e39-4e18-8a04-09ad45afc7d5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:17.612574 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 416/839] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:21:17 2022] GET /identity/v3/role_assignments?user.id=fcea66080f294f6bb9e18f73a02ae68e&scope.project.id=95d6b664484b4e5d8d3764ebd0628eca&role.id=e1b3a811029244d2a7e2664cd3246eec => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:19.736734 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bca6f-9055-4c02-aa3b-69b0f3f2f945 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:19.737316 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bca6f-9055-4c02-aa3b-69b0f3f2f945 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:19.737316 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bca6f-9055-4c02-aa3b-69b0f3f2f945 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:19.738633 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 424/840] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:19.744445 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a64f3c-7ef4-4216-838a-b933d7976dcc None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:19.744814 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a64f3c-7ef4-4216-838a-b933d7976dcc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:19.744995 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a64f3c-7ef4-4216-838a-b933d7976dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:19.762594 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-64a64f3c-7ef4-4216-838a-b933d7976dcc None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:19.763765 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-64a64f3c-7ef4-4216-838a-b933d7976dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:19.819507 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:19.827305 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 417/841] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:21:20.095812 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bca6f-9055-4c02-aa3b-69b0f3f2f945 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:20.195061 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bca6f-9055-4c02-aa3b-69b0f3f2f945 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:20.227765 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd1e0d-14f9-486f-b9e5-675224fa7bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:20.228370 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd1e0d-14f9-486f-b9e5-675224fa7bbc None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:20.228650 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd1e0d-14f9-486f-b9e5-675224fa7bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:20.228923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd1e0d-14f9-486f-b9e5-675224fa7bbc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:20.230036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd1e0d-14f9-486f-b9e5-675224fa7bbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:20.231459 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd1e0d-14f9-486f-b9e5-675224fa7bbc None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:20.232974 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 425/842] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:21:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:20.238636 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a64f3c-7ef4-4216-838a-b933d7976dcc None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:20.332361 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a64f3c-7ef4-4216-838a-b933d7976dcc None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:20.364468 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1b70c-57b4-44d6-8931-c514622ad26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:20.365058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1b70c-57b4-44d6-8931-c514622ad26a None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:20.365491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1b70c-57b4-44d6-8931-c514622ad26a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:20.365766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1b70c-57b4-44d6-8931-c514622ad26a None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:20.366402 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1b70c-57b4-44d6-8931-c514622ad26a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:20.367817 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1b70c-57b4-44d6-8931-c514622ad26a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:20.388679 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 418/843] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 31 12:21:20 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:21:22.518824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6754c-9ef3-40ca-926a-bdb8273cae64 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:22.519346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6754c-9ef3-40ca-926a-bdb8273cae64 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:22.519346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6754c-9ef3-40ca-926a-bdb8273cae64 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:22.521356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 426/844] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:22.526381 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd763d7-9b4c-43c9-9c3b-ae1d035c4bba None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:22.526815 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd763d7-9b4c-43c9-9c3b-ae1d035c4bba None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:22.526919 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd763d7-9b4c-43c9-9c3b-ae1d035c4bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:22.545506 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0fd763d7-9b4c-43c9-9c3b-ae1d035c4bba None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:22.546723 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0fd763d7-9b4c-43c9-9c3b-ae1d035c4bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:22.590772 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:22.611353 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 419/845] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:21:22.875050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6754c-9ef3-40ca-926a-bdb8273cae64 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:22.887726 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:22.972118 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6754c-9ef3-40ca-926a-bdb8273cae64 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:23.004184 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e1cfa-4b87-4fe4-9db6-cc7d6c0eccd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:23.005401 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e1cfa-4b87-4fe4-9db6-cc7d6c0eccd9 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:23.005678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e1cfa-4b87-4fe4-9db6-cc7d6c0eccd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:23.005946 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e1cfa-4b87-4fe4-9db6-cc7d6c0eccd9 None admin] PATH_INFO: `/v3/roles/209186498dcb49a693401b009f73812e` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:23.007311 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e1cfa-4b87-4fe4-9db6-cc7d6c0eccd9 None admin] RBAC: Authorizing `identity:get_role(role_id=209186498dcb49a693401b009f73812e)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:23.008650 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e1cfa-4b87-4fe4-9db6-cc7d6c0eccd9 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:23.009956 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 427/846] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:21:22 2022] GET /identity/v3/roles/209186498dcb49a693401b009f73812e => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:23.015619 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd763d7-9b4c-43c9-9c3b-ae1d035c4bba None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:23.108183 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd763d7-9b4c-43c9-9c3b-ae1d035c4bba None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:23.140554 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7af2c-fd5a-42ad-9e5b-abbaf88b8580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:23.141137 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7af2c-fd5a-42ad-9e5b-abbaf88b8580 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:23.141409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7af2c-fd5a-42ad-9e5b-abbaf88b8580 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:23.141677 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7af2c-fd5a-42ad-9e5b-abbaf88b8580 None admin] PATH_INFO: `/v3/users/95f62489b6524cfebb2e1ac4f859c2c9` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:23.153937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7af2c-fd5a-42ad-9e5b-abbaf88b8580 None admin] RBAC: Authorizing `identity:get_user(user_id=95f62489b6524cfebb2e1ac4f859c2c9)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:23.155349 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7af2c-fd5a-42ad-9e5b-abbaf88b8580 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:23.156898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 420/847] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:21:23 2022] GET /identity/v3/users/95f62489b6524cfebb2e1ac4f859c2c9 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:23.162811 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e1cfa-4b87-4fe4-9db6-cc7d6c0eccd9 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:23.237184 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:23.258294 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e1cfa-4b87-4fe4-9db6-cc7d6c0eccd9 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:23.290434 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088cd20-0138-4cf5-9f07-c79e0af0e1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:23.291043 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088cd20-0138-4cf5-9f07-c79e0af0e1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:23.291320 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088cd20-0138-4cf5-9f07-c79e0af0e1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:23.291590 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088cd20-0138-4cf5-9f07-c79e0af0e1e2 None admin] PATH_INFO: `/v3/projects/95d6b664484b4e5d8d3764ebd0628eca` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:23.292673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088cd20-0138-4cf5-9f07-c79e0af0e1e2 None admin] RBAC: Authorizing `identity:get_project(project_id=95d6b664484b4e5d8d3764ebd0628eca)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:23.294095 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088cd20-0138-4cf5-9f07-c79e0af0e1e2 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:23.295654 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 428/848] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:21:23 2022] GET /identity/v3/projects/95d6b664484b4e5d8d3764ebd0628eca => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:23.301372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7af2c-fd5a-42ad-9e5b-abbaf88b8580 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:23.339153 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:23.395293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7af2c-fd5a-42ad-9e5b-abbaf88b8580 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:23.427658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be6762-3d51-46d9-86d4-ac016ab8936d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:23.428303 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be6762-3d51-46d9-86d4-ac016ab8936d None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:23.428580 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be6762-3d51-46d9-86d4-ac016ab8936d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:23.428851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be6762-3d51-46d9-86d4-ac016ab8936d None admin] PATH_INFO: `/v3/projects/95d6b664484b4e5d8d3764ebd0628eca/users/95f62489b6524cfebb2e1ac4f859c2c9/roles/209186498dcb49a693401b009f73812e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:23.430956 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be6762-3d51-46d9-86d4-ac016ab8936d None admin] RBAC: Authorizing `identity:create_grant(project_id=95d6b664484b4e5d8d3764ebd0628eca, user_id=95f62489b6524cfebb2e1ac4f859c2c9, role_id=209186498dcb49a693401b009f73812e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:23.432348 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be6762-3d51-46d9-86d4-ac016ab8936d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:23.444919 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 421/849] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:21:23 2022] PUT /identity/v3/projects/95d6b664484b4e5d8d3764ebd0628eca/users/95f62489b6524cfebb2e1ac4f859c2c9/roles/209186498dcb49a693401b009f73812e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:21:25.528981 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c102cfc-7de8-416b-acd9-5f3d0dae6cb4 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:25.529543 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c102cfc-7de8-416b-acd9-5f3d0dae6cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:25.529543 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c102cfc-7de8-416b-acd9-5f3d0dae6cb4 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:25.530902 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 429/850] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:25.536274 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1eee06-4753-4b8b-8e54-8846ece10a51 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:25.536648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1eee06-4753-4b8b-8e54-8846ece10a51 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:25.536821 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1eee06-4753-4b8b-8e54-8846ece10a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:25.554346 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7a1eee06-4753-4b8b-8e54-8846ece10a51 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:25.555513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7a1eee06-4753-4b8b-8e54-8846ece10a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:25.617709 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 422/851] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:21:25.885943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c102cfc-7de8-416b-acd9-5f3d0dae6cb4 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:25.982757 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c102cfc-7de8-416b-acd9-5f3d0dae6cb4 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:26.015910 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76882f12-866b-432c-ad4a-2daa7ba8d44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:26.016532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76882f12-866b-432c-ad4a-2daa7ba8d44e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:26.016812 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76882f12-866b-432c-ad4a-2daa7ba8d44e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:26.017086 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76882f12-866b-432c-ad4a-2daa7ba8d44e None admin] PATH_INFO: `/v3/roles/209186498dcb49a693401b009f73812e` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:26.018498 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76882f12-866b-432c-ad4a-2daa7ba8d44e None admin] RBAC: Authorizing `identity:get_role(role_id=209186498dcb49a693401b009f73812e)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:26.019847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76882f12-866b-432c-ad4a-2daa7ba8d44e None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:26.021234 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 430/852] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:21:25 2022] GET /identity/v3/roles/209186498dcb49a693401b009f73812e => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:26.026965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1eee06-4753-4b8b-8e54-8846ece10a51 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:26.053514 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:26.122661 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1eee06-4753-4b8b-8e54-8846ece10a51 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:26.154573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15a88a-3d9a-418a-8ea1-31666b699cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:26.155128 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15a88a-3d9a-418a-8ea1-31666b699cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:26.155405 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15a88a-3d9a-418a-8ea1-31666b699cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:26.155676 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15a88a-3d9a-418a-8ea1-31666b699cc7 None admin] PATH_INFO: `/v3/users/95f62489b6524cfebb2e1ac4f859c2c9` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:26.156768 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15a88a-3d9a-418a-8ea1-31666b699cc7 None admin] RBAC: Authorizing `identity:get_user(user_id=95f62489b6524cfebb2e1ac4f859c2c9)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:26.158207 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15a88a-3d9a-418a-8ea1-31666b699cc7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:26.160011 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 423/853] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:21:26 2022] GET /identity/v3/users/95f62489b6524cfebb2e1ac4f859c2c9 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:26.165870 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76882f12-866b-432c-ad4a-2daa7ba8d44e None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:26.181641 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:26.262702 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76882f12-866b-432c-ad4a-2daa7ba8d44e None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:26.295392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5aefb-966e-4614-a8cf-269c1315fb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:26.295988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5aefb-966e-4614-a8cf-269c1315fb85 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:26.296268 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5aefb-966e-4614-a8cf-269c1315fb85 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:26.296538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5aefb-966e-4614-a8cf-269c1315fb85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:26.359827 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5aefb-966e-4614-a8cf-269c1315fb85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:26.361280 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5aefb-966e-4614-a8cf-269c1315fb85 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:26.375300 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:26.455971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 431/854] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:21:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 12:21:26.461694 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15a88a-3d9a-418a-8ea1-31666b699cc7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:26.551220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:26.557617 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15a88a-3d9a-418a-8ea1-31666b699cc7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:26.590430 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc19783-42fb-409a-8992-1455b55a3f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:26.591042 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc19783-42fb-409a-8992-1455b55a3f48 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:26.591321 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc19783-42fb-409a-8992-1455b55a3f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:26.591592 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc19783-42fb-409a-8992-1455b55a3f48 None admin] PATH_INFO: `/v3/projects/95d6b664484b4e5d8d3764ebd0628eca` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:26.592692 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc19783-42fb-409a-8992-1455b55a3f48 None admin] RBAC: Authorizing `identity:get_project(project_id=95d6b664484b4e5d8d3764ebd0628eca)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:26.594110 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc19783-42fb-409a-8992-1455b55a3f48 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:26.595709 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 424/855] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:21:26 2022] GET /identity/v3/projects/95d6b664484b4e5d8d3764ebd0628eca => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:26.602389 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5aefb-966e-4614-a8cf-269c1315fb85 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:26.812325 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5aefb-966e-4614-a8cf-269c1315fb85 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:26.825093 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:26.845244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2d43e-0241-40a8-916a-d23e9a67d28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:26.845834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2d43e-0241-40a8-916a-d23e9a67d28b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:26.846111 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2d43e-0241-40a8-916a-d23e9a67d28b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:26.846379 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2d43e-0241-40a8-916a-d23e9a67d28b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:26.847091 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2d43e-0241-40a8-916a-d23e9a67d28b None admin] RBAC: Adding query filter params (role.id=209186498dcb49a693401b009f73812e, scope.project.id=95d6b664484b4e5d8d3764ebd0628eca, user.id=95f62489b6524cfebb2e1ac4f859c2c9) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:26.847393 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2d43e-0241-40a8-916a-d23e9a67d28b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:26.849432 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2d43e-0241-40a8-916a-d23e9a67d28b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:26.855100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 432/856] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:21:26 2022] GET /identity/v3/role_assignments?user.id=95f62489b6524cfebb2e1ac4f859c2c9&scope.project.id=95d6b664484b4e5d8d3764ebd0628eca&role.id=209186498dcb49a693401b009f73812e => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:28.955849 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9b069-0a1b-4c7b-a779-f8e490e0f929 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:28.956383 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9b069-0a1b-4c7b-a779-f8e490e0f929 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:28.956383 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9b069-0a1b-4c7b-a779-f8e490e0f929 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:28.957738 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 425/857] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:28.963102 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88d40d-0bc0-418b-afd8-2ad182125800 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:28.963500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88d40d-0bc0-418b-afd8-2ad182125800 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:28.963649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88d40d-0bc0-418b-afd8-2ad182125800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:28.981225 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-5a88d40d-0bc0-418b-afd8-2ad182125800 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:28.982397 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5a88d40d-0bc0-418b-afd8-2ad182125800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:29.046610 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 433/858] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:21:29.315036 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9b069-0a1b-4c7b-a779-f8e490e0f929 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:29.526257 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9b069-0a1b-4c7b-a779-f8e490e0f929 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:29.559048 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177a010-cb98-46c0-95e8-eed2c861caff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:29.559657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177a010-cb98-46c0-95e8-eed2c861caff None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:29.559936 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177a010-cb98-46c0-95e8-eed2c861caff None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:29.560215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177a010-cb98-46c0-95e8-eed2c861caff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:29.561330 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177a010-cb98-46c0-95e8-eed2c861caff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:29.562724 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177a010-cb98-46c0-95e8-eed2c861caff None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:29.564262 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 426/859] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:21:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:29.570296 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88d40d-0bc0-418b-afd8-2ad182125800 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:29.664599 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88d40d-0bc0-418b-afd8-2ad182125800 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:29.673331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:29.696985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c2910-4b87-475d-b36e-1e69e203dec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:29.697603 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c2910-4b87-475d-b36e-1e69e203dec9 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:29.697878 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c2910-4b87-475d-b36e-1e69e203dec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:29.698145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c2910-4b87-475d-b36e-1e69e203dec9 None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:29.698777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c2910-4b87-475d-b36e-1e69e203dec9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:29.700170 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c2910-4b87-475d-b36e-1e69e203dec9 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:29.725990 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 434/860] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 31 12:21:29 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:21:31.867470 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dc05d-26d1-4945-af4c-92999351bd73 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:31.868022 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dc05d-26d1-4945-af4c-92999351bd73 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:31.868022 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dc05d-26d1-4945-af4c-92999351bd73 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:31.869364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 427/861] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:31.874494 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d0090-15c8-4862-a058-cf824a26131c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:31.874913 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d0090-15c8-4862-a058-cf824a26131c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:31.875056 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d0090-15c8-4862-a058-cf824a26131c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:31.893455 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d13d0090-15c8-4862-a058-cf824a26131c None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:31.894651 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d13d0090-15c8-4862-a058-cf824a26131c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:31.958497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 435/862] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:21:32.228254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7dc05d-26d1-4945-af4c-92999351bd73 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:32.258078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:32.325333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7dc05d-26d1-4945-af4c-92999351bd73 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:32.357070 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09a6c7-2123-433c-8e3f-0d02ac4ce23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:32.357704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09a6c7-2123-433c-8e3f-0d02ac4ce23f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:32.357979 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09a6c7-2123-433c-8e3f-0d02ac4ce23f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:32.358245 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09a6c7-2123-433c-8e3f-0d02ac4ce23f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:32.359345 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09a6c7-2123-433c-8e3f-0d02ac4ce23f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:32.360740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09a6c7-2123-433c-8e3f-0d02ac4ce23f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:32.362278 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 428/863] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:21:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:32.368498 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d0090-15c8-4862-a058-cf824a26131c None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:32.453174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:32.464133 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d0090-15c8-4862-a058-cf824a26131c None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:32.497339 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdf4f3-dfd0-4b35-9c46-8247c62c2f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:32.497874 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdf4f3-dfd0-4b35-9c46-8247c62c2f04 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:32.498149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdf4f3-dfd0-4b35-9c46-8247c62c2f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:32.498420 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdf4f3-dfd0-4b35-9c46-8247c62c2f04 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:32.499066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdf4f3-dfd0-4b35-9c46-8247c62c2f04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:32.500459 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdf4f3-dfd0-4b35-9c46-8247c62c2f04 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:32.520579 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 436/864] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 31 12:21:32 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:21:34.663199 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485b0eb-b14a-4aa6-b428-0ddee73bf77c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:34.663761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485b0eb-b14a-4aa6-b428-0ddee73bf77c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:34.663761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485b0eb-b14a-4aa6-b428-0ddee73bf77c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:34.665089 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 429/865] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:34.670286 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91294c-f83e-4fcb-85e8-a81bcb81087d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:34.670679 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91294c-f83e-4fcb-85e8-a81bcb81087d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:34.670856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91294c-f83e-4fcb-85e8-a81bcb81087d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:34.688477 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-1e91294c-f83e-4fcb-85e8-a81bcb81087d None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:34.689687 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1e91294c-f83e-4fcb-85e8-a81bcb81087d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:34.752672 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 437/866] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:21:35.019159 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485b0eb-b14a-4aa6-b428-0ddee73bf77c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:35.112364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:35.117211 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485b0eb-b14a-4aa6-b428-0ddee73bf77c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:35.149194 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d29f9-f54c-4310-af74-e64fd0fd7c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:35.149808 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d29f9-f54c-4310-af74-e64fd0fd7c66 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:35.150085 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d29f9-f54c-4310-af74-e64fd0fd7c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:35.150354 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d29f9-f54c-4310-af74-e64fd0fd7c66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:35.160196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d29f9-f54c-4310-af74-e64fd0fd7c66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:21:35.164965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-b44d29f9-f54c-4310-af74-e64fd0fd7c66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:21:35.164965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:35.164965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:35.164965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:35.164965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:35.164965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:35.164965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:35.164965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:35.164965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:35.164965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:35.164965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:35.164965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:35.164965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:21:35.164965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:21:35.164965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:21:35.164965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:21:35.166155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:21:35.166155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:21:35.166155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:21:35.166155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:21:35.166155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:35.166155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:35.166155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:35.166155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:35.166155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:35.166155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:35.166155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:35.166155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:35.166155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:35.166155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:35.166155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:35.166155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:35.167261 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:35.167261 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:35.167261 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:35.167261 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:35.167261 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:21:35.167261 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:21:35.167261 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:21:35.167261 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:21:35.167261 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:21:35.167261 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:21:35.167261 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:21:35.167261 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:21:35.167261 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 430/867] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 31 12:21:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:21:35.172092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91294c-f83e-4fcb-85e8-a81bcb81087d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:35.246580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:35.268875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91294c-f83e-4fcb-85e8-a81bcb81087d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:35.302120 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641cfe68-fd80-4fed-8d6a-0b3886ee6e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:35.302650 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641cfe68-fd80-4fed-8d6a-0b3886ee6e4d None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:35.302927 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641cfe68-fd80-4fed-8d6a-0b3886ee6e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:35.303197 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641cfe68-fd80-4fed-8d6a-0b3886ee6e4d None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:35.303850 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641cfe68-fd80-4fed-8d6a-0b3886ee6e4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:35.304147 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641cfe68-fd80-4fed-8d6a-0b3886ee6e4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:35.305521 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641cfe68-fd80-4fed-8d6a-0b3886ee6e4d None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:35.313182 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 438/868] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:21:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:35.319372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d29f9-f54c-4310-af74-e64fd0fd7c66 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:35.413494 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d29f9-f54c-4310-af74-e64fd0fd7c66 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:35.445648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e4787-c287-4a4f-bec4-7ed5bb0b8ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:35.446254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e4787-c287-4a4f-bec4-7ed5bb0b8ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:35.446530 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e4787-c287-4a4f-bec4-7ed5bb0b8ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:35.446798 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e4787-c287-4a4f-bec4-7ed5bb0b8ec9 None admin] PATH_INFO: `/v3/users/b5b78e459b3541ec8947ae3bd1c6612a` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:35.459074 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e4787-c287-4a4f-bec4-7ed5bb0b8ec9 None admin] RBAC: Authorizing `identity:get_user(user_id=b5b78e459b3541ec8947ae3bd1c6612a)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:35.460480 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e4787-c287-4a4f-bec4-7ed5bb0b8ec9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:35.462064 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 431/869] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:21:35 2022] GET /identity/v3/users/b5b78e459b3541ec8947ae3bd1c6612a => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:35.467597 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641cfe68-fd80-4fed-8d6a-0b3886ee6e4d None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:35.564505 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641cfe68-fd80-4fed-8d6a-0b3886ee6e4d None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:35.596997 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c9b19-ee89-41f5-b206-e5a6c6102531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:35.597630 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c9b19-ee89-41f5-b206-e5a6c6102531 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:35.597929 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c9b19-ee89-41f5-b206-e5a6c6102531 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:35.598787 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c9b19-ee89-41f5-b206-e5a6c6102531 None admin] PATH_INFO: `/v3/projects/1614834bf65546409ea18ded66efd5c6` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:35.599895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c9b19-ee89-41f5-b206-e5a6c6102531 None admin] RBAC: Authorizing `identity:get_project(project_id=1614834bf65546409ea18ded66efd5c6)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:35.601322 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c9b19-ee89-41f5-b206-e5a6c6102531 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:35.602880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 439/870] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:21:35 2022] GET /identity/v3/projects/1614834bf65546409ea18ded66efd5c6 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:35.608526 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e4787-c287-4a4f-bec4-7ed5bb0b8ec9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:35.626316 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:35.703303 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e4787-c287-4a4f-bec4-7ed5bb0b8ec9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:35.736493 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf201802-7bdb-47c0-8c99-0ad54beef135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:35.737148 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf201802-7bdb-47c0-8c99-0ad54beef135 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:35.737433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf201802-7bdb-47c0-8c99-0ad54beef135 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:35.737707 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf201802-7bdb-47c0-8c99-0ad54beef135 None admin] PATH_INFO: `/v3/projects/1614834bf65546409ea18ded66efd5c6/users/b5b78e459b3541ec8947ae3bd1c6612a/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:35.739594 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf201802-7bdb-47c0-8c99-0ad54beef135 None admin] RBAC: Authorizing `identity:create_grant(project_id=1614834bf65546409ea18ded66efd5c6, user_id=b5b78e459b3541ec8947ae3bd1c6612a, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:35.741001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf201802-7bdb-47c0-8c99-0ad54beef135 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:35.752856 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 432/871] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:21:35 2022] PUT /identity/v3/projects/1614834bf65546409ea18ded66efd5c6/users/b5b78e459b3541ec8947ae3bd1c6612a/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:21:37.847232 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598bd77-1504-413f-8b26-20b181acb2c8 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:37.847764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598bd77-1504-413f-8b26-20b181acb2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:37.847764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598bd77-1504-413f-8b26-20b181acb2c8 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:37.849161 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 440/872] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:37.854288 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf330f1-4849-42c5-8a0e-2a1f8d26ed80 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:37.854686 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf330f1-4849-42c5-8a0e-2a1f8d26ed80 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:37.854833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf330f1-4849-42c5-8a0e-2a1f8d26ed80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:37.872740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-acf330f1-4849-42c5-8a0e-2a1f8d26ed80 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:37.873942 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-acf330f1-4849-42c5-8a0e-2a1f8d26ed80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:37.936312 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 433/873] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 12:21:38.201097 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598bd77-1504-413f-8b26-20b181acb2c8 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:38.210294 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:38.298413 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598bd77-1504-413f-8b26-20b181acb2c8 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:38.329880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30c1e2-4e93-4153-a86b-f186c3c9eb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:38.330486 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30c1e2-4e93-4153-a86b-f186c3c9eb60 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:38.330760 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30c1e2-4e93-4153-a86b-f186c3c9eb60 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:38.331031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30c1e2-4e93-4153-a86b-f186c3c9eb60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:38.340983 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30c1e2-4e93-4153-a86b-f186c3c9eb60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:21:38.345661 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-6e30c1e2-4e93-4153-a86b-f186c3c9eb60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:21:38.345661 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:38.345661 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:38.345661 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:38.345661 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:38.345661 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:38.345661 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:38.345661 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:38.345661 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:38.345661 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:38.345661 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:38.345661 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:38.345661 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:21:38.345661 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:21:38.345661 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:21:38.345661 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:21:38.346736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:21:38.346736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:21:38.346736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:21:38.346736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:21:38.346736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:38.346736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:38.346736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:38.346736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:38.346736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:38.346736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:38.346736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:38.346736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:38.346736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:38.346736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:38.346736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:38.346736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:38.347775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:38.347775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:38.347775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:38.347775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:38.347775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:21:38.347775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:21:38.347775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:21:38.347775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:21:38.347775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:21:38.347775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:21:38.347775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:21:38.347775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:38.347775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 441/874] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 31 12:21:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:21:38.353222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf330f1-4849-42c5-8a0e-2a1f8d26ed80 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:38.362985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:38.447818 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf330f1-4849-42c5-8a0e-2a1f8d26ed80 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:38.480452 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67d483-a7ec-4036-b02c-fabbeedc647a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:38.480988 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67d483-a7ec-4036-b02c-fabbeedc647a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:38.481294 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67d483-a7ec-4036-b02c-fabbeedc647a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:38.481563 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67d483-a7ec-4036-b02c-fabbeedc647a None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:38.482218 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67d483-a7ec-4036-b02c-fabbeedc647a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:38.482524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67d483-a7ec-4036-b02c-fabbeedc647a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:38.483868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67d483-a7ec-4036-b02c-fabbeedc647a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:38.492059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 434/875] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:21:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:38.497814 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30c1e2-4e93-4153-a86b-f186c3c9eb60 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:38.560655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:38.594330 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30c1e2-4e93-4153-a86b-f186c3c9eb60 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:38.626152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1988601-8d5a-4cc3-a0e1-778a027e07be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:38.626758 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1988601-8d5a-4cc3-a0e1-778a027e07be None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:38.627036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1988601-8d5a-4cc3-a0e1-778a027e07be None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:38.627307 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1988601-8d5a-4cc3-a0e1-778a027e07be None admin] PATH_INFO: `/v3/users/b5b78e459b3541ec8947ae3bd1c6612a` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:38.628396 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1988601-8d5a-4cc3-a0e1-778a027e07be None admin] RBAC: Authorizing `identity:get_user(user_id=b5b78e459b3541ec8947ae3bd1c6612a)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:38.629848 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1988601-8d5a-4cc3-a0e1-778a027e07be None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:38.631375 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 442/876] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:21:38 2022] GET /identity/v3/users/b5b78e459b3541ec8947ae3bd1c6612a => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:38.637237 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67d483-a7ec-4036-b02c-fabbeedc647a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:38.703127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:38.733522 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67d483-a7ec-4036-b02c-fabbeedc647a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:38.764526 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a9fc8-3f14-4928-a524-a2f49423779e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:38.765128 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a9fc8-3f14-4928-a524-a2f49423779e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:38.765421 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a9fc8-3f14-4928-a524-a2f49423779e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:38.765689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a9fc8-3f14-4928-a524-a2f49423779e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:38.829210 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a9fc8-3f14-4928-a524-a2f49423779e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:38.830613 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a9fc8-3f14-4928-a524-a2f49423779e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:38.893551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:38.924931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 435/877] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:21:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 12:21:38.930678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1988601-8d5a-4cc3-a0e1-778a027e07be None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:39.027761 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1988601-8d5a-4cc3-a0e1-778a027e07be None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:39.059255 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180bfb0-47cd-4979-916f-b2318a814b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:39.059863 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180bfb0-47cd-4979-916f-b2318a814b5c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:39.060146 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180bfb0-47cd-4979-916f-b2318a814b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:39.060417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180bfb0-47cd-4979-916f-b2318a814b5c None admin] PATH_INFO: `/v3/projects/1614834bf65546409ea18ded66efd5c6` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:39.061557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180bfb0-47cd-4979-916f-b2318a814b5c None admin] RBAC: Authorizing `identity:get_project(project_id=1614834bf65546409ea18ded66efd5c6)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:39.062974 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180bfb0-47cd-4979-916f-b2318a814b5c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:39.064579 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 443/878] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:21:38 2022] GET /identity/v3/projects/1614834bf65546409ea18ded66efd5c6 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:39.071077 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a9fc8-3f14-4928-a524-a2f49423779e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:39.164219 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a9fc8-3f14-4928-a524-a2f49423779e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:39.195980 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e9266-807b-4002-8e2f-a4c466e96508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:39.196565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e9266-807b-4002-8e2f-a4c466e96508 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:39.196845 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e9266-807b-4002-8e2f-a4c466e96508 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:39.197143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e9266-807b-4002-8e2f-a4c466e96508 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:39.197855 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e9266-807b-4002-8e2f-a4c466e96508 None admin] RBAC: Adding query filter params (role.id=e1b3a811029244d2a7e2664cd3246eec, scope.project.id=1614834bf65546409ea18ded66efd5c6, user.id=b5b78e459b3541ec8947ae3bd1c6612a) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:39.198161 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e9266-807b-4002-8e2f-a4c466e96508 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:39.199559 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e9266-807b-4002-8e2f-a4c466e96508 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:39.204993 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 436/879] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:21:39 2022] GET /identity/v3/role_assignments?user.id=b5b78e459b3541ec8947ae3bd1c6612a&scope.project.id=1614834bf65546409ea18ded66efd5c6&role.id=e1b3a811029244d2a7e2664cd3246eec => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:41.336755 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2853-6486-41be-8226-11b59bf8c3bf None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:41.337297 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2853-6486-41be-8226-11b59bf8c3bf None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:41.337297 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2853-6486-41be-8226-11b59bf8c3bf None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:41.338604 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 444/880] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:41.343829 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761de0e-8187-4a2f-87f8-14f8751f77e7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:41.344248 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761de0e-8187-4a2f-87f8-14f8751f77e7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:41.344379 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761de0e-8187-4a2f-87f8-14f8751f77e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:41.363086 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e761de0e-8187-4a2f-87f8-14f8751f77e7 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:41.364876 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e761de0e-8187-4a2f-87f8-14f8751f77e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:41.389642 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:41.428304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 437/881] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 12:21:41.695731 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff2853-6486-41be-8226-11b59bf8c3bf None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:41.698657 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:41.797070 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff2853-6486-41be-8226-11b59bf8c3bf None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:41.828654 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee418f-5f79-4030-80a6-3ca6f266792d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:41.829268 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee418f-5f79-4030-80a6-3ca6f266792d None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:41.829547 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee418f-5f79-4030-80a6-3ca6f266792d None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:41.829818 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee418f-5f79-4030-80a6-3ca6f266792d None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:41.830473 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee418f-5f79-4030-80a6-3ca6f266792d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:41.831811 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee418f-5f79-4030-80a6-3ca6f266792d None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:41.847123 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 445/882] 10.222.0.18 () {60 vars in 1138 bytes} [Mon Oct 31 12:21:41 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:21:43.992393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66137fb-0682-41ba-adab-c7645eb669dd None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:43.993028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66137fb-0682-41ba-adab-c7645eb669dd None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:43.993028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66137fb-0682-41ba-adab-c7645eb669dd None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:43.994308 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 438/883] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:43.999938 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae455c-4551-4c28-9ea9-50e4ba9f9f9f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:44.000382 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae455c-4551-4c28-9ea9-50e4ba9f9f9f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:44.000483 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae455c-4551-4c28-9ea9-50e4ba9f9f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:44.018047 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-26ae455c-4551-4c28-9ea9-50e4ba9f9f9f None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:44.019216 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-26ae455c-4551-4c28-9ea9-50e4ba9f9f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:44.074218 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:44.085313 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 446/884] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:21:44.353905 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66137fb-0682-41ba-adab-c7645eb669dd None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:44.449645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66137fb-0682-41ba-adab-c7645eb669dd None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:44.481322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b90eb-f8a9-493f-afb9-b79230b2faf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:44.481928 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b90eb-f8a9-493f-afb9-b79230b2faf7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:44.482207 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b90eb-f8a9-493f-afb9-b79230b2faf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:44.482477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b90eb-f8a9-493f-afb9-b79230b2faf7 None admin] PATH_INFO: `/v3/domains/9eddcc75a8a048aa9e7aea3b5a0988d3` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:44.492869 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b90eb-f8a9-493f-afb9-b79230b2faf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9eddcc75a8a048aa9e7aea3b5a0988d3)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:44.494317 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b90eb-f8a9-493f-afb9-b79230b2faf7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:44.495840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 439/885] 10.222.0.18 () {56 vars in 1183 bytes} [Mon Oct 31 12:21:44 2022] GET /identity/v3/domains/9eddcc75a8a048aa9e7aea3b5a0988d3 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:44.501383 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae455c-4551-4c28-9ea9-50e4ba9f9f9f None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:44.594540 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae455c-4551-4c28-9ea9-50e4ba9f9f9f None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:44.626857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb12688-776d-4542-8722-117fa3ad2afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:44.627390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb12688-776d-4542-8722-117fa3ad2afd None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:44.627665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb12688-776d-4542-8722-117fa3ad2afd None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:44.627930 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb12688-776d-4542-8722-117fa3ad2afd None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:44.628570 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb12688-776d-4542-8722-117fa3ad2afd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:44.630028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb12688-776d-4542-8722-117fa3ad2afd None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:44.655671 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 447/886] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 31 12:21:44 2022] POST /identity/v3/projects => generated 361 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:21:46.799703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a479480-ed52-479f-bd3d-66e0c0d55659 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:46.800239 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a479480-ed52-479f-bd3d-66e0c0d55659 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:46.800239 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a479480-ed52-479f-bd3d-66e0c0d55659 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:46.802103 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 440/887] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:46.807239 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5787e-64b7-42ae-9a45-78ec0ac38460 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:46.807667 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5787e-64b7-42ae-9a45-78ec0ac38460 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:46.807766 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5787e-64b7-42ae-9a45-78ec0ac38460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:46.826030 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-eca5787e-64b7-42ae-9a45-78ec0ac38460 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:46.827189 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-eca5787e-64b7-42ae-9a45-78ec0ac38460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:46.864611 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:46.892266 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 448/888] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:21:47.156643 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a479480-ed52-479f-bd3d-66e0c0d55659 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:47.181927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:47.252786 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a479480-ed52-479f-bd3d-66e0c0d55659 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:47.285089 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95ec22-2150-434f-b4ac-0c724a85edba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:47.285725 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95ec22-2150-434f-b4ac-0c724a85edba None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:47.286003 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95ec22-2150-434f-b4ac-0c724a85edba None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:47.286270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95ec22-2150-434f-b4ac-0c724a85edba None admin] PATH_INFO: `/v3/domains/9eddcc75a8a048aa9e7aea3b5a0988d3` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:47.287391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95ec22-2150-434f-b4ac-0c724a85edba None admin] RBAC: Authorizing `identity:get_domain(domain_id=9eddcc75a8a048aa9e7aea3b5a0988d3)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:47.288824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95ec22-2150-434f-b4ac-0c724a85edba None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:47.290391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 441/889] 10.222.0.18 () {56 vars in 1183 bytes} [Mon Oct 31 12:21:47 2022] GET /identity/v3/domains/9eddcc75a8a048aa9e7aea3b5a0988d3 => generated 267 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:47.295968 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5787e-64b7-42ae-9a45-78ec0ac38460 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:47.389390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5787e-64b7-42ae-9a45-78ec0ac38460 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:47.421698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7a5b4-0988-4939-9858-20c2754c59b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:47.422283 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7a5b4-0988-4939-9858-20c2754c59b8 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:47.422556 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7a5b4-0988-4939-9858-20c2754c59b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:47.422822 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7a5b4-0988-4939-9858-20c2754c59b8 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:47.423462 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7a5b4-0988-4939-9858-20c2754c59b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:47.425140 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7a5b4-0988-4939-9858-20c2754c59b8 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:47.445443 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 449/890] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 31 12:21:47 2022] POST /identity/v3/users => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:21:49.588029 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a74e5c-6342-4384-8baf-5d76187f90f7 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:49.588591 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a74e5c-6342-4384-8baf-5d76187f90f7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:49.588591 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a74e5c-6342-4384-8baf-5d76187f90f7 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:49.590040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 442/891] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:49.595318 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb4153-5105-4d64-bfb9-aaa36c591789 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:49.595717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb4153-5105-4d64-bfb9-aaa36c591789 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:49.595870 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb4153-5105-4d64-bfb9-aaa36c591789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:49.614656 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-7adb4153-5105-4d64-bfb9-aaa36c591789 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:49.615834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7adb4153-5105-4d64-bfb9-aaa36c591789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:49.638272 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:49.680976 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 450/892] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:21:49.951291 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a74e5c-6342-4384-8baf-5d76187f90f7 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:50.039195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:50.048717 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a74e5c-6342-4384-8baf-5d76187f90f7 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:50.079997 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f2eff-a9a2-4ebd-8232-f4961dad11bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:50.080609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f2eff-a9a2-4ebd-8232-f4961dad11bb None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:50.080886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f2eff-a9a2-4ebd-8232-f4961dad11bb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:50.081187 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f2eff-a9a2-4ebd-8232-f4961dad11bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:50.091923 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f2eff-a9a2-4ebd-8232-f4961dad11bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:21:50.096641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-118f2eff-a9a2-4ebd-8232-f4961dad11bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:21:50.096641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:50.096641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:50.096641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:50.096641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:50.096641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:50.096641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:50.096641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:50.096641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:50.096641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:50.096641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:50.096641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:50.096641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:21:50.096641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:21:50.096641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:21:50.096641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:21:50.098778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:21:50.098778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:21:50.098778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:21:50.098778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:21:50.098778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:50.098778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:50.098778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:50.098778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:50.098778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:50.098778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:50.098778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:50.098778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:50.098778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:50.098778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:50.098778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:50.098778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:50.100503 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:50.100503 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:50.100503 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:50.100503 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:50.100503 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:21:50.100503 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:21:50.100503 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:21:50.100503 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:21:50.100503 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:21:50.100503 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:21:50.100503 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:21:50.100503 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:21:50.100503 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 443/893] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 31 12:21:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:21:50.104436 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb4153-5105-4d64-bfb9-aaa36c591789 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:50.198308 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb4153-5105-4d64-bfb9-aaa36c591789 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:50.230891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc07c5c-423d-4c3b-b703-b87a95892654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:50.231417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc07c5c-423d-4c3b-b703-b87a95892654 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:50.231689 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc07c5c-423d-4c3b-b703-b87a95892654 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:50.231957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc07c5c-423d-4c3b-b703-b87a95892654 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:50.232609 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc07c5c-423d-4c3b-b703-b87a95892654 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:50.232904 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc07c5c-423d-4c3b-b703-b87a95892654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:50.234274 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc07c5c-423d-4c3b-b703-b87a95892654 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:50.241854 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 451/894] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:21:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:50.247564 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f2eff-a9a2-4ebd-8232-f4961dad11bb None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:50.342149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f2eff-a9a2-4ebd-8232-f4961dad11bb None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:50.373213 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e064d-345f-4968-81e3-545bdcad879e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:50.373815 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e064d-345f-4968-81e3-545bdcad879e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:50.374091 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e064d-345f-4968-81e3-545bdcad879e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:50.374361 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e064d-345f-4968-81e3-545bdcad879e None admin] PATH_INFO: `/v3/users/ed42d1d358224f2884ba6cdd52e6ac72` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:50.387171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e064d-345f-4968-81e3-545bdcad879e None admin] RBAC: Authorizing `identity:get_user(user_id=ed42d1d358224f2884ba6cdd52e6ac72)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:50.388572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e064d-345f-4968-81e3-545bdcad879e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:50.390136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 444/895] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:21:50 2022] GET /identity/v3/users/ed42d1d358224f2884ba6cdd52e6ac72 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:50.396191 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc07c5c-423d-4c3b-b703-b87a95892654 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:50.420068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:50.491535 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc07c5c-423d-4c3b-b703-b87a95892654 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:50.523766 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acd79b-010e-48a8-b559-b6a08e6926ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:50.524366 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acd79b-010e-48a8-b559-b6a08e6926ca None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:50.524638 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acd79b-010e-48a8-b559-b6a08e6926ca None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:50.524905 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acd79b-010e-48a8-b559-b6a08e6926ca None admin] PATH_INFO: `/v3/projects/ee94cf4f9f084e1a959a497916bac7fb` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:50.526011 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acd79b-010e-48a8-b559-b6a08e6926ca None admin] RBAC: Authorizing `identity:get_project(project_id=ee94cf4f9f084e1a959a497916bac7fb)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:50.527396 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acd79b-010e-48a8-b559-b6a08e6926ca None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:50.528952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 452/896] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:21:50 2022] GET /identity/v3/projects/ee94cf4f9f084e1a959a497916bac7fb => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:50.534924 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e064d-345f-4968-81e3-545bdcad879e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:50.546744 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:50.631726 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e064d-345f-4968-81e3-545bdcad879e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:50.663318 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecbe55-d3ad-4ca4-9e02-1a8870a8ecf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:50.663952 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecbe55-d3ad-4ca4-9e02-1a8870a8ecf5 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:50.664231 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecbe55-d3ad-4ca4-9e02-1a8870a8ecf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:50.664505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecbe55-d3ad-4ca4-9e02-1a8870a8ecf5 None admin] PATH_INFO: `/v3/projects/ee94cf4f9f084e1a959a497916bac7fb/users/ed42d1d358224f2884ba6cdd52e6ac72/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:50.666390 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ecbe55-d3ad-4ca4-9e02-1a8870a8ecf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee94cf4f9f084e1a959a497916bac7fb, user_id=ed42d1d358224f2884ba6cdd52e6ac72, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:50.667793 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ecbe55-d3ad-4ca4-9e02-1a8870a8ecf5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:50.680067 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 445/897] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:21:50 2022] PUT /identity/v3/projects/ee94cf4f9f084e1a959a497916bac7fb/users/ed42d1d358224f2884ba6cdd52e6ac72/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:21:52.792142 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba97762-6056-49a5-992c-7deec6875356 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:52.792708 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba97762-6056-49a5-992c-7deec6875356 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:52.792708 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba97762-6056-49a5-992c-7deec6875356 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:52.794067 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 453/898] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:21:52.799478 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48407009-902e-4632-bc3f-ae906300a3f3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:52.799858 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48407009-902e-4632-bc3f-ae906300a3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:52.800016 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48407009-902e-4632-bc3f-ae906300a3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:52.818545 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-48407009-902e-4632-bc3f-ae906300a3f3 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:21:52.819707 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-48407009-902e-4632-bc3f-ae906300a3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:21:52.879113 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:52.883864 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 446/899] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:21:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:21:53.149159 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba97762-6056-49a5-992c-7deec6875356 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:53.236287 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:53.247282 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba97762-6056-49a5-992c-7deec6875356 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:53.278349 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd71a1-b6aa-4be7-a2c3-0adbaa80564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:53.278948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd71a1-b6aa-4be7-a2c3-0adbaa80564b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:53.279228 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd71a1-b6aa-4be7-a2c3-0adbaa80564b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:53.279493 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd71a1-b6aa-4be7-a2c3-0adbaa80564b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:53.290206 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd71a1-b6aa-4be7-a2c3-0adbaa80564b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:21:53.294857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-1abd71a1-b6aa-4be7-a2c3-0adbaa80564b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:21:53.294857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:21:53.294857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:21:53.294857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:21:53.294857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:21:53.294857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:21:53.294857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:21:53.294857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:21:53.294857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:21:53.294857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:21:53.294857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:21:53.294857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:21:53.294857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:21:53.294857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:21:53.294857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:21:53.294857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:21:53.295965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:21:53.295965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:21:53.295965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:21:53.295965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:21:53.295965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:21:53.295965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:21:53.295965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:21:53.295965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:21:53.295965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:21:53.295965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:21:53.295965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:21:53.295965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:21:53.295965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:21:53.295965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:21:53.295965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:21:53.295965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:21:53.296843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:21:53.296843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:21:53.296843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:21:53.296843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:21:53.296843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:21:53.296843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:21:53.296843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:21:53.296843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:21:53.296843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:21:53.296843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:21:53.296843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:21:53.296843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:21:53.296843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 454/900] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 31 12:21:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:21:53.302384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48407009-902e-4632-bc3f-ae906300a3f3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:53.395449 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48407009-902e-4632-bc3f-ae906300a3f3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:53.428257 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccbe17-2dc6-4a1c-a60b-3069307ea383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:53.428844 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccbe17-2dc6-4a1c-a60b-3069307ea383 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:53.429144 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccbe17-2dc6-4a1c-a60b-3069307ea383 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:53.429422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccbe17-2dc6-4a1c-a60b-3069307ea383 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:53.430081 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bccbe17-2dc6-4a1c-a60b-3069307ea383 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:53.430382 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bccbe17-2dc6-4a1c-a60b-3069307ea383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:53.431734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bccbe17-2dc6-4a1c-a60b-3069307ea383 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:53.439349 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 447/901] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:21:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:53.444929 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd71a1-b6aa-4be7-a2c3-0adbaa80564b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:53.539940 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd71a1-b6aa-4be7-a2c3-0adbaa80564b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:53.572401 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d129f-5a34-4ba3-bfa1-223f86ee48a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:53.573005 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d129f-5a34-4ba3-bfa1-223f86ee48a5 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:53.573311 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d129f-5a34-4ba3-bfa1-223f86ee48a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:53.573580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d129f-5a34-4ba3-bfa1-223f86ee48a5 None admin] PATH_INFO: `/v3/users/ed42d1d358224f2884ba6cdd52e6ac72` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:53.574664 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d129f-5a34-4ba3-bfa1-223f86ee48a5 None admin] RBAC: Authorizing `identity:get_user(user_id=ed42d1d358224f2884ba6cdd52e6ac72)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:53.576062 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d129f-5a34-4ba3-bfa1-223f86ee48a5 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:53.577619 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 455/902] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Oct 31 12:21:53 2022] GET /identity/v3/users/ed42d1d358224f2884ba6cdd52e6ac72 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:53.583838 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccbe17-2dc6-4a1c-a60b-3069307ea383 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:53.642223 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:53.680472 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccbe17-2dc6-4a1c-a60b-3069307ea383 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:53.712108 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bad45-fe55-40ce-8ded-fbb652295a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:53.712696 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bad45-fe55-40ce-8ded-fbb652295a0e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:53.712978 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bad45-fe55-40ce-8ded-fbb652295a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:53.713277 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bad45-fe55-40ce-8ded-fbb652295a0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:53.776449 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bad45-fe55-40ce-8ded-fbb652295a0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:53.777882 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bad45-fe55-40ce-8ded-fbb652295a0e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:53.834058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:53.871580 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 448/903] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:21:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 12:21:53.877320 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d129f-5a34-4ba3-bfa1-223f86ee48a5 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:53.896615 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:21:53.975130 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d129f-5a34-4ba3-bfa1-223f86ee48a5 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:54.007053 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55452a9a-d597-4b23-a5e6-1d55822f0ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:54.007653 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55452a9a-d597-4b23-a5e6-1d55822f0ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:54.007931 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55452a9a-d597-4b23-a5e6-1d55822f0ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:54.008200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55452a9a-d597-4b23-a5e6-1d55822f0ba5 None admin] PATH_INFO: `/v3/projects/ee94cf4f9f084e1a959a497916bac7fb` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:54.009344 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55452a9a-d597-4b23-a5e6-1d55822f0ba5 None admin] RBAC: Authorizing `identity:get_project(project_id=ee94cf4f9f084e1a959a497916bac7fb)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:54.010755 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55452a9a-d597-4b23-a5e6-1d55822f0ba5 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:54.012332 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 456/904] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Oct 31 12:21:53 2022] GET /identity/v3/projects/ee94cf4f9f084e1a959a497916bac7fb => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:21:54.018265 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bad45-fe55-40ce-8ded-fbb652295a0e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:21:54.115518 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bad45-fe55-40ce-8ded-fbb652295a0e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:21:54.149490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bd556-db3a-4d8a-9c9c-043bc5204f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:21:54.150120 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bd556-db3a-4d8a-9c9c-043bc5204f3c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:21:54.150441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bd556-db3a-4d8a-9c9c-043bc5204f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:21:54.150744 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bd556-db3a-4d8a-9c9c-043bc5204f3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:21:54.151470 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bd556-db3a-4d8a-9c9c-043bc5204f3c None admin] RBAC: Adding query filter params (role.id=e1b3a811029244d2a7e2664cd3246eec, scope.project.id=ee94cf4f9f084e1a959a497916bac7fb, user.id=ed42d1d358224f2884ba6cdd52e6ac72) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:21:54.151777 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bd556-db3a-4d8a-9c9c-043bc5204f3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:21:54.153206 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bd556-db3a-4d8a-9c9c-043bc5204f3c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:21:54.158731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 449/905] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:21:54 2022] GET /identity/v3/role_assignments?user.id=ed42d1d358224f2884ba6cdd52e6ac72&scope.project.id=ee94cf4f9f084e1a959a497916bac7fb&role.id=e1b3a811029244d2a7e2664cd3246eec => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:22:04.002550 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=57 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:22:04.156179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=87 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:22:49.285011 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e31cb8-741c-4ae9-a29b-d090ded1e8f2 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:49.285654 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e31cb8-741c-4ae9-a29b-d090ded1e8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:49.285754 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e31cb8-741c-4ae9-a29b-d090ded1e8f2 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:49.287287 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 457/906] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:22:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:22:49.296954 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2a4d2-f463-4db4-b0ed-8b6992a4e5fd None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:49.296954 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2a4d2-f463-4db4-b0ed-8b6992a4e5fd None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:49.296954 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2a4d2-f463-4db4-b0ed-8b6992a4e5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:49.315367 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4ba2a4d2-f463-4db4-b0ed-8b6992a4e5fd None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:22:49.316620 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4ba2a4d2-f463-4db4-b0ed-8b6992a4e5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:22:49.402921 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 450/907] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:22:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:22:49.717370 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e31cb8-741c-4ae9-a29b-d090ded1e8f2 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:22:49.869741 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e31cb8-741c-4ae9-a29b-d090ded1e8f2 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:22:49.918698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1e226-7109-4302-918b-32f0d5784b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:22:49.919340 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1e226-7109-4302-918b-32f0d5784b50 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:49.919619 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1e226-7109-4302-918b-32f0d5784b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:49.919889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1e226-7109-4302-918b-32f0d5784b50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:49.936120 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1e226-7109-4302-918b-32f0d5784b50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:22:49.937673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1e226-7109-4302-918b-32f0d5784b50 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:22:49.953497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-adc1e226-7109-4302-918b-32f0d5784b50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:22:49.953497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:22:49.953497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:22:49.953497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:22:49.953497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:22:49.953497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:22:49.953497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:22:49.953497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:22:49.953497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:22:49.953497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:22:49.953497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:22:49.953497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:22:49.953497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:22:49.953497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:22:49.953497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:22:49.953497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:22:49.954691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:22:49.954691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:22:49.954691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:22:49.954691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:22:49.954691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:22:49.954691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:22:49.954691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:22:49.954691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:22:49.954691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:22:49.954691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:22:49.954691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:22:49.954691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:22:49.954691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:22:49.954691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:22:49.954691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:22:49.954691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:22:49.954691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:22:49.955711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:22:49.955711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:22:49.955711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:22:49.955711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 458/908] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:22:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:22:49.961879 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2a4d2-f463-4db4-b0ed-8b6992a4e5fd None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:22:50.095055 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2a4d2-f463-4db4-b0ed-8b6992a4e5fd None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:22:50.134669 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:22:50.143197 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d605a-61fc-42f7-988c-22437b7e222e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:22:50.143895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d605a-61fc-42f7-988c-22437b7e222e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:50.144188 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d605a-61fc-42f7-988c-22437b7e222e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:50.144489 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d605a-61fc-42f7-988c-22437b7e222e None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:50.145182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d605a-61fc-42f7-988c-22437b7e222e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:22:50.145971 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d605a-61fc-42f7-988c-22437b7e222e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:22:50.147889 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d605a-61fc-42f7-988c-22437b7e222e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:22:50.162077 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 451/909] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:22:50.168774 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1e226-7109-4302-918b-32f0d5784b50 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:22:50.249895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:22:50.324063 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1e226-7109-4302-918b-32f0d5784b50 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:22:50.369698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284cdc9-b30d-4b8c-9839-1ae55c8ce497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:22:50.371094 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284cdc9-b30d-4b8c-9839-1ae55c8ce497 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:50.371629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284cdc9-b30d-4b8c-9839-1ae55c8ce497 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:50.372072 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284cdc9-b30d-4b8c-9839-1ae55c8ce497 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:50.372787 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284cdc9-b30d-4b8c-9839-1ae55c8ce497 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:22:50.374600 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284cdc9-b30d-4b8c-9839-1ae55c8ce497 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:22:50.405764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 459/910] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Oct 31 12:22:50 2022] POST /identity/v3/users => generated 251 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:22:52.781495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fe095-3e1c-4c76-b9d2-d6f4c47df564 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:52.782116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fe095-3e1c-4c76-b9d2-d6f4c47df564 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:52.782116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fe095-3e1c-4c76-b9d2-d6f4c47df564 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:52.784466 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 452/911] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:22:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:22:52.790692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68fc08-14c2-40ee-8ba6-c976fbf4fa50 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:52.791184 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68fc08-14c2-40ee-8ba6-c976fbf4fa50 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:52.791349 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68fc08-14c2-40ee-8ba6-c976fbf4fa50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:52.812655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ea68fc08-14c2-40ee-8ba6-c976fbf4fa50 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:22:52.814125 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ea68fc08-14c2-40ee-8ba6-c976fbf4fa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:22:52.891000 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 460/912] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:22:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:22:53.172322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fe095-3e1c-4c76-b9d2-d6f4c47df564 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:22:53.302668 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fe095-3e1c-4c76-b9d2-d6f4c47df564 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:22:53.338156 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee1442-05bf-4a4f-a8b7-9982d81fe851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:22:53.338707 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee1442-05bf-4a4f-a8b7-9982d81fe851 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:53.339099 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee1442-05bf-4a4f-a8b7-9982d81fe851 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:53.339382 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee1442-05bf-4a4f-a8b7-9982d81fe851 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:53.350920 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee1442-05bf-4a4f-a8b7-9982d81fe851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:22:53.356437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-90ee1442-05bf-4a4f-a8b7-9982d81fe851 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:22:53.356437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:22:53.356437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:22:53.356437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:22:53.356437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:22:53.356437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:22:53.356437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:22:53.356437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:22:53.356437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:22:53.356437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:22:53.356437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:22:53.356437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:22:53.356437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:22:53.356437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:22:53.356437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:22:53.356437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:22:53.357492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:22:53.357492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:22:53.357492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:22:53.357492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:22:53.357492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:22:53.357492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:22:53.357492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:22:53.357492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:22:53.357492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:22:53.357492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:22:53.357492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:22:53.357492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:22:53.357492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:22:53.357492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:22:53.357492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:22:53.357492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:22:53.358361 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:22:53.358361 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:22:53.358361 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:22:53.358361 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:22:53.358361 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:22:53.358361 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:22:53.358361 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:22:53.358361 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:22:53.358361 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:22:53.358361 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:22:53.358361 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:22:53.358361 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:22:53.358361 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 453/913] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 31 12:22:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:22:53.363861 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68fc08-14c2-40ee-8ba6-c976fbf4fa50 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:22:53.410039 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:22:53.481443 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68fc08-14c2-40ee-8ba6-c976fbf4fa50 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:22:53.527399 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73769b-3a3c-4f60-9cc6-a5a56618b340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:22:53.528073 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73769b-3a3c-4f60-9cc6-a5a56618b340 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:53.528405 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73769b-3a3c-4f60-9cc6-a5a56618b340 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:53.528678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73769b-3a3c-4f60-9cc6-a5a56618b340 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:53.529462 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73769b-3a3c-4f60-9cc6-a5a56618b340 None admin] RBAC: Adding query filter params (name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:22:53.529808 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73769b-3a3c-4f60-9cc6-a5a56618b340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:22:53.531279 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73769b-3a3c-4f60-9cc6-a5a56618b340 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:22:53.545995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 461/914] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 31 12:22:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:22:53.547235 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee1442-05bf-4a4f-a8b7-9982d81fe851 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:22:53.613318 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:22:53.680931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee1442-05bf-4a4f-a8b7-9982d81fe851 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:22:53.715860 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8bbbb-bde5-4f7e-a044-309be91b98bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:22:53.716504 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8bbbb-bde5-4f7e-a044-309be91b98bb None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:53.716789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8bbbb-bde5-4f7e-a044-309be91b98bb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:53.717068 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8bbbb-bde5-4f7e-a044-309be91b98bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:53.737991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8bbbb-bde5-4f7e-a044-309be91b98bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:22:53.739897 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8bbbb-bde5-4f7e-a044-309be91b98bb None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:22:53.757477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-69e8bbbb-bde5-4f7e-a044-309be91b98bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:22:53.757477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:22:53.757477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:22:53.757477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:22:53.757477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:22:53.757477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:22:53.757477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:22:53.757477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:22:53.757477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:22:53.757477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:22:53.757477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:22:53.757477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:22:53.757477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:22:53.757477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:22:53.757477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:22:53.757477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:22:53.758645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:22:53.758645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:22:53.758645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:22:53.758645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:22:53.758645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:22:53.758645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:22:53.758645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:22:53.758645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:22:53.758645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:22:53.758645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:22:53.758645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:22:53.758645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:22:53.758645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:22:53.758645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:22:53.758645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:22:53.758645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:22:53.758645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:22:53.759815 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:22:53.759815 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:22:53.759815 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:22:53.765101 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73769b-3a3c-4f60-9cc6-a5a56618b340 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:22:53.765313 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 454/915] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:22:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:22:53.874468 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:22:53.878461 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73769b-3a3c-4f60-9cc6-a5a56618b340 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:22:53.918593 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1acc4-a9c9-4e07-9212-7ab57c790e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:22:53.919201 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1acc4-a9c9-4e07-9212-7ab57c790e4a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:53.919520 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1acc4-a9c9-4e07-9212-7ab57c790e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:53.919745 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1acc4-a9c9-4e07-9212-7ab57c790e4a None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:53.920386 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1acc4-a9c9-4e07-9212-7ab57c790e4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:22:53.920686 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1acc4-a9c9-4e07-9212-7ab57c790e4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:22:53.922072 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1acc4-a9c9-4e07-9212-7ab57c790e4a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:22:53.935296 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 462/916] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:22:53.941732 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8bbbb-bde5-4f7e-a044-309be91b98bb None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:22:54.054627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8bbbb-bde5-4f7e-a044-309be91b98bb None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:22:54.056530 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:22:54.093895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16f68e-69e8-42f5-a7d4-8ccf8d96a20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:22:54.094548 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16f68e-69e8-42f5-a7d4-8ccf8d96a20a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:54.094827 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16f68e-69e8-42f5-a7d4-8ccf8d96a20a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:54.095099 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16f68e-69e8-42f5-a7d4-8ccf8d96a20a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:54.104160 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16f68e-69e8-42f5-a7d4-8ccf8d96a20a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:22:54.105638 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16f68e-69e8-42f5-a7d4-8ccf8d96a20a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:22:54.119193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-1a16f68e-69e8-42f5-a7d4-8ccf8d96a20a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 31 12:22:54.119193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:22:54.119193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:22:54.119193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:22:54.119193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:22:54.119193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:22:54.119193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:22:54.119193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:22:54.119193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:22:54.119193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:22:54.119193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:22:54.119193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:22:54.119193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:22:54.119193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:22:54.119193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:22:54.119193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:22:54.120306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:22:54.120306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:22:54.120306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:22:54.120306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:22:54.120306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:22:54.120306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:22:54.120306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:22:54.120306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:22:54.120306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:22:54.120306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:22:54.120306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:22:54.120306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:22:54.120306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:22:54.120306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:22:54.120306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:22:54.120306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:22:54.120306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:22:54.120306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:22:54.126463 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:22:54.126463 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:22:54.126463 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:22:54.126463 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:22:54.126463 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:22:54.126463 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:22:54.126463 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:22:54.126463 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:22:54.126463 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 31 12:22:54.126463 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:22:54.126463 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 455/917] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:22:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:22:54.127163 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1acc4-a9c9-4e07-9212-7ab57c790e4a None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:22:54.240739 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1acc4-a9c9-4e07-9212-7ab57c790e4a None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:22:54.284443 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d061d67-1aa0-4763-86ca-f6557955ef5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:22:54.285121 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d061d67-1aa0-4763-86ca-f6557955ef5b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:54.285432 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d061d67-1aa0-4763-86ca-f6557955ef5b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:54.285701 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d061d67-1aa0-4763-86ca-f6557955ef5b None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:54.286487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d061d67-1aa0-4763-86ca-f6557955ef5b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:22:54.286853 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d061d67-1aa0-4763-86ca-f6557955ef5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:22:54.288518 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d061d67-1aa0-4763-86ca-f6557955ef5b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:22:54.314345 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 463/918] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Oct 31 12:22:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:22:54.320073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16f68e-69e8-42f5-a7d4-8ccf8d96a20a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:22:54.423768 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16f68e-69e8-42f5-a7d4-8ccf8d96a20a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:22:54.459179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc40e06-c840-4c7d-b826-4662dbd0e28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:22:54.459843 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc40e06-c840-4c7d-b826-4662dbd0e28c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:54.460131 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc40e06-c840-4c7d-b826-4662dbd0e28c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:54.460418 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc40e06-c840-4c7d-b826-4662dbd0e28c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:54.473312 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc40e06-c840-4c7d-b826-4662dbd0e28c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:22:54.474780 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc40e06-c840-4c7d-b826-4662dbd0e28c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:22:54.490108 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-cdc40e06-c840-4c7d-b826-4662dbd0e28c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:22:54.490108 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:22:54.490108 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:22:54.490108 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:22:54.490108 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:22:54.490108 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:22:54.490108 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:22:54.490108 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:22:54.490108 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:22:54.490108 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:22:54.490108 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:22:54.490108 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:22:54.490108 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:22:54.490108 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:22:54.490108 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:22:54.490108 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:22:54.491269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:22:54.491269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:22:54.491269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:22:54.491269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:22:54.491269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:22:54.491269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:22:54.491269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:22:54.491269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:22:54.491269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:22:54.491269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:22:54.491269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:22:54.491269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:22:54.491269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:22:54.491269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:22:54.491269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:22:54.491269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:22:54.491269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:22:54.492396 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:22:54.492396 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:22:54.492396 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:22:54.497431 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 456/919] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:22:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:22:54.499427 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d061d67-1aa0-4763-86ca-f6557955ef5b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:22:54.519053 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:22:54.606821 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d061d67-1aa0-4763-86ca-f6557955ef5b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:22:54.645221 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01864537-fa86-4d2e-ae0d-e0e6b863213c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:22:54.645915 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01864537-fa86-4d2e-ae0d-e0e6b863213c None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:54.646198 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01864537-fa86-4d2e-ae0d-e0e6b863213c None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:54.646676 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01864537-fa86-4d2e-ae0d-e0e6b863213c None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:54.647349 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01864537-fa86-4d2e-ae0d-e0e6b863213c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:22:54.647692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01864537-fa86-4d2e-ae0d-e0e6b863213c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:22:54.649115 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01864537-fa86-4d2e-ae0d-e0e6b863213c None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:22:54.663994 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 464/920] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:22:54.670382 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc40e06-c840-4c7d-b826-4662dbd0e28c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:22:54.689656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:22:54.795583 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc40e06-c840-4c7d-b826-4662dbd0e28c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:22:54.835653 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc733df4-2d7f-449e-ae67-2c527f750c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:22:54.836324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc733df4-2d7f-449e-ae67-2c527f750c10 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:54.836610 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc733df4-2d7f-449e-ae67-2c527f750c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:54.836886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc733df4-2d7f-449e-ae67-2c527f750c10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:54.844782 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc733df4-2d7f-449e-ae67-2c527f750c10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:22:54.846386 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc733df4-2d7f-449e-ae67-2c527f750c10 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:22:54.858311 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-dc733df4-2d7f-449e-ae67-2c527f750c10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:22:54.858311 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:22:54.858311 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:22:54.858311 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:22:54.858311 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:22:54.858311 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:22:54.858311 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:22:54.858311 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:22:54.858311 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:22:54.858311 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:22:54.858311 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:22:54.858311 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:22:54.858311 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:22:54.858311 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:22:54.858311 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:22:54.859524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:22:54.859524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:22:54.859524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:22:54.859524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:22:54.859524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:22:54.859524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:22:54.859524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:22:54.859524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:22:54.859524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:22:54.859524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:22:54.859524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:22:54.859524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:22:54.859524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:22:54.859524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:22:54.859524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:22:54.859524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:22:54.859524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:22:54.860661 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:22:54.860661 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:22:54.860661 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:22:54.860661 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:22:54.860661 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:22:54.860661 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:22:54.860661 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:22:54.860661 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:22:54.860661 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 457/921] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:22:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:22:54.867867 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01864537-fa86-4d2e-ae0d-e0e6b863213c None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:22:54.957060 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:22:54.982810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01864537-fa86-4d2e-ae0d-e0e6b863213c None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:22:55.019980 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e1342-6402-434f-8e16-3cda2c713648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:22:55.020696 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e1342-6402-434f-8e16-3cda2c713648 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:55.021041 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e1342-6402-434f-8e16-3cda2c713648 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:55.021405 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e1342-6402-434f-8e16-3cda2c713648 None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:55.022188 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e1342-6402-434f-8e16-3cda2c713648 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:22:55.022557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e1342-6402-434f-8e16-3cda2c713648 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:22:55.024074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e1342-6402-434f-8e16-3cda2c713648 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:22:55.046770 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 465/922] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:22:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:22:55.046996 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc733df4-2d7f-449e-ae67-2c527f750c10 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:22:55.133437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:22:55.160811 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc733df4-2d7f-449e-ae67-2c527f750c10 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:22:55.197163 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba78527-dafb-44a7-9a28-df25740398ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:22:55.197845 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba78527-dafb-44a7-9a28-df25740398ae None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:55.198116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba78527-dafb-44a7-9a28-df25740398ae None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:55.198386 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba78527-dafb-44a7-9a28-df25740398ae None admin] PATH_INFO: `/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/18c015b8317b4517911f69bef21a0573/roles/df935cf8a7f24352ba94fe83718280ea` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:55.213880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba78527-dafb-44a7-9a28-df25740398ae None admin] RBAC: Authorizing `identity:create_grant(project_id=786ee416a639447ab3698d1f56d04e9a, user_id=18c015b8317b4517911f69bef21a0573, role_id=df935cf8a7f24352ba94fe83718280ea)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:22:55.215236 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba78527-dafb-44a7-9a28-df25740398ae None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:22:55.229011 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 458/923] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:22:55 2022] PUT /identity/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/18c015b8317b4517911f69bef21a0573/roles/df935cf8a7f24352ba94fe83718280ea => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:22:57.807586 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946031db-2058-4b0b-a621-03add3d0ce5d None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:57.808181 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946031db-2058-4b0b-a621-03add3d0ce5d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:57.808181 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946031db-2058-4b0b-a621-03add3d0ce5d None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:57.809564 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 466/924] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:22:57.814910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0245a5-13d7-421a-bda8-42b51c302cb6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:57.815332 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0245a5-13d7-421a-bda8-42b51c302cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:57.815483 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0245a5-13d7-421a-bda8-42b51c302cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:57.833468 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ba0245a5-13d7-421a-bda8-42b51c302cb6 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:22:57.834676 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ba0245a5-13d7-421a-bda8-42b51c302cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:22:57.905962 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 459/925] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:22:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 12:22:58.186549 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946031db-2058-4b0b-a621-03add3d0ce5d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:22:58.302421 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946031db-2058-4b0b-a621-03add3d0ce5d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:22:58.348804 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ebee2-6054-4175-a404-1d573c8786ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:22:58.349750 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ebee2-6054-4175-a404-1d573c8786ae None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:58.350110 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ebee2-6054-4175-a404-1d573c8786ae None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:58.350408 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ebee2-6054-4175-a404-1d573c8786ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:58.359563 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:22:58.364614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ebee2-6054-4175-a404-1d573c8786ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:22:58.371972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-3b1ebee2-6054-4175-a404-1d573c8786ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:22:58.371972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:22:58.371972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:22:58.371972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:22:58.371972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:22:58.371972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:22:58.371972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:22:58.371972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:22:58.371972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:22:58.371972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:22:58.371972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:22:58.371972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:22:58.371972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:22:58.371972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:22:58.371972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:22:58.371972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:22:58.373098 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:22:58.373098 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:22:58.373098 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:22:58.373098 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:22:58.373098 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:22:58.373098 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:22:58.373098 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:22:58.373098 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:22:58.373098 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:22:58.373098 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:22:58.373098 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:22:58.373098 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:22:58.373098 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:22:58.373098 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:22:58.373098 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:22:58.373098 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:22:58.373972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:22:58.373972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:22:58.373972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:22:58.373972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:22:58.373972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:22:58.373972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:22:58.373972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:22:58.373972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:22:58.373972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:22:58.373972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:22:58.373972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 12:22:58.373972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:22:58.373972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 467/926] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Oct 31 12:22:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:22:58.379378 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0245a5-13d7-421a-bda8-42b51c302cb6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:22:58.439552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:22:58.489502 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0245a5-13d7-421a-bda8-42b51c302cb6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:22:58.523972 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e9793-6c08-4f53-8385-5e62cc1f79db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:22:58.524576 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e9793-6c08-4f53-8385-5e62cc1f79db None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:58.524853 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e9793-6c08-4f53-8385-5e62cc1f79db None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:58.525144 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e9793-6c08-4f53-8385-5e62cc1f79db None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:58.525801 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e9793-6c08-4f53-8385-5e62cc1f79db None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:22:58.526095 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e9793-6c08-4f53-8385-5e62cc1f79db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:22:58.527455 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e9793-6c08-4f53-8385-5e62cc1f79db None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:22:58.537282 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 460/927] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Oct 31 12:22:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:22:58.543252 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ebee2-6054-4175-a404-1d573c8786ae None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:22:58.655169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ebee2-6054-4175-a404-1d573c8786ae None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:22:58.692497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8a61a-dcae-47e8-a487-f3446c993774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:22:58.693145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8a61a-dcae-47e8-a487-f3446c993774 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:58.693428 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8a61a-dcae-47e8-a487-f3446c993774 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:58.693702 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8a61a-dcae-47e8-a487-f3446c993774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:58.703753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8a61a-dcae-47e8-a487-f3446c993774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:22:58.705843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8a61a-dcae-47e8-a487-f3446c993774 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:22:58.720998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-a2f8a61a-dcae-47e8-a487-f3446c993774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:22:58.720998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:22:58.720998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:22:58.720998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:22:58.720998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:22:58.720998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:22:58.720998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:22:58.720998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:22:58.720998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:22:58.720998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:22:58.720998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:22:58.720998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:22:58.720998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:22:58.720998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:22:58.720998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:22:58.720998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:22:58.722194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:22:58.722194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:22:58.722194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:22:58.722194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:22:58.722194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:22:58.722194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:22:58.722194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:22:58.722194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:22:58.722194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:22:58.722194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:22:58.722194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:22:58.722194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:22:58.722194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:22:58.722194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:22:58.722194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:22:58.722194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:22:58.722194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:22:58.723151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:22:58.723151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:22:58.723151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:22:58.723151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 468/928] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:22:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:22:58.728378 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e9793-6c08-4f53-8385-5e62cc1f79db None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:22:58.848970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e9793-6c08-4f53-8385-5e62cc1f79db None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:22:58.866643 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:22:58.885309 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a53d5-3906-448f-b237-a32d0b1cb11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:22:58.885917 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a53d5-3906-448f-b237-a32d0b1cb11a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:58.886186 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a53d5-3906-448f-b237-a32d0b1cb11a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:58.886460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a53d5-3906-448f-b237-a32d0b1cb11a None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:58.887099 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a53d5-3906-448f-b237-a32d0b1cb11a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:22:58.887404 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a53d5-3906-448f-b237-a32d0b1cb11a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:22:58.888778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a53d5-3906-448f-b237-a32d0b1cb11a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:22:58.900521 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 461/929] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:22:58.906494 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8a61a-dcae-47e8-a487-f3446c993774 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:22:58.958925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:22:59.015516 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8a61a-dcae-47e8-a487-f3446c993774 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:22:59.051605 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794c676-bd99-44fa-9488-ce1263b5f233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:22:59.052226 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794c676-bd99-44fa-9488-ce1263b5f233 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:59.052501 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794c676-bd99-44fa-9488-ce1263b5f233 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:59.052764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794c676-bd99-44fa-9488-ce1263b5f233 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:59.060607 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794c676-bd99-44fa-9488-ce1263b5f233 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:22:59.062078 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794c676-bd99-44fa-9488-ce1263b5f233 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:22:59.074293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-8794c676-bd99-44fa-9488-ce1263b5f233 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 31 12:22:59.074293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:22:59.074293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:22:59.074293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:22:59.074293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:22:59.074293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:22:59.074293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:22:59.074293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:22:59.074293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:22:59.074293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:22:59.074293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:22:59.074293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:22:59.074293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:22:59.074293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:22:59.074293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:22:59.074293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:22:59.075487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:22:59.075487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:22:59.075487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:22:59.075487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:22:59.075487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:22:59.075487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:22:59.075487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:22:59.075487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:22:59.075487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:22:59.075487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:22:59.075487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:22:59.075487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:22:59.075487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:22:59.075487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:22:59.075487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:22:59.075487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:22:59.075487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:22:59.075487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:22:59.081368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:22:59.081368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:22:59.081368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:22:59.081368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:22:59.081368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:22:59.081368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:22:59.081368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:22:59.081368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:22:59.081368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 31 12:22:59.081368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:22:59.081368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 469/930] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:22:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:22:59.082806 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a53d5-3906-448f-b237-a32d0b1cb11a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:22:59.191410 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a53d5-3906-448f-b237-a32d0b1cb11a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:22:59.226914 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7ec1f-6c3d-4848-8635-bcfe12da3aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:22:59.227516 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7ec1f-6c3d-4848-8635-bcfe12da3aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:59.227794 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7ec1f-6c3d-4848-8635-bcfe12da3aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:59.228065 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7ec1f-6c3d-4848-8635-bcfe12da3aa0 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:59.228780 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7ec1f-6c3d-4848-8635-bcfe12da3aa0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:22:59.229081 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7ec1f-6c3d-4848-8635-bcfe12da3aa0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:22:59.230519 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7ec1f-6c3d-4848-8635-bcfe12da3aa0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:22:59.251052 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 462/931] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Oct 31 12:22:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:22:59.257137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794c676-bd99-44fa-9488-ce1263b5f233 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:22:59.368197 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794c676-bd99-44fa-9488-ce1263b5f233 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:22:59.379295 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:22:59.403897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437afebf-fad2-44f5-80fe-fcb9bf18248e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:22:59.404589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437afebf-fad2-44f5-80fe-fcb9bf18248e None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:59.404947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437afebf-fad2-44f5-80fe-fcb9bf18248e None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:59.405311 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437afebf-fad2-44f5-80fe-fcb9bf18248e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:59.474949 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437afebf-fad2-44f5-80fe-fcb9bf18248e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:22:59.476786 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437afebf-fad2-44f5-80fe-fcb9bf18248e None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:22:59.584903 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 470/932] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:22:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 31 12:22:59.590666 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7ec1f-6c3d-4848-8635-bcfe12da3aa0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:22:59.628637 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:22:59.699416 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7ec1f-6c3d-4848-8635-bcfe12da3aa0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:22:59.735607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614b28f-6833-43a4-b139-87c895ba8f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:22:59.737032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614b28f-6833-43a4-b139-87c895ba8f62 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:59.737466 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614b28f-6833-43a4-b139-87c895ba8f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:59.737793 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614b28f-6833-43a4-b139-87c895ba8f62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:59.747978 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614b28f-6833-43a4-b139-87c895ba8f62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:22:59.749490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614b28f-6833-43a4-b139-87c895ba8f62 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:22:59.764851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-9614b28f-6833-43a4-b139-87c895ba8f62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:22:59.764851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:22:59.764851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:22:59.764851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:22:59.764851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:22:59.764851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:22:59.764851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:22:59.764851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:22:59.764851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:22:59.764851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:22:59.764851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:22:59.764851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:22:59.764851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:22:59.764851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:22:59.764851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:22:59.764851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:22:59.766169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:22:59.766169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:22:59.766169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:22:59.766169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:22:59.766169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:22:59.766169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:22:59.766169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:22:59.766169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:22:59.766169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:22:59.766169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:22:59.766169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:22:59.766169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:22:59.766169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:22:59.766169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:22:59.766169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:22:59.766169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:22:59.766169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:22:59.767930 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:22:59.767930 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:22:59.767930 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:22:59.767930 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 463/933] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:22:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:22:59.772838 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437afebf-fad2-44f5-80fe-fcb9bf18248e None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:22:59.788130 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:22:59.882873 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437afebf-fad2-44f5-80fe-fcb9bf18248e None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:22:59.919376 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89d25e-5eb3-41a5-90b4-34fbe7ad54a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:22:59.920049 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89d25e-5eb3-41a5-90b4-34fbe7ad54a2 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:22:59.920251 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89d25e-5eb3-41a5-90b4-34fbe7ad54a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:22:59.920524 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89d25e-5eb3-41a5-90b4-34fbe7ad54a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:22:59.921205 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89d25e-5eb3-41a5-90b4-34fbe7ad54a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:22:59.921511 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89d25e-5eb3-41a5-90b4-34fbe7ad54a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:22:59.922870 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89d25e-5eb3-41a5-90b4-34fbe7ad54a2 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:22:59.934796 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 471/934] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:22:59.940908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614b28f-6833-43a4-b139-87c895ba8f62 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:00.034114 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:00.051809 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614b28f-6833-43a4-b139-87c895ba8f62 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:00.087599 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac180ce-577d-40f2-9158-25ec80ea7ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:00.088235 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac180ce-577d-40f2-9158-25ec80ea7ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:00.088517 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac180ce-577d-40f2-9158-25ec80ea7ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:00.088791 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac180ce-577d-40f2-9158-25ec80ea7ea1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:00.095977 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac180ce-577d-40f2-9158-25ec80ea7ea1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:00.099299 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac180ce-577d-40f2-9158-25ec80ea7ea1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:00.111039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-7ac180ce-577d-40f2-9158-25ec80ea7ea1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:23:00.111039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:23:00.111039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:23:00.111039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:23:00.111039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:23:00.111039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:23:00.111039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:23:00.111039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:23:00.111039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:23:00.111039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:23:00.111039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:23:00.111039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:23:00.111039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:23:00.111039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:23:00.111039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:23:00.112082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:23:00.112082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:23:00.112082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:23:00.112082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:23:00.112082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:23:00.112082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:23:00.112082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:23:00.112082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:23:00.112082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:23:00.112082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:23:00.112082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:23:00.112082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:23:00.112082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:23:00.112082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:23:00.112082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:23:00.112082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:23:00.112082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:23:00.113365 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:23:00.113365 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:23:00.113365 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:23:00.113365 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:23:00.113365 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:23:00.113365 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:23:00.113365 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:23:00.113365 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:23:00.113365 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 464/935] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:22:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:23:00.118365 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89d25e-5eb3-41a5-90b4-34fbe7ad54a2 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:00.196971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:00.233952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89d25e-5eb3-41a5-90b4-34fbe7ad54a2 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:00.272802 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8128aa-dfdf-4162-bf44-3ae34c1686e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:00.273432 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8128aa-dfdf-4162-bf44-3ae34c1686e1 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:00.273710 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8128aa-dfdf-4162-bf44-3ae34c1686e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:00.273979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8128aa-dfdf-4162-bf44-3ae34c1686e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:00.274663 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8128aa-dfdf-4162-bf44-3ae34c1686e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:23:00.274963 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8128aa-dfdf-4162-bf44-3ae34c1686e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:00.276426 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8128aa-dfdf-4162-bf44-3ae34c1686e1 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:00.293949 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 472/936] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:23:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:23:00.302536 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac180ce-577d-40f2-9158-25ec80ea7ea1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:00.416839 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac180ce-577d-40f2-9158-25ec80ea7ea1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:00.453016 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc544c4-f2ef-49d5-9de6-bb335b8fca4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:00.453717 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc544c4-f2ef-49d5-9de6-bb335b8fca4d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:00.453993 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc544c4-f2ef-49d5-9de6-bb335b8fca4d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:00.454258 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc544c4-f2ef-49d5-9de6-bb335b8fca4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:00.454975 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc544c4-f2ef-49d5-9de6-bb335b8fca4d None admin] RBAC: Adding query filter params (role.id=df935cf8a7f24352ba94fe83718280ea, scope.project.id=786ee416a639447ab3698d1f56d04e9a, user.id=18c015b8317b4517911f69bef21a0573) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:23:00.455278 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc544c4-f2ef-49d5-9de6-bb335b8fca4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:00.456684 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc544c4-f2ef-49d5-9de6-bb335b8fca4d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:00.462363 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 465/937] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:23:00 2022] GET /identity/v3/role_assignments?user.id=18c015b8317b4517911f69bef21a0573&scope.project.id=786ee416a639447ab3698d1f56d04e9a&role.id=df935cf8a7f24352ba94fe83718280ea => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:23:02.790546 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc542e4-95db-448c-a154-34c730b565d1 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:02.791094 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc542e4-95db-448c-a154-34c730b565d1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:02.791391 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc542e4-95db-448c-a154-34c730b565d1 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:02.793008 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 473/938] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:23:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:23:02.799103 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbf571-e87a-48be-a10a-19e4f342352e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:02.799517 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbf571-e87a-48be-a10a-19e4f342352e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:02.799655 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbf571-e87a-48be-a10a-19e4f342352e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:02.820597 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1cdbf571-e87a-48be-a10a-19e4f342352e None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:23:02.822061 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1cdbf571-e87a-48be-a10a-19e4f342352e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:23:02.825285 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:02.894271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 466/939] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:23:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:23:03.184353 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc542e4-95db-448c-a154-34c730b565d1 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:03.301803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc542e4-95db-448c-a154-34c730b565d1 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:03.335055 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:03.341663 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4460d-dd56-4f0d-a651-303f0a7d540b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:03.342297 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4460d-dd56-4f0d-a651-303f0a7d540b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:03.342791 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4460d-dd56-4f0d-a651-303f0a7d540b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:03.343059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4460d-dd56-4f0d-a651-303f0a7d540b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:03.356594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4460d-dd56-4f0d-a651-303f0a7d540b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:23:03.361717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-ede4460d-dd56-4f0d-a651-303f0a7d540b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:23:03.361717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:23:03.361717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:23:03.361717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:23:03.361717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:23:03.361717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:23:03.361717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:23:03.361717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:23:03.361717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:23:03.361717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:23:03.361717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:23:03.361717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:23:03.361717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:23:03.361717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:23:03.361717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:23:03.361717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:23:03.362894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:23:03.362894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:23:03.362894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:23:03.362894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:23:03.362894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:23:03.362894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:23:03.362894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:23:03.362894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:23:03.362894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:23:03.362894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:23:03.362894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:23:03.362894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:23:03.362894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:23:03.362894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:23:03.362894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:23:03.362894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:23:03.364029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:23:03.364029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:23:03.364029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:23:03.364029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:23:03.364029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:23:03.364029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:23:03.364029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:23:03.364029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:23:03.364029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:23:03.364029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:23:03.364029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:23:03.364029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:23:03.364029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 474/940] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 31 12:23:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:23:03.368753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbf571-e87a-48be-a10a-19e4f342352e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:03.474627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbf571-e87a-48be-a10a-19e4f342352e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:03.512325 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0eb213-90b5-4798-bcd8-f7c79174eea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:03.513233 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0eb213-90b5-4798-bcd8-f7c79174eea4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:03.513513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0eb213-90b5-4798-bcd8-f7c79174eea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:03.513800 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0eb213-90b5-4798-bcd8-f7c79174eea4 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:03.514438 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0eb213-90b5-4798-bcd8-f7c79174eea4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:23:03.514746 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0eb213-90b5-4798-bcd8-f7c79174eea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:03.516077 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0eb213-90b5-4798-bcd8-f7c79174eea4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:03.524670 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 467/941] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:23:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:23:03.530799 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4460d-dd56-4f0d-a651-303f0a7d540b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:03.633058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4460d-dd56-4f0d-a651-303f0a7d540b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:03.672634 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38324b-cabb-4ed6-8bb6-d0e2f15041ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:03.673333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38324b-cabb-4ed6-8bb6-d0e2f15041ce None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:03.673603 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38324b-cabb-4ed6-8bb6-d0e2f15041ce None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:03.673874 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38324b-cabb-4ed6-8bb6-d0e2f15041ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:03.684743 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38324b-cabb-4ed6-8bb6-d0e2f15041ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:03.686294 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38324b-cabb-4ed6-8bb6-d0e2f15041ce None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:03.702407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-1c38324b-cabb-4ed6-8bb6-d0e2f15041ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:23:03.702407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:23:03.702407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:23:03.702407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:23:03.702407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:23:03.702407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:23:03.702407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:23:03.702407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:23:03.702407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:23:03.702407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:23:03.702407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:23:03.702407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:23:03.702407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:23:03.702407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:23:03.702407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:23:03.702407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:23:03.703698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:23:03.703698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:23:03.703698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:23:03.703698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:23:03.703698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:23:03.703698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:23:03.703698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:23:03.703698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:23:03.703698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:23:03.703698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:23:03.703698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:23:03.703698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:23:03.703698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:23:03.703698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:23:03.703698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:23:03.703698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:23:03.703698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:23:03.705363 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:23:03.705363 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:23:03.705363 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:23:03.705363 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 475/942] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:23:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:23:03.710144 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0eb213-90b5-4798-bcd8-f7c79174eea4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:03.713314 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:03.822947 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0eb213-90b5-4798-bcd8-f7c79174eea4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:03.859276 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9440747-7a6d-4fab-bba4-e88b5cb26f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:03.859890 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9440747-7a6d-4fab-bba4-e88b5cb26f8b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:03.860181 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9440747-7a6d-4fab-bba4-e88b5cb26f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:03.860457 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9440747-7a6d-4fab-bba4-e88b5cb26f8b None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:03.861784 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9440747-7a6d-4fab-bba4-e88b5cb26f8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:23:03.861784 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9440747-7a6d-4fab-bba4-e88b5cb26f8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:03.862817 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9440747-7a6d-4fab-bba4-e88b5cb26f8b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:03.875425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 468/943] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:23:03.882174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38324b-cabb-4ed6-8bb6-d0e2f15041ce None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:03.929186 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:03.987427 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38324b-cabb-4ed6-8bb6-d0e2f15041ce None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:04.024070 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924ad34-e6a7-4926-ad39-52e04a12ed15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:04.024707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924ad34-e6a7-4926-ad39-52e04a12ed15 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:04.024971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924ad34-e6a7-4926-ad39-52e04a12ed15 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:04.025278 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924ad34-e6a7-4926-ad39-52e04a12ed15 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:04.033088 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924ad34-e6a7-4926-ad39-52e04a12ed15 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:04.034783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924ad34-e6a7-4926-ad39-52e04a12ed15 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:04.045925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-1924ad34-e6a7-4926-ad39-52e04a12ed15 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 31 12:23:04.045925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:23:04.045925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:23:04.045925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:23:04.045925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:23:04.045925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:23:04.045925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:23:04.045925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:23:04.045925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:23:04.045925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:23:04.045925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:23:04.045925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:23:04.045925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:23:04.045925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:23:04.045925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:23:04.045925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:23:04.047059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:23:04.047059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:23:04.047059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:23:04.047059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:23:04.047059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:23:04.047059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:23:04.047059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:23:04.047059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:23:04.047059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:23:04.047059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:23:04.047059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:23:04.047059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:23:04.047059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:23:04.047059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:23:04.047059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:23:04.047059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:23:04.047059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:23:04.047059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:23:04.049028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:23:04.049028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:23:04.049028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:23:04.049028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:23:04.049028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:23:04.049028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:23:04.049028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:23:04.049028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:23:04.049028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 31 12:23:04.049028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:23:04.049028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 476/944] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:23:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:23:04.053514 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9440747-7a6d-4fab-bba4-e88b5cb26f8b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:04.121759 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:04.173797 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9440747-7a6d-4fab-bba4-e88b5cb26f8b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:04.208727 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcca70e-bce6-419e-8533-d8a06c38ab07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:04.209313 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcca70e-bce6-419e-8533-d8a06c38ab07 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:04.209638 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcca70e-bce6-419e-8533-d8a06c38ab07 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:04.209907 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcca70e-bce6-419e-8533-d8a06c38ab07 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:04.210790 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcca70e-bce6-419e-8533-d8a06c38ab07 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:23:04.211214 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcca70e-bce6-419e-8533-d8a06c38ab07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:04.212967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcca70e-bce6-419e-8533-d8a06c38ab07 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:04.231995 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 469/945] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Oct 31 12:23:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:23:04.239455 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924ad34-e6a7-4926-ad39-52e04a12ed15 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:04.350003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924ad34-e6a7-4926-ad39-52e04a12ed15 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:04.352180 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:04.388903 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14364b08-1963-437e-ac59-bd8708c26e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:04.389560 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14364b08-1963-437e-ac59-bd8708c26e73 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:04.389844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14364b08-1963-437e-ac59-bd8708c26e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:04.390118 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14364b08-1963-437e-ac59-bd8708c26e73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:04.402372 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14364b08-1963-437e-ac59-bd8708c26e73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:04.403817 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14364b08-1963-437e-ac59-bd8708c26e73 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:04.418783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-14364b08-1963-437e-ac59-bd8708c26e73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:23:04.418783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:23:04.418783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:23:04.418783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:23:04.418783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:23:04.418783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:23:04.418783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:23:04.418783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:23:04.418783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:23:04.418783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:23:04.418783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:23:04.418783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:23:04.418783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:23:04.418783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:23:04.418783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:23:04.418783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:23:04.419769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:23:04.419769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:23:04.419769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:23:04.419769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:23:04.419769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:23:04.419769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:23:04.419769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:23:04.419769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:23:04.419769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:23:04.419769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:23:04.419769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:23:04.419769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:23:04.419769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:23:04.419769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:23:04.419769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:23:04.419769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:23:04.419769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:23:04.420848 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:23:04.420848 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:23:04.420848 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:23:04.420848 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 477/946] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:23:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:23:04.426926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcca70e-bce6-419e-8533-d8a06c38ab07 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:04.541213 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcca70e-bce6-419e-8533-d8a06c38ab07 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:04.562301 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:04.578319 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38168a28-b1c9-4c01-9fa8-7d79db04ffa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:04.579069 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38168a28-b1c9-4c01-9fa8-7d79db04ffa2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:04.579483 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38168a28-b1c9-4c01-9fa8-7d79db04ffa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:04.579922 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38168a28-b1c9-4c01-9fa8-7d79db04ffa2 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:04.581042 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38168a28-b1c9-4c01-9fa8-7d79db04ffa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:23:04.581607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38168a28-b1c9-4c01-9fa8-7d79db04ffa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:04.584058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38168a28-b1c9-4c01-9fa8-7d79db04ffa2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:04.597919 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 470/947] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:23:04.603912 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14364b08-1963-437e-ac59-bd8708c26e73 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:04.718939 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14364b08-1963-437e-ac59-bd8708c26e73 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:04.762652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6e560-b202-49a5-a12d-767e43142476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:04.763296 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6e560-b202-49a5-a12d-767e43142476 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:04.763653 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6e560-b202-49a5-a12d-767e43142476 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:04.763899 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6e560-b202-49a5-a12d-767e43142476 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:04.771453 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6e560-b202-49a5-a12d-767e43142476 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:04.772845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6e560-b202-49a5-a12d-767e43142476 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:04.786625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-cbc6e560-b202-49a5-a12d-767e43142476 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:23:04.786625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:23:04.786625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:23:04.786625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:23:04.786625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:23:04.786625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:23:04.786625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:23:04.786625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:23:04.786625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:23:04.786625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:23:04.786625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:23:04.786625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:23:04.786625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:23:04.786625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:23:04.786625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:23:04.787914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:23:04.787914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:23:04.787914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:23:04.787914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:23:04.787914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:23:04.787914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:23:04.787914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:23:04.787914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:23:04.787914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:23:04.787914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:23:04.787914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:23:04.787914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:23:04.787914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:23:04.787914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:23:04.787914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:23:04.787914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:23:04.787914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:23:04.789169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:23:04.789169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:23:04.789169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:23:04.789169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:23:04.789169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:23:04.789169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:23:04.789169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:23:04.789169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:23:04.789169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 478/948] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:23:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:23:04.795093 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38168a28-b1c9-4c01-9fa8-7d79db04ffa2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:04.902049 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38168a28-b1c9-4c01-9fa8-7d79db04ffa2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:04.940613 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeff2d2-549a-44e1-9bcf-77f1920f3793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:04.941256 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeff2d2-549a-44e1-9bcf-77f1920f3793 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:04.941611 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeff2d2-549a-44e1-9bcf-77f1920f3793 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:04.941889 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeff2d2-549a-44e1-9bcf-77f1920f3793 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:04.944400 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeff2d2-549a-44e1-9bcf-77f1920f3793 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:23:04.944726 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeff2d2-549a-44e1-9bcf-77f1920f3793 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:04.946383 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeff2d2-549a-44e1-9bcf-77f1920f3793 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:04.960595 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 471/949] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:23:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:23:04.967417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6e560-b202-49a5-a12d-767e43142476 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:04.985564 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:05.081359 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6e560-b202-49a5-a12d-767e43142476 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:05.124371 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6ee00-39c8-4a26-a9a2-5f5781a90713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:05.125154 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6ee00-39c8-4a26-a9a2-5f5781a90713 None admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:05.125563 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6ee00-39c8-4a26-a9a2-5f5781a90713 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:05.125912 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6ee00-39c8-4a26-a9a2-5f5781a90713 None admin] PATH_INFO: `/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/18c015b8317b4517911f69bef21a0573/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:05.128136 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6ee00-39c8-4a26-a9a2-5f5781a90713 None admin] RBAC: Authorizing `identity:create_grant(project_id=786ee416a639447ab3698d1f56d04e9a, user_id=18c015b8317b4517911f69bef21a0573, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:05.129765 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6ee00-39c8-4a26-a9a2-5f5781a90713 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:05.143230 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 479/950] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Oct 31 12:23:04 2022] PUT /identity/v3/projects/786ee416a639447ab3698d1f56d04e9a/users/18c015b8317b4517911f69bef21a0573/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:23:07.305751 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbbe0f-604a-4b24-a10e-721ff4dfd4a3 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:07.306320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbbe0f-604a-4b24-a10e-721ff4dfd4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:07.306320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbbe0f-604a-4b24-a10e-721ff4dfd4a3 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:07.308082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 472/951] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:23:07.314772 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521ddf0-a907-47e4-bfaa-d68e421a8393 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:07.315218 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521ddf0-a907-47e4-bfaa-d68e421a8393 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:07.315421 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521ddf0-a907-47e4-bfaa-d68e421a8393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:07.335119 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-b521ddf0-a907-47e4-bfaa-d68e421a8393 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:23:07.336477 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b521ddf0-a907-47e4-bfaa-d68e421a8393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:23:07.420414 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 480/952] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:23:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:23:07.710068 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbbe0f-604a-4b24-a10e-721ff4dfd4a3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:07.756800 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:07.836766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbbe0f-604a-4b24-a10e-721ff4dfd4a3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:07.878659 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bb095-2902-4b87-960b-67d1bf296c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:07.879377 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bb095-2902-4b87-960b-67d1bf296c31 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:07.879732 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bb095-2902-4b87-960b-67d1bf296c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:07.880051 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bb095-2902-4b87-960b-67d1bf296c31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:07.890984 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bb095-2902-4b87-960b-67d1bf296c31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 12:23:07.896273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-968bb095-2902-4b87-960b-67d1bf296c31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:23:07.896273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:23:07.896273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:23:07.896273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:23:07.896273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:23:07.896273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:23:07.896273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:23:07.896273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:23:07.896273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:23:07.896273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:23:07.896273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:23:07.896273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:23:07.896273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 12:23:07.896273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 12:23:07.896273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 12:23:07.896273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 12:23:07.897240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 12:23:07.897240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 12:23:07.897240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 12:23:07.897240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 12:23:07.897240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:23:07.897240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:23:07.897240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:23:07.897240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:23:07.897240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:23:07.897240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:23:07.897240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:23:07.897240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:23:07.897240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:23:07.897240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:23:07.897240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:23:07.897240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:23:07.898263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:23:07.898263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:23:07.898263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:23:07.898263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:23:07.898263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 12:23:07.898263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 12:23:07.898263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 12:23:07.898263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 12:23:07.898263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 12:23:07.898263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 12:23:07.898263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 12:23:07.898263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:23:07.898263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 473/953] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Oct 31 12:23:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:23:07.903523 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521ddf0-a907-47e4-bfaa-d68e421a8393 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:07.906625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:08.012885 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521ddf0-a907-47e4-bfaa-d68e421a8393 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:08.051608 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416384ab-a56c-4f6a-aed7-fc8d1a86cf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:08.052283 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416384ab-a56c-4f6a-aed7-fc8d1a86cf37 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:08.052561 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416384ab-a56c-4f6a-aed7-fc8d1a86cf37 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:08.052834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416384ab-a56c-4f6a-aed7-fc8d1a86cf37 None admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:08.053617 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416384ab-a56c-4f6a-aed7-fc8d1a86cf37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:23:08.053924 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416384ab-a56c-4f6a-aed7-fc8d1a86cf37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:08.055514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416384ab-a56c-4f6a-aed7-fc8d1a86cf37 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:08.064572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 481/954] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Oct 31 12:23:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:23:08.070289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bb095-2902-4b87-960b-67d1bf296c31 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:08.172709 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:08.175992 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bb095-2902-4b87-960b-67d1bf296c31 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:08.215082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548ec12-29ac-4b7e-af27-0d7af76bde0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:08.215709 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548ec12-29ac-4b7e-af27-0d7af76bde0e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:08.215988 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548ec12-29ac-4b7e-af27-0d7af76bde0e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:08.216257 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548ec12-29ac-4b7e-af27-0d7af76bde0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:08.226763 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548ec12-29ac-4b7e-af27-0d7af76bde0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:08.228199 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548ec12-29ac-4b7e-af27-0d7af76bde0e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:08.243890 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-3548ec12-29ac-4b7e-af27-0d7af76bde0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:23:08.243890 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:23:08.243890 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:23:08.243890 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:23:08.243890 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:23:08.243890 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:23:08.243890 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:23:08.243890 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:23:08.243890 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:23:08.243890 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:23:08.243890 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:23:08.243890 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:23:08.243890 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:23:08.243890 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:23:08.243890 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:23:08.243890 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:23:08.245362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:23:08.245362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:23:08.245362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:23:08.245362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:23:08.245362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:23:08.245362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:23:08.245362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:23:08.245362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:23:08.245362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:23:08.245362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:23:08.245362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:23:08.245362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:23:08.245362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:23:08.245362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:23:08.245362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:23:08.245362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:23:08.245362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:23:08.246505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:23:08.246505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:23:08.246505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:23:08.246505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 474/955] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:23:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 12:23:08.252134 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416384ab-a56c-4f6a-aed7-fc8d1a86cf37 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:08.322173 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:08.369459 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416384ab-a56c-4f6a-aed7-fc8d1a86cf37 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:08.411842 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2aea8-21c7-497c-96b4-726410412efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:08.412456 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2aea8-21c7-497c-96b4-726410412efb None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:08.412737 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2aea8-21c7-497c-96b4-726410412efb None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:08.413012 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2aea8-21c7-497c-96b4-726410412efb None admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:08.413858 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2aea8-21c7-497c-96b4-726410412efb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:23:08.414161 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2aea8-21c7-497c-96b4-726410412efb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:08.415846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c2aea8-21c7-497c-96b4-726410412efb None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:08.429966 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 482/956] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:23:08.435931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548ec12-29ac-4b7e-af27-0d7af76bde0e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:08.540789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548ec12-29ac-4b7e-af27-0d7af76bde0e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:08.576983 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0def68-be7d-426e-9d02-4ded23daf796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:08.577590 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0def68-be7d-426e-9d02-4ded23daf796 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:08.577922 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0def68-be7d-426e-9d02-4ded23daf796 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:08.578251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0def68-be7d-426e-9d02-4ded23daf796 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:08.587820 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0def68-be7d-426e-9d02-4ded23daf796 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:08.589421 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0def68-be7d-426e-9d02-4ded23daf796 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:08.601179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-5d0def68-be7d-426e-9d02-4ded23daf796 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 31 12:23:08.601179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:23:08.601179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:23:08.601179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:23:08.601179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:23:08.601179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:23:08.601179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:23:08.601179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:23:08.601179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:23:08.601179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:23:08.601179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:23:08.601179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:23:08.601179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 12:23:08.601179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 12:23:08.601179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 12:23:08.601179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 12:23:08.602279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:23:08.602279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:23:08.602279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 12:23:08.602279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:23:08.602279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 12:23:08.602279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 12:23:08.602279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:23:08.602279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:23:08.602279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:23:08.602279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:23:08.602279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:23:08.602279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:23:08.602279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:23:08.602279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:23:08.602279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:23:08.602279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:23:08.602279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:23:08.602279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:23:08.603240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:23:08.603240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:23:08.603240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 12:23:08.603240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 12:23:08.603240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 12:23:08.603240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 12:23:08.603240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 12:23:08.603240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 12:23:08.603240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 31 12:23:08.603240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:23:08.603240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 475/957] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:23:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:23:08.608169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2aea8-21c7-497c-96b4-726410412efb None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:08.716397 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2aea8-21c7-497c-96b4-726410412efb None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:08.744384 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:08.753906 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f3c37-1855-4978-b144-6433ee0721b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:08.754574 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f3c37-1855-4978-b144-6433ee0721b7 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:08.754890 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f3c37-1855-4978-b144-6433ee0721b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:08.755146 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f3c37-1855-4978-b144-6433ee0721b7 None admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:08.755877 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f3c37-1855-4978-b144-6433ee0721b7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:23:08.756177 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f3c37-1855-4978-b144-6433ee0721b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:08.757638 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f3c37-1855-4978-b144-6433ee0721b7 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:08.779814 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 483/958] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Oct 31 12:23:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:23:08.787236 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0def68-be7d-426e-9d02-4ded23daf796 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:08.805842 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:08.896684 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0def68-be7d-426e-9d02-4ded23daf796 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:08.932304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999faaec-bf5f-48d2-abdf-74e4bc9b4c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:08.932926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999faaec-bf5f-48d2-abdf-74e4bc9b4c9d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:08.933237 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999faaec-bf5f-48d2-abdf-74e4bc9b4c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:08.933512 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999faaec-bf5f-48d2-abdf-74e4bc9b4c9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:09.004234 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999faaec-bf5f-48d2-abdf-74e4bc9b4c9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:09.005738 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999faaec-bf5f-48d2-abdf-74e4bc9b4c9d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:09.020195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:09.108856 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 476/959] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Oct 31 12:23:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 12:23:09.114988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f3c37-1855-4978-b144-6433ee0721b7 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:09.217312 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f3c37-1855-4978-b144-6433ee0721b7 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:09.254624 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54f055-ee86-4640-91b8-68f70e6c7387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:09.255257 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54f055-ee86-4640-91b8-68f70e6c7387 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:09.255536 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54f055-ee86-4640-91b8-68f70e6c7387 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:09.255805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54f055-ee86-4640-91b8-68f70e6c7387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:09.265810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54f055-ee86-4640-91b8-68f70e6c7387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:09.267276 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54f055-ee86-4640-91b8-68f70e6c7387 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:09.282052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-fd54f055-ee86-4640-91b8-68f70e6c7387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:23:09.282052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:23:09.282052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:23:09.282052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:23:09.282052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:23:09.282052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:23:09.282052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:23:09.282052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:23:09.282052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:23:09.282052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:23:09.282052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:23:09.282052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:23:09.282052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 12:23:09.282052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 12:23:09.282052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 12:23:09.282052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 12:23:09.283538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:23:09.283538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:23:09.283538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:23:09.283538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:23:09.283538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:23:09.283538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:23:09.283538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:23:09.283538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:23:09.283538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:23:09.283538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:23:09.283538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:23:09.283538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:23:09.283538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:23:09.283538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:23:09.283538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:23:09.283538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:23:09.283538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 12:23:09.284753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 12:23:09.284753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 12:23:09.284753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:23:09.284753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 484/960] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:23:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:23:09.289859 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999faaec-bf5f-48d2-abdf-74e4bc9b4c9d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:09.385377 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999faaec-bf5f-48d2-abdf-74e4bc9b4c9d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:09.398192 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:09.419063 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be6965-93d7-4644-8ca7-452bb17119bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:09.419652 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be6965-93d7-4644-8ca7-452bb17119bf None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:09.419927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be6965-93d7-4644-8ca7-452bb17119bf None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:09.420197 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be6965-93d7-4644-8ca7-452bb17119bf None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:09.420831 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be6965-93d7-4644-8ca7-452bb17119bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:23:09.421155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be6965-93d7-4644-8ca7-452bb17119bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:09.422496 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be6965-93d7-4644-8ca7-452bb17119bf None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:09.433047 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 477/961] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Oct 31 12:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:23:09.438831 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54f055-ee86-4640-91b8-68f70e6c7387 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:09.473768 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:09.535758 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54f055-ee86-4640-91b8-68f70e6c7387 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:09.567164 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e7b80-576d-41a5-ad96-8348d846c71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:09.567770 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e7b80-576d-41a5-ad96-8348d846c71b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:09.568049 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e7b80-576d-41a5-ad96-8348d846c71b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:09.568321 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e7b80-576d-41a5-ad96-8348d846c71b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:09.574667 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e7b80-576d-41a5-ad96-8348d846c71b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:09.576087 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e7b80-576d-41a5-ad96-8348d846c71b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:09.587410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application [None req-5d7e7b80-576d-41a5-ad96-8348d846c71b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:23:09.587410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:23:09.587410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:23:09.587410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:23:09.587410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:23:09.587410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:23:09.587410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:23:09.587410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:23:09.587410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:23:09.587410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:23:09.587410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:23:09.587410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:23:09.587410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 12:23:09.587410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 12:23:09.587410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 12:23:09.588435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 12:23:09.588435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:23:09.588435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:23:09.588435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:23:09.588435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:23:09.588435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:23:09.588435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:23:09.588435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:23:09.588435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application with Lock( Oct 31 12:23:09.588435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:23:09.588435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:23:09.588435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:23:09.588435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:23:09.588435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:23:09.588435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:23:09.588435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:23:09.588435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:23:09.589596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 12:23:09.589596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 12:23:09.589596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 12:23:09.589596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 12:23:09.589596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 12:23:09.589596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 12:23:09.589596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 12:23:09.589596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: ERROR keystone.server.flask.application Oct 31 12:23:09.589596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 485/962] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Oct 31 12:23:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:23:09.594278 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be6965-93d7-4644-8ca7-452bb17119bf None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:09.689772 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be6965-93d7-4644-8ca7-452bb17119bf None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:09.721406 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072acbfb-a3fe-42dc-9bd7-caef27ef7cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:09.721989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072acbfb-a3fe-42dc-9bd7-caef27ef7cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:09.722264 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072acbfb-a3fe-42dc-9bd7-caef27ef7cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:09.722533 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072acbfb-a3fe-42dc-9bd7-caef27ef7cd8 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:09.723210 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072acbfb-a3fe-42dc-9bd7-caef27ef7cd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:23:09.723508 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072acbfb-a3fe-42dc-9bd7-caef27ef7cd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:09.724950 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072acbfb-a3fe-42dc-9bd7-caef27ef7cd8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:09.736096 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 478/963] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Oct 31 12:23:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:23:09.741923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e7b80-576d-41a5-ad96-8348d846c71b None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:09.844873 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:09.850912 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e7b80-576d-41a5-ad96-8348d846c71b None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:09.882981 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4db010-bde4-4333-bf2a-dd829aaa3c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:09.883571 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4db010-bde4-4333-bf2a-dd829aaa3c35 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:09.883849 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4db010-bde4-4333-bf2a-dd829aaa3c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:09.884117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4db010-bde4-4333-bf2a-dd829aaa3c35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:09.884825 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4db010-bde4-4333-bf2a-dd829aaa3c35 None admin] RBAC: Adding query filter params (role.id=e1b3a811029244d2a7e2664cd3246eec, scope.project.id=786ee416a639447ab3698d1f56d04e9a, user.id=18c015b8317b4517911f69bef21a0573) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:23:09.885148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4db010-bde4-4333-bf2a-dd829aaa3c35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:09.886544 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4db010-bde4-4333-bf2a-dd829aaa3c35 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:09.892820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 486/964] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Oct 31 12:23:09 2022] GET /identity/v3/role_assignments?user.id=18c015b8317b4517911f69bef21a0573&scope.project.id=786ee416a639447ab3698d1f56d04e9a&role.id=e1b3a811029244d2a7e2664cd3246eec => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:23:12.042941 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba69643-76dd-4e86-951c-b2972a16f4f2 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:12.043507 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba69643-76dd-4e86-951c-b2972a16f4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:12.043507 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba69643-76dd-4e86-951c-b2972a16f4f2 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:12.044822 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 479/965] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:23:12.050852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a90e0-fc04-490a-b1e4-3b26a43acc6b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:12.051251 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a90e0-fc04-490a-b1e4-3b26a43acc6b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:12.051410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a90e0-fc04-490a-b1e4-3b26a43acc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:12.070054 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-739a90e0-fc04-490a-b1e4-3b26a43acc6b None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:23:12.071246 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-739a90e0-fc04-490a-b1e4-3b26a43acc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:23:12.135793 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 487/966] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:23:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:23:12.409435 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba69643-76dd-4e86-951c-b2972a16f4f2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:12.439031 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:12.505495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba69643-76dd-4e86-951c-b2972a16f4f2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:12.537997 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d57d0-485e-4b0e-b4d8-d1a7370b1700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:12.538614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d57d0-485e-4b0e-b4d8-d1a7370b1700 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:12.538898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d57d0-485e-4b0e-b4d8-d1a7370b1700 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:12.539171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d57d0-485e-4b0e-b4d8-d1a7370b1700 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:12.539753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d57d0-485e-4b0e-b4d8-d1a7370b1700 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:12.541096 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d57d0-485e-4b0e-b4d8-d1a7370b1700 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:12.549647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-d16d57d0-485e-4b0e-b4d8-d1a7370b1700 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 12:23:12.549647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:23:12.549647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:23:12.549647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:23:12.549647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:23:12.549647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:23:12.549647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:23:12.549647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:23:12.549647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 12:23:12.549647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:23:12.549647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:23:12.549647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:23:12.549647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:23:12.549647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:23:12.549647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:23:12.549647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:23:12.549647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:23:12.550880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:23:12.550880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:23:12.550880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:23:12.550880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:23:12.550880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:23:12.550880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:23:12.550880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:23:12.550880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:23:12.550880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:23:12.550880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:23:12.550880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:23:12.550880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:23:12.550880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:23:12.550880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:23:12.550880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:23:12.550880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:23:12.551985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:23:12.551985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:23:12.551985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:23:12.551985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:23:12.551985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:23:12.551985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:23:12.551985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:23:12.551985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:23:12.551985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:23:12.551985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:23:12.551985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:23:12.551985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:23:12.551985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 12:23:12.551985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:23:12.551985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 480/967] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Oct 31 12:23:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:23:12.556635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a90e0-fc04-490a-b1e4-3b26a43acc6b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:12.643103 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:12.652717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a90e0-fc04-490a-b1e4-3b26a43acc6b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:12.686055 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d5a52-7922-4525-873c-9db248b0b03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:12.686591 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d5a52-7922-4525-873c-9db248b0b03b None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:12.686872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d5a52-7922-4525-873c-9db248b0b03b None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:12.687142 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d5a52-7922-4525-873c-9db248b0b03b None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:12.687768 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d5a52-7922-4525-873c-9db248b0b03b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:23:12.688070 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d5a52-7922-4525-873c-9db248b0b03b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:12.689961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d5a52-7922-4525-873c-9db248b0b03b None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:12.694637 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 488/968] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Oct 31 12:23:12 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:23:12.700309 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d57d0-485e-4b0e-b4d8-d1a7370b1700 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:12.796774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:12.804204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d57d0-485e-4b0e-b4d8-d1a7370b1700 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:12.842245 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafcd80-713c-42f9-bf3d-f7ba1d494aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:12.843013 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafcd80-713c-42f9-bf3d-f7ba1d494aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:12.843365 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafcd80-713c-42f9-bf3d-f7ba1d494aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:12.843755 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafcd80-713c-42f9-bf3d-f7ba1d494aa2 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:12.844453 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eafcd80-713c-42f9-bf3d-f7ba1d494aa2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:23:12.844876 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eafcd80-713c-42f9-bf3d-f7ba1d494aa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:12.846504 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eafcd80-713c-42f9-bf3d-f7ba1d494aa2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:12.851704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 481/969] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Oct 31 12:23:12 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:23:14.982010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8482a4e-7520-46ab-a79d-6a03a1b5d3d3 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:14.982546 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8482a4e-7520-46ab-a79d-6a03a1b5d3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:14.982546 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8482a4e-7520-46ab-a79d-6a03a1b5d3d3 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:14.983890 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 489/970] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:23:14.989625 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897b29a-c660-4815-b4f1-af386e04ece2 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:14.990047 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897b29a-c660-4815-b4f1-af386e04ece2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:14.990168 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897b29a-c660-4815-b4f1-af386e04ece2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:15.007734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d897b29a-c660-4815-b4f1-af386e04ece2 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:23:15.008910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d897b29a-c660-4815-b4f1-af386e04ece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:23:15.071548 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 482/971] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:23:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 12:23:15.335449 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8482a4e-7520-46ab-a79d-6a03a1b5d3d3 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:15.433004 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8482a4e-7520-46ab-a79d-6a03a1b5d3d3 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:15.465466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43762fd-1458-483b-b0b1-fa0a4b0924a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:15.466051 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43762fd-1458-483b-b0b1-fa0a4b0924a4 None admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:15.466329 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43762fd-1458-483b-b0b1-fa0a4b0924a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:15.466598 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43762fd-1458-483b-b0b1-fa0a4b0924a4 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:15.467246 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43762fd-1458-483b-b0b1-fa0a4b0924a4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:15.468590 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43762fd-1458-483b-b0b1-fa0a4b0924a4 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:15.483036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 490/972] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Oct 31 12:23:15 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:23:17.609560 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4af1c-c982-4bfa-a922-d48e9aca0e71 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:17.610148 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4af1c-c982-4bfa-a922-d48e9aca0e71 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:17.610148 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4af1c-c982-4bfa-a922-d48e9aca0e71 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:17.611955 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 483/973] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:23:17.617017 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cd13d-261c-4841-8515-af8d67b8ff43 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:17.617473 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cd13d-261c-4841-8515-af8d67b8ff43 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:17.617599 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cd13d-261c-4841-8515-af8d67b8ff43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:17.635877 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-b89cd13d-261c-4841-8515-af8d67b8ff43 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:23:17.637059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b89cd13d-261c-4841-8515-af8d67b8ff43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:23:17.646067 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:17.708994 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 491/974] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:23:17 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:23:17.988150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4af1c-c982-4bfa-a922-d48e9aca0e71 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:18.075191 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:18.085979 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4af1c-c982-4bfa-a922-d48e9aca0e71 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:18.119020 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20856e5d-823d-4e13-811a-2ab409cdc912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:18.119638 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20856e5d-823d-4e13-811a-2ab409cdc912 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:18.119919 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20856e5d-823d-4e13-811a-2ab409cdc912 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:18.120191 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20856e5d-823d-4e13-811a-2ab409cdc912 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:18.120771 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20856e5d-823d-4e13-811a-2ab409cdc912 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:18.122153 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20856e5d-823d-4e13-811a-2ab409cdc912 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:18.130683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-20856e5d-823d-4e13-811a-2ab409cdc912 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 12:23:18.130683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:23:18.130683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:23:18.130683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:23:18.130683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:23:18.130683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:23:18.130683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:23:18.130683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:23:18.130683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 12:23:18.130683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:23:18.130683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:23:18.130683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:23:18.130683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:23:18.130683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:23:18.130683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:23:18.130683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:23:18.130683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:23:18.131969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:23:18.131969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:23:18.131969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:23:18.131969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:23:18.131969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:23:18.131969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:23:18.131969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:23:18.131969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:23:18.131969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:23:18.131969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:23:18.131969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:23:18.131969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:23:18.131969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:23:18.131969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:23:18.131969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:23:18.131969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:23:18.133195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:23:18.133195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:23:18.133195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:23:18.133195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:23:18.133195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:23:18.133195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:23:18.133195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:23:18.133195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:23:18.133195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:23:18.133195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:23:18.133195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:23:18.133195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:23:18.133195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 12:23:18.133195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:23:18.133195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 484/975] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Oct 31 12:23:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:23:18.137791 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cd13d-261c-4841-8515-af8d67b8ff43 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:18.233689 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cd13d-261c-4841-8515-af8d67b8ff43 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:18.266173 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc0cf4-5b70-4646-86f5-4c1e9b158cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:18.266704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc0cf4-5b70-4646-86f5-4c1e9b158cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:18.266980 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc0cf4-5b70-4646-86f5-4c1e9b158cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:18.267248 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc0cf4-5b70-4646-86f5-4c1e9b158cc2 None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:18.267867 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc0cf4-5b70-4646-86f5-4c1e9b158cc2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:23:18.268163 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc0cf4-5b70-4646-86f5-4c1e9b158cc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:18.269562 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc0cf4-5b70-4646-86f5-4c1e9b158cc2 None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:18.274412 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 492/976] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Oct 31 12:23:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:23:18.280129 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20856e5d-823d-4e13-811a-2ab409cdc912 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:18.377126 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20856e5d-823d-4e13-811a-2ab409cdc912 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:18.409924 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8830a8-99c4-4421-b3b0-e2c78beb573c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:18.410506 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8830a8-99c4-4421-b3b0-e2c78beb573c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:18.410788 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8830a8-99c4-4421-b3b0-e2c78beb573c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:18.411060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8830a8-99c4-4421-b3b0-e2c78beb573c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:18.411753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8830a8-99c4-4421-b3b0-e2c78beb573c None admin] RBAC: Adding query filter params (interface=public, service_id=3b06975bed244da9a5e925220111e4ee, region_id=RegionOne) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:23:18.412061 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8830a8-99c4-4421-b3b0-e2c78beb573c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:18.413425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8830a8-99c4-4421-b3b0-e2c78beb573c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:18.418786 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 485/977] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Oct 31 12:23:18 2022] GET /identity/v3/endpoints?service_id=3b06975bed244da9a5e925220111e4ee&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:23:18.424586 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc0cf4-5b70-4646-86f5-4c1e9b158cc2 None admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:18.428303 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:18.520167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc0cf4-5b70-4646-86f5-4c1e9b158cc2 None admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:18.552930 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db70bf3-7293-493b-9b82-dc1adb1dc61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:18.553541 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db70bf3-7293-493b-9b82-dc1adb1dc61a None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:18.553821 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db70bf3-7293-493b-9b82-dc1adb1dc61a None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:18.554091 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db70bf3-7293-493b-9b82-dc1adb1dc61a None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:18.554686 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db70bf3-7293-493b-9b82-dc1adb1dc61a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:18.556033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db70bf3-7293-493b-9b82-dc1adb1dc61a None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:18.562655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 493/978] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Oct 31 12:23:18 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:23:20.675624 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d72877-186e-46b0-932a-c32aeb268435 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:20.676170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d72877-186e-46b0-932a-c32aeb268435 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:20.676170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d72877-186e-46b0-932a-c32aeb268435 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:20.677531 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 486/979] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:23:20.682545 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb29257-37e3-40d4-9250-7b688bff4d10 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:20.682960 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb29257-37e3-40d4-9250-7b688bff4d10 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:20.683091 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb29257-37e3-40d4-9250-7b688bff4d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:20.702295 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-1cb29257-37e3-40d4-9250-7b688bff4d10 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:23:20.703469 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1cb29257-37e3-40d4-9250-7b688bff4d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:23:20.762098 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:20.768591 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 494/980] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:23:20 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 12:23:21.045428 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d72877-186e-46b0-932a-c32aeb268435 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:21.064610 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:21.142872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d72877-186e-46b0-932a-c32aeb268435 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:21.175265 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1232a66-e0f6-4bda-9fd3-1985255f70be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:21.175892 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1232a66-e0f6-4bda-9fd3-1985255f70be None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:21.176150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1232a66-e0f6-4bda-9fd3-1985255f70be None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:21.176415 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1232a66-e0f6-4bda-9fd3-1985255f70be None admin] PATH_INFO: `/v3/services/placement` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:21.176987 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1232a66-e0f6-4bda-9fd3-1985255f70be None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:21.178350 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1232a66-e0f6-4bda-9fd3-1985255f70be None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:21.186695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-d1232a66-e0f6-4bda-9fd3-1985255f70be None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 12:23:21.186695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:23:21.186695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 12:23:21.186695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 12:23:21.186695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 12:23:21.186695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 12:23:21.186695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 12:23:21.186695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:23:21.186695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 12:23:21.186695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:23:21.186695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 12:23:21.186695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:23:21.186695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 12:23:21.186695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 12:23:21.186695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 12:23:21.186695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 12:23:21.186695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 12:23:21.187867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 12:23:21.187867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 12:23:21.187867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 12:23:21.187867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 12:23:21.187867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 12:23:21.187867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 12:23:21.187867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 12:23:21.187867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 12:23:21.187867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 12:23:21.187867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 12:23:21.187867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 12:23:21.187867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 12:23:21.187867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 12:23:21.187867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 12:23:21.187867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 12:23:21.187867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 12:23:21.188761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 12:23:21.188761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Oct 31 12:23:21.188761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 12:23:21.188761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Oct 31 12:23:21.188761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 12:23:21.188761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 12:23:21.188761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 12:23:21.188761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Oct 31 12:23:21.188761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 12:23:21.188761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Oct 31 12:23:21.188761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 12:23:21.188761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 12:23:21.188761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 12:23:21.188761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Oct 31 12:23:21.188761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 487/981] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Oct 31 12:23:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 12:23:21.193842 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb29257-37e3-40d4-9250-7b688bff4d10 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:21.288336 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb29257-37e3-40d4-9250-7b688bff4d10 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:21.320608 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05245afc-a1ed-4f24-b613-f4c0116ec6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:21.321159 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05245afc-a1ed-4f24-b613-f4c0116ec6cf None admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:21.321438 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05245afc-a1ed-4f24-b613-f4c0116ec6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:21.321706 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05245afc-a1ed-4f24-b613-f4c0116ec6cf None admin] PATH_INFO: `/v3/services` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:21.322322 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05245afc-a1ed-4f24-b613-f4c0116ec6cf None admin] RBAC: Adding query filter params (name=placement) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:23:21.322616 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05245afc-a1ed-4f24-b613-f4c0116ec6cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:21.323949 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05245afc-a1ed-4f24-b613-f4c0116ec6cf None admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:21.328865 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 495/982] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Oct 31 12:23:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:23:21.334954 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1232a66-e0f6-4bda-9fd3-1985255f70be None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:23:21.413600 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:21.430835 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1232a66-e0f6-4bda-9fd3-1985255f70be None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:23:21.462654 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c25e49-5ae3-4b81-917d-84965d0795ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:23:21.463237 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c25e49-5ae3-4b81-917d-84965d0795ae None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:23:21.463513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c25e49-5ae3-4b81-917d-84965d0795ae None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:23:21.463782 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c25e49-5ae3-4b81-917d-84965d0795ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:23:21.464442 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c25e49-5ae3-4b81-917d-84965d0795ae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:23:21.465793 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c25e49-5ae3-4b81-917d-84965d0795ae None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:23:21.485328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 488/983] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:23:21 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:23:31.326071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=69 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:23:31.481244 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:24:25.345936 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c49ab-8a31-4758-b1a3-db5c0729e441 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:25.346390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c49ab-8a31-4758-b1a3-db5c0729e441 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:25.346486 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c49ab-8a31-4758-b1a3-db5c0729e441 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:25.347994 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 496/984] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:24:25.353301 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59d490-6548-4772-a3c1-5e8d952fe700 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:25.353782 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59d490-6548-4772-a3c1-5e8d952fe700 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:25.353862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59d490-6548-4772-a3c1-5e8d952fe700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:25.441681 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1a59d490-6548-4772-a3c1-5e8d952fe700 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:24:25.442903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1a59d490-6548-4772-a3c1-5e8d952fe700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:25.602567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 489/985] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:24:25.921574 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5c629-9944-40af-b35d-276a81000f92 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:25.921873 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5c629-9944-40af-b35d-276a81000f92 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:25.922141 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5c629-9944-40af-b35d-276a81000f92 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:25.923639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 497/986] 10.222.0.18 () {54 vars in 965 bytes} [Mon Oct 31 12:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:24:25.941883 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae616e5-e94f-4815-8634-708ce771eabe None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:25.944151 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae616e5-e94f-4815-8634-708ce771eabe None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:25.944457 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae616e5-e94f-4815-8634-708ce771eabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:26.043835 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1ae616e5-e94f-4815-8634-708ce771eabe None None] MFA Rules not processed for user `7179d21011064d5b91d0e35a51b8adae`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:24:26.045123 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1ae616e5-e94f-4815-8634-708ce771eabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:26.071253 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:24:26.136301 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 490/987] 10.222.0.18 () {58 vars in 1062 bytes} [Mon Oct 31 12:24:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:24:26.145945 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5c629-9944-40af-b35d-276a81000f92 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:24:26.147714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c5a5c629-9944-40af-b35d-276a81000f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:26.270020 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5c629-9944-40af-b35d-276a81000f92 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:24:26.355122 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ed61b-9d73-49a9-bbde-e39e8770358e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:24:26.355780 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ed61b-9d73-49a9-bbde-e39e8770358e service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:26.356016 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ed61b-9d73-49a9-bbde-e39e8770358e service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:26.356467 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ed61b-9d73-49a9-bbde-e39e8770358e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:26.358572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-663ed61b-9d73-49a9-bbde-e39e8770358e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:26.421714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:24:26.484665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ed61b-9d73-49a9-bbde-e39e8770358e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:24:26.486054 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ed61b-9d73-49a9-bbde-e39e8770358e service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:24:26.521460 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 498/988] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:24:28.991294 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521af53-9ac2-4341-a945-115fd707db78 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:28.991750 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521af53-9ac2-4341-a945-115fd707db78 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:28.991839 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521af53-9ac2-4341-a945-115fd707db78 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:28.993238 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 491/989] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:24:28.998618 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac8c35-5290-41e1-815a-f67fe815755e None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:28.999045 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac8c35-5290-41e1-815a-f67fe815755e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:28.999179 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac8c35-5290-41e1-815a-f67fe815755e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:29.072460 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-84ac8c35-5290-41e1-815a-f67fe815755e None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:24:29.073716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-84ac8c35-5290-41e1-815a-f67fe815755e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:29.169618 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 499/990] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:24:29.450447 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521af53-9ac2-4341-a945-115fd707db78 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:24:29.451982 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8521af53-9ac2-4341-a945-115fd707db78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:29.554118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521af53-9ac2-4341-a945-115fd707db78 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:24:29.623236 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:24:29.625892 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbddde-f82d-4636-9c45-61b754ad68f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:24:29.626780 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbddde-f82d-4636-9c45-61b754ad68f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:29.627105 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbddde-f82d-4636-9c45-61b754ad68f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:29.627545 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbddde-f82d-4636-9c45-61b754ad68f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:29.629327 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-13cbddde-f82d-4636-9c45-61b754ad68f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:29.736670 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbddde-f82d-4636-9c45-61b754ad68f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:24:29.738114 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbddde-f82d-4636-9c45-61b754ad68f8 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:24:29.755477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 492/991] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:24:32.194319 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60756514-5117-42e0-a26d-1b04e6388043 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:32.194850 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60756514-5117-42e0-a26d-1b04e6388043 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:32.194850 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60756514-5117-42e0-a26d-1b04e6388043 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:32.196225 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 500/992] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:24:32.201456 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d8ed4-687a-4dc3-a096-13d3aa2fb077 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:32.201828 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d8ed4-687a-4dc3-a096-13d3aa2fb077 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:32.201999 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d8ed4-687a-4dc3-a096-13d3aa2fb077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:32.266645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-576d8ed4-687a-4dc3-a096-13d3aa2fb077 None None] MFA Rules not processed for user `1ac8a34c1c5541d29cb91cfa44b9e4eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:24:32.267842 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-576d8ed4-687a-4dc3-a096-13d3aa2fb077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:32.318118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:24:32.361638 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 493/993] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:24:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:24:32.645756 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60756514-5117-42e0-a26d-1b04e6388043 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:24:32.647315 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-60756514-5117-42e0-a26d-1b04e6388043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:32.657242 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:24:32.750886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60756514-5117-42e0-a26d-1b04e6388043 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:24:32.824905 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201846c5-3369-4c3a-84ef-1fafeae3b41e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:24:32.825535 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201846c5-3369-4c3a-84ef-1fafeae3b41e service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:32.825816 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201846c5-3369-4c3a-84ef-1fafeae3b41e service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:32.826088 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201846c5-3369-4c3a-84ef-1fafeae3b41e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:32.827678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-201846c5-3369-4c3a-84ef-1fafeae3b41e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:32.887806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:24:32.933308 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201846c5-3369-4c3a-84ef-1fafeae3b41e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:24:32.934657 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201846c5-3369-4c3a-84ef-1fafeae3b41e service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:24:32.953146 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 501/994] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:24:32 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:24:35.634079 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46c12d-8d5a-40ea-aaac-78caa219a97a None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:35.634630 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46c12d-8d5a-40ea-aaac-78caa219a97a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:35.634630 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46c12d-8d5a-40ea-aaac-78caa219a97a None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:35.635974 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 494/995] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:24:35.641744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b045c1-d3a6-45c6-8c14-46f2bcf00ec2 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:35.642168 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b045c1-d3a6-45c6-8c14-46f2bcf00ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:35.642283 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b045c1-d3a6-45c6-8c14-46f2bcf00ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:35.707662 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-69b045c1-d3a6-45c6-8c14-46f2bcf00ec2 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:24:35.708865 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-69b045c1-d3a6-45c6-8c14-46f2bcf00ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:35.805415 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 502/996] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:24:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:24:36.087743 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46c12d-8d5a-40ea-aaac-78caa219a97a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:24:36.089325 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fa46c12d-8d5a-40ea-aaac-78caa219a97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:36.189779 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46c12d-8d5a-40ea-aaac-78caa219a97a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:24:36.260497 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ea450-6b0e-4d76-8723-e94da97a23ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:24:36.261101 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ea450-6b0e-4d76-8723-e94da97a23ce service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:36.261422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ea450-6b0e-4d76-8723-e94da97a23ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:36.261683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ea450-6b0e-4d76-8723-e94da97a23ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:36.263248 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ee1ea450-6b0e-4d76-8723-e94da97a23ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:36.270516 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:24:36.369360 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ea450-6b0e-4d76-8723-e94da97a23ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:24:36.370776 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ea450-6b0e-4d76-8723-e94da97a23ce service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:24:36.388518 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 495/997] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:24:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:24:39.142379 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a015f26-80a8-4bf1-aca0-f034906148f7 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:39.142902 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a015f26-80a8-4bf1-aca0-f034906148f7 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:39.142902 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a015f26-80a8-4bf1-aca0-f034906148f7 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:39.144337 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 503/998] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:24:39.149577 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eace9c-e0e9-4b9f-b3c5-4b69af1a6725 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:39.149993 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eace9c-e0e9-4b9f-b3c5-4b69af1a6725 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:39.150136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eace9c-e0e9-4b9f-b3c5-4b69af1a6725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:39.221758 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b3eace9c-e0e9-4b9f-b3c5-4b69af1a6725 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:24:39.223007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b3eace9c-e0e9-4b9f-b3c5-4b69af1a6725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:39.284553 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:24:39.327124 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 496/999] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:24:39.612035 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a015f26-80a8-4bf1-aca0-f034906148f7 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:24:39.613613 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0a015f26-80a8-4bf1-aca0-f034906148f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:39.633537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:24:39.717221 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a015f26-80a8-4bf1-aca0-f034906148f7 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:24:39.792529 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd9923-d0af-4349-bc2d-15529fc320cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:24:39.793158 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd9923-d0af-4349-bc2d-15529fc320cb service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:39.793442 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd9923-d0af-4349-bc2d-15529fc320cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:39.793713 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd9923-d0af-4349-bc2d-15529fc320cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:39.795283 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c0dd9923-d0af-4349-bc2d-15529fc320cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:39.866161 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:24:39.903614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd9923-d0af-4349-bc2d-15529fc320cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:24:39.905052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd9923-d0af-4349-bc2d-15529fc320cb service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:24:39.924000 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 504/1000] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:24:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:24:42.132190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e59a45-c44e-425f-9a36-96e134feb2a1 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:42.132710 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e59a45-c44e-425f-9a36-96e134feb2a1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:42.132710 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e59a45-c44e-425f-9a36-96e134feb2a1 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:42.134132 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 497/1001] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:24:42.139512 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b2561-a80c-4ddd-b5a0-3c2bf5654d0f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:42.139898 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b2561-a80c-4ddd-b5a0-3c2bf5654d0f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:42.140647 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b2561-a80c-4ddd-b5a0-3c2bf5654d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:42.207265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f36b2561-a80c-4ddd-b5a0-3c2bf5654d0f None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:24:42.208470 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f36b2561-a80c-4ddd-b5a0-3c2bf5654d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:42.314571 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 505/1002] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:24:42.593373 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e59a45-c44e-425f-9a36-96e134feb2a1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:24:42.594906 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-13e59a45-c44e-425f-9a36-96e134feb2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:42.703755 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e59a45-c44e-425f-9a36-96e134feb2a1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:24:42.776246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122754b-f32d-400f-82b9-e2df01be02cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:24:42.776883 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122754b-f32d-400f-82b9-e2df01be02cb service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:42.777195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122754b-f32d-400f-82b9-e2df01be02cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:42.777472 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122754b-f32d-400f-82b9-e2df01be02cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:42.779054 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3122754b-f32d-400f-82b9-e2df01be02cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:42.797567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:24:42.891799 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122754b-f32d-400f-82b9-e2df01be02cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:24:42.893293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122754b-f32d-400f-82b9-e2df01be02cb service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:24:42.911637 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 498/1003] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:24:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:24:45.120505 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced7cfc-c641-4e62-91ce-b2c51636f3b9 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:45.120997 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced7cfc-c641-4e62-91ce-b2c51636f3b9 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:45.121134 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced7cfc-c641-4e62-91ce-b2c51636f3b9 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:45.122556 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 506/1004] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:24:45.128371 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c293c1d-c3f4-42a9-8a57-51542e9e9434 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:45.128819 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c293c1d-c3f4-42a9-8a57-51542e9e9434 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:45.128912 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c293c1d-c3f4-42a9-8a57-51542e9e9434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:45.196095 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9c293c1d-c3f4-42a9-8a57-51542e9e9434 None None] MFA Rules not processed for user `1ac8a34c1c5541d29cb91cfa44b9e4eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:24:45.197278 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9c293c1d-c3f4-42a9-8a57-51542e9e9434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:45.267770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:24:45.300285 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 499/1005] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:24:45 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:24:45.584165 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced7cfc-c641-4e62-91ce-b2c51636f3b9 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:24:45.585606 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0ced7cfc-c641-4e62-91ce-b2c51636f3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:45.617420 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:24:45.690160 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced7cfc-c641-4e62-91ce-b2c51636f3b9 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:24:45.762672 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb17d6a-50dc-4bfc-9015-940e4d106e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:24:45.763192 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb17d6a-50dc-4bfc-9015-940e4d106e71 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:45.763467 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb17d6a-50dc-4bfc-9015-940e4d106e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:45.763731 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb17d6a-50dc-4bfc-9015-940e4d106e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:45.765350 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5eb17d6a-50dc-4bfc-9015-940e4d106e71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:45.841804 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:24:45.874210 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb17d6a-50dc-4bfc-9015-940e4d106e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:24:45.875555 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb17d6a-50dc-4bfc-9015-940e4d106e71 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:24:45.897054 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 507/1006] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:24:45 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:24:48.258949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08f12c-44c0-4fbd-bef6-3602205c1c65 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:48.259547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08f12c-44c0-4fbd-bef6-3602205c1c65 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:48.259547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08f12c-44c0-4fbd-bef6-3602205c1c65 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:48.260830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 500/1007] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:24:48.266565 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cb7f6-04f4-4c98-8c25-0a0340f50b9c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:48.267044 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cb7f6-04f4-4c98-8c25-0a0340f50b9c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:48.267142 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cb7f6-04f4-4c98-8c25-0a0340f50b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:48.332502 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-615cb7f6-04f4-4c98-8c25-0a0340f50b9c None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:24:48.333654 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-615cb7f6-04f4-4c98-8c25-0a0340f50b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:48.428317 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 508/1008] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:24:48.703510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08f12c-44c0-4fbd-bef6-3602205c1c65 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:24:48.705021 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bc08f12c-44c0-4fbd-bef6-3602205c1c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:48.804826 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08f12c-44c0-4fbd-bef6-3602205c1c65 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:24:48.877092 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6602f3f-4ca5-48fa-a776-0b8bc72d8f8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:24:48.877718 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6602f3f-4ca5-48fa-a776-0b8bc72d8f8e service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:48.877997 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6602f3f-4ca5-48fa-a776-0b8bc72d8f8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:48.878269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6602f3f-4ca5-48fa-a776-0b8bc72d8f8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:48.879829 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b6602f3f-4ca5-48fa-a776-0b8bc72d8f8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:48.906157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:24:48.985944 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6602f3f-4ca5-48fa-a776-0b8bc72d8f8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:24:48.987274 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6602f3f-4ca5-48fa-a776-0b8bc72d8f8e service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:24:49.004850 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 501/1009] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:24:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:24:51.172838 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb0069-d7ba-44f8-86a4-74e4202ea36a None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:51.173411 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb0069-d7ba-44f8-86a4-74e4202ea36a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:51.173411 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb0069-d7ba-44f8-86a4-74e4202ea36a None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:51.174791 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 509/1010] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:24:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:24:51.180076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ed388-f879-4f82-ae55-34ad9cf483a4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:51.180456 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ed388-f879-4f82-ae55-34ad9cf483a4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:51.180623 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ed388-f879-4f82-ae55-34ad9cf483a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:51.245397 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b97ed388-f879-4f82-ae55-34ad9cf483a4 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:24:51.246598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b97ed388-f879-4f82-ae55-34ad9cf483a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:51.319287 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:24:51.341203 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 502/1011] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:24:51.621941 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb0069-d7ba-44f8-86a4-74e4202ea36a None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:24:51.623459 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8ddb0069-d7ba-44f8-86a4-74e4202ea36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:51.663514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:24:51.725573 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb0069-d7ba-44f8-86a4-74e4202ea36a None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:24:51.797301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d998db-a9ec-4b1a-9790-b46025645113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:24:51.797904 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d998db-a9ec-4b1a-9790-b46025645113 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:51.798178 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d998db-a9ec-4b1a-9790-b46025645113 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:51.798466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d998db-a9ec-4b1a-9790-b46025645113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:51.800014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-13d998db-a9ec-4b1a-9790-b46025645113 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:51.881096 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:24:51.906528 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d998db-a9ec-4b1a-9790-b46025645113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:24:51.907940 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d998db-a9ec-4b1a-9790-b46025645113 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:24:51.925553 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 510/1012] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:24:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:24:54.381480 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864bc65-40ff-4c62-ab5a-508ca3e6e266 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:54.382062 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864bc65-40ff-4c62-ab5a-508ca3e6e266 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:54.382062 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864bc65-40ff-4c62-ab5a-508ca3e6e266 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:54.383411 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 503/1013] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:24:54.388569 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56f705-4b71-4f3a-90d2-978f93aca3be None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:54.389024 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56f705-4b71-4f3a-90d2-978f93aca3be None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:54.389147 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56f705-4b71-4f3a-90d2-978f93aca3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:54.454710 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-cc56f705-4b71-4f3a-90d2-978f93aca3be None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:24:54.455903 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-cc56f705-4b71-4f3a-90d2-978f93aca3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:54.550279 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 511/1014] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:24:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:24:54.835473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864bc65-40ff-4c62-ab5a-508ca3e6e266 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:24:54.836997 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3864bc65-40ff-4c62-ab5a-508ca3e6e266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:54.940837 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864bc65-40ff-4c62-ab5a-508ca3e6e266 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:24:55.012962 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7868c7-5429-4dab-b1d2-ec4e660a6d59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:24:55.013612 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7868c7-5429-4dab-b1d2-ec4e660a6d59 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:55.013893 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7868c7-5429-4dab-b1d2-ec4e660a6d59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:55.014164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7868c7-5429-4dab-b1d2-ec4e660a6d59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:55.016376 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ba7868c7-5429-4dab-b1d2-ec4e660a6d59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:55.051324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:24:55.123878 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7868c7-5429-4dab-b1d2-ec4e660a6d59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:24:55.126020 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7868c7-5429-4dab-b1d2-ec4e660a6d59 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:24:55.143530 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 504/1015] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:24:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:24:59.162554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75574d-400f-4d58-801b-f30f1f1da8a2 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:59.163105 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75574d-400f-4d58-801b-f30f1f1da8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:59.163105 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75574d-400f-4d58-801b-f30f1f1da8a2 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:59.164433 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 512/1016] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:24:59.169633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f632b-0b7c-4f80-a932-b5ea8b890b34 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:59.170049 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f632b-0b7c-4f80-a932-b5ea8b890b34 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:59.170262 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f632b-0b7c-4f80-a932-b5ea8b890b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:59.237548 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-506f632b-0b7c-4f80-a932-b5ea8b890b34 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:24:59.238753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-506f632b-0b7c-4f80-a932-b5ea8b890b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:59.325449 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:24:59.336135 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 505/1017] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:24:59.618303 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75574d-400f-4d58-801b-f30f1f1da8a2 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:24:59.619884 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-dd75574d-400f-4d58-801b-f30f1f1da8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:59.669926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:24:59.725829 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75574d-400f-4d58-801b-f30f1f1da8a2 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:24:59.799331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e87be8-4929-4a66-a5ba-186d1ed0badc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:24:59.799939 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e87be8-4929-4a66-a5ba-186d1ed0badc service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:24:59.800216 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e87be8-4929-4a66-a5ba-186d1ed0badc service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:24:59.800485 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e87be8-4929-4a66-a5ba-186d1ed0badc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:24:59.802062 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-44e87be8-4929-4a66-a5ba-186d1ed0badc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:24:59.893483 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:24:59.911131 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e87be8-4929-4a66-a5ba-186d1ed0badc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:24:59.912560 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e87be8-4929-4a66-a5ba-186d1ed0badc service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:24:59.930270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 513/1018] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:24:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:25:02.712785 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830c7e7-6428-4a94-8d63-0c44beb18ed0 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:02.713394 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830c7e7-6428-4a94-8d63-0c44beb18ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:02.713394 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830c7e7-6428-4a94-8d63-0c44beb18ed0 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:02.714720 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 506/1019] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:25:02.720596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97310618-9164-4b99-b8fa-891d7ddf8ff7 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:02.721005 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97310618-9164-4b99-b8fa-891d7ddf8ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:02.721179 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97310618-9164-4b99-b8fa-891d7ddf8ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:02.787518 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-97310618-9164-4b99-b8fa-891d7ddf8ff7 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:02.788880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-97310618-9164-4b99-b8fa-891d7ddf8ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:02.894479 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 514/1020] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:25:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:25:03.182360 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830c7e7-6428-4a94-8d63-0c44beb18ed0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:25:03.183930 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4830c7e7-6428-4a94-8d63-0c44beb18ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:03.294362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830c7e7-6428-4a94-8d63-0c44beb18ed0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:25:03.366609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c71efe-8f3b-4d8f-bacc-76456ecd620b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:25:03.367218 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c71efe-8f3b-4d8f-bacc-76456ecd620b service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:03.367621 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c71efe-8f3b-4d8f-bacc-76456ecd620b service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:03.367898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c71efe-8f3b-4d8f-bacc-76456ecd620b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:03.369539 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-48c71efe-8f3b-4d8f-bacc-76456ecd620b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:03.412791 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:03.479226 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c71efe-8f3b-4d8f-bacc-76456ecd620b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:25:03.480660 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c71efe-8f3b-4d8f-bacc-76456ecd620b service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:25:03.500553 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 507/1021] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:25:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:25:07.574016 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a79e56-b616-42a3-a323-ac5ec0f2c628 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:07.574927 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a79e56-b616-42a3-a323-ac5ec0f2c628 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:07.575280 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a79e56-b616-42a3-a323-ac5ec0f2c628 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:07.578861 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 515/1022] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:25:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:25:07.583574 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab82f8-bd75-4e55-beb1-74936caeada5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:07.584546 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab82f8-bd75-4e55-beb1-74936caeada5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:07.584957 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab82f8-bd75-4e55-beb1-74936caeada5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:07.662005 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f4ab82f8-bd75-4e55-beb1-74936caeada5 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:07.663282 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f4ab82f8-bd75-4e55-beb1-74936caeada5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:07.762895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:07.766200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 508/1023] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:25:08.050168 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a79e56-b616-42a3-a323-ac5ec0f2c628 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:25:08.051687 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f5a79e56-b616-42a3-a323-ac5ec0f2c628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:08.109611 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:08.154004 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a79e56-b616-42a3-a323-ac5ec0f2c628 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:25:08.226379 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfebdd3-2932-4c7e-b21d-5bf5953e87d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:25:08.226981 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfebdd3-2932-4c7e-b21d-5bf5953e87d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:08.227261 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfebdd3-2932-4c7e-b21d-5bf5953e87d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:08.227531 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfebdd3-2932-4c7e-b21d-5bf5953e87d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:08.229129 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6cfebdd3-2932-4c7e-b21d-5bf5953e87d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:08.331553 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:08.335955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfebdd3-2932-4c7e-b21d-5bf5953e87d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:25:08.337391 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfebdd3-2932-4c7e-b21d-5bf5953e87d1 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:25:08.354659 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 516/1024] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:25:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:25:13.230639 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6bc76-df8b-44fa-8e3f-cc5faf75b0c1 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:13.231072 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6bc76-df8b-44fa-8e3f-cc5faf75b0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:13.236701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6bc76-df8b-44fa-8e3f-cc5faf75b0c1 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:13.236701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 509/1025] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 31 12:25:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:25:13.242943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec02485-d96c-4835-b6c8-a43bd0442ce3 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:13.242943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec02485-d96c-4835-b6c8-a43bd0442ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:13.242943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec02485-d96c-4835-b6c8-a43bd0442ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:13.393010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3ec02485-d96c-4835-b6c8-a43bd0442ce3 None None] MFA Rules not processed for user `18c015b8317b4517911f69bef21a0573`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:13.394350 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3ec02485-d96c-4835-b6c8-a43bd0442ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:13.514826 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 517/1026] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 31 12:25:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:25:17.592057 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3b0dd-06fe-473b-8511-51da77daa92b None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:17.593193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3b0dd-06fe-473b-8511-51da77daa92b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:17.593607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3b0dd-06fe-473b-8511-51da77daa92b None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:17.595073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 510/1027] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 31 12:25:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:25:17.600510 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bfdd9-d949-4356-81fc-2b318900c879 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:17.600919 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bfdd9-d949-4356-81fc-2b318900c879 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:17.601148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bfdd9-d949-4356-81fc-2b318900c879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:17.660766 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:17.685664 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-134bfdd9-d949-4356-81fc-2b318900c879 None None] MFA Rules not processed for user `18c015b8317b4517911f69bef21a0573`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:17.687259 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-134bfdd9-d949-4356-81fc-2b318900c879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:17.800096 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 518/1028] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 31 12:25:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:25:19.153544 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33515b4-f9e9-415d-a36f-415dbf8edbab None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:19.154117 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33515b4-f9e9-415d-a36f-415dbf8edbab None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:19.154117 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33515b4-f9e9-415d-a36f-415dbf8edbab None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:19.156011 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 511/1029] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 31 12:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:25:19.161197 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad830427-059c-4048-be6c-c98ceaba9d7d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:19.161618 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad830427-059c-4048-be6c-c98ceaba9d7d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:19.161888 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad830427-059c-4048-be6c-c98ceaba9d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:19.239099 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ad830427-059c-4048-be6c-c98ceaba9d7d None None] MFA Rules not processed for user `18c015b8317b4517911f69bef21a0573`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:19.240302 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ad830427-059c-4048-be6c-c98ceaba9d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:19.282734 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:19.347847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 519/1030] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 31 12:25:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:25:22.909176 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afe894-3054-4666-85b3-9b16f6c08f22 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:22.909707 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afe894-3054-4666-85b3-9b16f6c08f22 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:22.909707 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afe894-3054-4666-85b3-9b16f6c08f22 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:22.911447 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 512/1031] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:25:22.916702 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ffa9b-f92d-4cff-8528-8a0a4b26dacf None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:22.917133 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ffa9b-f92d-4cff-8528-8a0a4b26dacf None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:22.917232 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ffa9b-f92d-4cff-8528-8a0a4b26dacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:22.985447 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ba2ffa9b-f92d-4cff-8528-8a0a4b26dacf None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:22.986647 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ba2ffa9b-f92d-4cff-8528-8a0a4b26dacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:23.090062 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 520/1032] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:25:23.390294 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8da75-da72-4bff-89eb-570be8b8f2c2 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:23.390874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8da75-da72-4bff-89eb-570be8b8f2c2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:23.391372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8da75-da72-4bff-89eb-570be8b8f2c2 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:23.393763 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 513/1033] 10.222.0.18 () {54 vars in 961 bytes} [Mon Oct 31 12:25:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:25:23.403475 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9e08f-c4e5-464c-a7cf-cdab34d39eb2 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:23.403825 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9e08f-c4e5-464c-a7cf-cdab34d39eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:23.404231 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9e08f-c4e5-464c-a7cf-cdab34d39eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:23.426130 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:23.490040 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-0fe9e08f-c4e5-464c-a7cf-cdab34d39eb2 None None] MFA Rules not processed for user `d93ce5759e0648a1934ff4d9c9d8fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:23.491314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0fe9e08f-c4e5-464c-a7cf-cdab34d39eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:23.618242 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 521/1034] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Oct 31 12:25:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:25:23.626641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8da75-da72-4bff-89eb-570be8b8f2c2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:25:23.628271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2dc8da75-da72-4bff-89eb-570be8b8f2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:23.789022 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8da75-da72-4bff-89eb-570be8b8f2c2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:25:23.866622 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:23.911017 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7089db7-3671-4e60-97c4-4e45123fd6aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:25:23.911802 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7089db7-3671-4e60-97c4-4e45123fd6aa service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:23.912207 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7089db7-3671-4e60-97c4-4e45123fd6aa service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:23.912566 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7089db7-3671-4e60-97c4-4e45123fd6aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:23.914685 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e7089db7-3671-4e60-97c4-4e45123fd6aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:24.017044 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7089db7-3671-4e60-97c4-4e45123fd6aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:25:24.018752 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7089db7-3671-4e60-97c4-4e45123fd6aa service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:25:24.038640 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 514/1035] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:25:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:25:26.419341 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f190c1-4378-4347-9e8b-3629c4101d3f None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:26.419954 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f190c1-4378-4347-9e8b-3629c4101d3f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:26.419954 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f190c1-4378-4347-9e8b-3629c4101d3f None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:26.422326 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 522/1036] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:25:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:25:26.427634 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c7c8d-acf7-43a5-81dd-a2b0684ee4b6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:26.428101 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c7c8d-acf7-43a5-81dd-a2b0684ee4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:26.428101 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c7c8d-acf7-43a5-81dd-a2b0684ee4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:26.500131 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-915c7c8d-acf7-43a5-81dd-a2b0684ee4b6 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:26.501469 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-915c7c8d-acf7-43a5-81dd-a2b0684ee4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:26.546150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:26.609866 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 515/1037] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:25:26.899035 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f190c1-4378-4347-9e8b-3629c4101d3f None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:25:26.900784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-51f190c1-4378-4347-9e8b-3629c4101d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:26.973613 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:27.086351 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f190c1-4378-4347-9e8b-3629c4101d3f None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:25:27.219987 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591d91a-d518-4339-9c5b-ce8a79135d69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:25:27.220596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591d91a-d518-4339-9c5b-ce8a79135d69 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:27.220874 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591d91a-d518-4339-9c5b-ce8a79135d69 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:27.221174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591d91a-d518-4339-9c5b-ce8a79135d69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:27.222757 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3591d91a-d518-4339-9c5b-ce8a79135d69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:27.249472 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:27.319975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591d91a-d518-4339-9c5b-ce8a79135d69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:25:27.321522 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591d91a-d518-4339-9c5b-ce8a79135d69 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:25:27.340494 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 523/1038] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:25:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:25:29.820878 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337806b-de6b-4aaa-9f9e-3a103d6a679f None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:29.821479 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337806b-de6b-4aaa-9f9e-3a103d6a679f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:29.821479 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337806b-de6b-4aaa-9f9e-3a103d6a679f None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:29.822716 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 516/1039] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:25:29.828759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784887d-0c1f-4fb3-a472-d1098e900a81 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:29.829223 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784887d-0c1f-4fb3-a472-d1098e900a81 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:29.829503 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784887d-0c1f-4fb3-a472-d1098e900a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:29.896539 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-4784887d-0c1f-4fb3-a472-d1098e900a81 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:29.897948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4784887d-0c1f-4fb3-a472-d1098e900a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:29.998174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:30.005150 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 524/1040] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:25:30.294049 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0741f-6b94-4a88-aec0-1208723a0de0 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:30.294456 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0741f-6b94-4a88-aec0-1208723a0de0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:30.294826 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0741f-6b94-4a88-aec0-1208723a0de0 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:30.296769 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 517/1041] 10.222.0.18 () {54 vars in 961 bytes} [Mon Oct 31 12:25:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:25:30.302182 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe009e-2307-41cd-9947-59214bdbcbef None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:30.302481 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe009e-2307-41cd-9947-59214bdbcbef None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:30.302751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe009e-2307-41cd-9947-59214bdbcbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:30.381038 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-65fe009e-2307-41cd-9947-59214bdbcbef None None] MFA Rules not processed for user `d93ce5759e0648a1934ff4d9c9d8fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:30.382283 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-65fe009e-2307-41cd-9947-59214bdbcbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:30.502281 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 525/1042] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Oct 31 12:25:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:25:30.510870 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0741f-6b94-4a88-aec0-1208723a0de0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:25:30.512493 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-eec0741f-6b94-4a88-aec0-1208723a0de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:30.666857 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0741f-6b94-4a88-aec0-1208723a0de0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:25:30.689013 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:30.790127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d33dd4-640d-41ee-8cc9-0e4819c71d1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:25:30.791089 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d33dd4-640d-41ee-8cc9-0e4819c71d1b service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:30.791561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d33dd4-640d-41ee-8cc9-0e4819c71d1b service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:30.791994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d33dd4-640d-41ee-8cc9-0e4819c71d1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:30.794039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-65d33dd4-640d-41ee-8cc9-0e4819c71d1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:30.894360 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d33dd4-640d-41ee-8cc9-0e4819c71d1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:25:30.896814 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d33dd4-640d-41ee-8cc9-0e4819c71d1b service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:25:30.918887 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 518/1043] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:25:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:25:31.000174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9710b-68a4-4477-a49b-e60327c80d2e None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:31.000712 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9710b-68a4-4477-a49b-e60327c80d2e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:31.000712 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9710b-68a4-4477-a49b-e60327c80d2e None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:31.002288 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 526/1044] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:25:31.007541 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd2567-deda-49e1-a580-40a90524f313 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:31.008083 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd2567-deda-49e1-a580-40a90524f313 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:31.008364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd2567-deda-49e1-a580-40a90524f313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:31.048276 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:31.096868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-81cd2567-deda-49e1-a580-40a90524f313 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:31.098502 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-81cd2567-deda-49e1-a580-40a90524f313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:31.221288 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 519/1045] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:25:31.547307 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83307fc-6970-4fb2-b518-a710edb5b740 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:31.547307 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83307fc-6970-4fb2-b518-a710edb5b740 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:31.547520 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83307fc-6970-4fb2-b518-a710edb5b740 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:31.549033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 527/1046] 10.222.0.18 () {54 vars in 963 bytes} [Mon Oct 31 12:25:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:25:31.553875 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e9f75-bb9d-4396-aded-00d7f2eb21fd None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:31.554165 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e9f75-bb9d-4396-aded-00d7f2eb21fd None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:31.554438 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e9f75-bb9d-4396-aded-00d7f2eb21fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:31.636012 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a00e9f75-bb9d-4396-aded-00d7f2eb21fd None None] MFA Rules not processed for user `b2ffd08478684105b83c4e74566ca6a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:31.637244 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a00e9f75-bb9d-4396-aded-00d7f2eb21fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:31.692042 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:31.725727 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 520/1047] 10.222.0.18 () {58 vars in 1060 bytes} [Mon Oct 31 12:25:31 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:25:31.733713 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83307fc-6970-4fb2-b518-a710edb5b740 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:25:31.735222 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e83307fc-6970-4fb2-b518-a710edb5b740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:31.790758 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:31.848623 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83307fc-6970-4fb2-b518-a710edb5b740 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:25:31.929460 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d8ef7-f837-4e1a-a4a3-c6461623c5e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:25:31.930050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d8ef7-f837-4e1a-a4a3-c6461623c5e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:31.930329 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d8ef7-f837-4e1a-a4a3-c6461623c5e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:31.930607 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d8ef7-f837-4e1a-a4a3-c6461623c5e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:31.932258 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-811d8ef7-f837-4e1a-a4a3-c6461623c5e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:32.041249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:32.058329 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d8ef7-f837-4e1a-a4a3-c6461623c5e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:25:32.059666 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d8ef7-f837-4e1a-a4a3-c6461623c5e0 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:25:32.086930 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 528/1048] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:25:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:25:33.186884 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6026da8-fc00-4f6e-bc5b-c43db61cdc89 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:33.187412 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6026da8-fc00-4f6e-bc5b-c43db61cdc89 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:33.187412 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6026da8-fc00-4f6e-bc5b-c43db61cdc89 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:33.188797 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 521/1049] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:25:33.194088 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342f01c-77be-4edc-82df-20c64135124a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:33.194502 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342f01c-77be-4edc-82df-20c64135124a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:33.194640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342f01c-77be-4edc-82df-20c64135124a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:33.259460 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3342f01c-77be-4edc-82df-20c64135124a None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:33.260663 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3342f01c-77be-4edc-82df-20c64135124a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:33.361400 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 529/1050] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:25:33.653783 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6026da8-fc00-4f6e-bc5b-c43db61cdc89 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:25:33.655457 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e6026da8-fc00-4f6e-bc5b-c43db61cdc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:33.809615 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6026da8-fc00-4f6e-bc5b-c43db61cdc89 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:25:33.861531 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:33.924624 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519c24a-43a9-434e-a813-480f174d9778 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:25:33.925239 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519c24a-43a9-434e-a813-480f174d9778 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:33.925516 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519c24a-43a9-434e-a813-480f174d9778 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:33.926556 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519c24a-43a9-434e-a813-480f174d9778 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:33.927342 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0519c24a-43a9-434e-a813-480f174d9778 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:34.019834 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519c24a-43a9-434e-a813-480f174d9778 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:25:34.021542 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519c24a-43a9-434e-a813-480f174d9778 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:25:34.041916 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 522/1051] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:25:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:25:36.265803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512f7f8-8cd2-4683-9574-011ba0c1d44b None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:36.266357 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512f7f8-8cd2-4683-9574-011ba0c1d44b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:36.266357 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512f7f8-8cd2-4683-9574-011ba0c1d44b None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:36.267883 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 530/1052] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:25:36.273099 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730d116-2341-48a1-b8f6-a57c41fe4667 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:36.273628 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730d116-2341-48a1-b8f6-a57c41fe4667 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:36.273711 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730d116-2341-48a1-b8f6-a57c41fe4667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:36.345330 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7730d116-2341-48a1-b8f6-a57c41fe4667 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:36.346536 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7730d116-2341-48a1-b8f6-a57c41fe4667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:36.353340 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:36.447593 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 523/1053] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:25:36.738798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512f7f8-8cd2-4683-9574-011ba0c1d44b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:25:36.740476 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d512f7f8-8cd2-4683-9574-011ba0c1d44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:36.812187 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:36.904576 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512f7f8-8cd2-4683-9574-011ba0c1d44b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:25:37.022600 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c68305-d98d-4b6d-a060-fd9e1d036896 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:25:37.023271 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c68305-d98d-4b6d-a060-fd9e1d036896 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:37.023667 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c68305-d98d-4b6d-a060-fd9e1d036896 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:37.024131 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c68305-d98d-4b6d-a060-fd9e1d036896 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:37.025911 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-03c68305-d98d-4b6d-a060-fd9e1d036896 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:37.045916 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:37.133144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c68305-d98d-4b6d-a060-fd9e1d036896 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:25:37.134726 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c68305-d98d-4b6d-a060-fd9e1d036896 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:25:37.153959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 531/1054] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:25:39.365724 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e9042-ad37-4d6f-bc8a-58a4bf3cd20c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:39.365724 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e9042-ad37-4d6f-bc8a-58a4bf3cd20c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:39.365724 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e9042-ad37-4d6f-bc8a-58a4bf3cd20c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:39.367028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 524/1055] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:25:39.373765 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8050b3e-c5fa-4ee0-a777-5f81e37d8f90 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:39.374330 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8050b3e-c5fa-4ee0-a777-5f81e37d8f90 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:39.374706 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8050b3e-c5fa-4ee0-a777-5f81e37d8f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:39.477018 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-b8050b3e-c5fa-4ee0-a777-5f81e37d8f90 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:39.480946 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b8050b3e-c5fa-4ee0-a777-5f81e37d8f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:39.583498 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:39.590736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 532/1056] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:25:39.884337 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e9042-ad37-4d6f-bc8a-58a4bf3cd20c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:25:39.886592 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2b2e9042-ad37-4d6f-bc8a-58a4bf3cd20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:40.031521 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:40.042163 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e9042-ad37-4d6f-bc8a-58a4bf3cd20c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:25:40.189556 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4ab77-d1dc-401b-8ec0-befe86e80c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:25:40.190346 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4ab77-d1dc-401b-8ec0-befe86e80c98 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:40.190718 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4ab77-d1dc-401b-8ec0-befe86e80c98 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:40.191123 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4ab77-d1dc-401b-8ec0-befe86e80c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:40.193415 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f4d4ab77-d1dc-401b-8ec0-befe86e80c98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:40.313170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4ab77-d1dc-401b-8ec0-befe86e80c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:25:40.314812 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4ab77-d1dc-401b-8ec0-befe86e80c98 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:25:40.324910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:40.333991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 525/1057] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:25:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:25:43.345662 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613092b-0146-4172-99f5-99c25e461f3a None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:43.346211 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613092b-0146-4172-99f5-99c25e461f3a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:43.346211 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613092b-0146-4172-99f5-99c25e461f3a None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:43.347751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 533/1058] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:25:43.353069 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541fb61-ac64-4370-adab-0ec28f692641 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:43.353630 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541fb61-ac64-4370-adab-0ec28f692641 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:43.353727 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541fb61-ac64-4370-adab-0ec28f692641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:43.421452 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d541fb61-ac64-4370-adab-0ec28f692641 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:43.422662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d541fb61-ac64-4370-adab-0ec28f692641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:43.527320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 526/1059] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:25:43.815330 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613092b-0146-4172-99f5-99c25e461f3a None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:25:43.816831 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9613092b-0146-4172-99f5-99c25e461f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:43.965756 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613092b-0146-4172-99f5-99c25e461f3a None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:25:44.037169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:44.090096 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d6433-0e9a-4608-bfd0-77395dcf3e27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:25:44.090901 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d6433-0e9a-4608-bfd0-77395dcf3e27 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:44.091308 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d6433-0e9a-4608-bfd0-77395dcf3e27 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:44.091666 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d6433-0e9a-4608-bfd0-77395dcf3e27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:44.094137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-165d6433-0e9a-4608-bfd0-77395dcf3e27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:44.200279 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d6433-0e9a-4608-bfd0-77395dcf3e27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:25:44.202850 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d6433-0e9a-4608-bfd0-77395dcf3e27 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:25:44.225269 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 534/1060] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:25:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:25:46.354080 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cf494-70db-49db-a58e-bb2863940636 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:46.354643 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cf494-70db-49db-a58e-bb2863940636 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:46.354643 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cf494-70db-49db-a58e-bb2863940636 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:46.355970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 527/1061] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:25:46.361235 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bc7c5-cb6c-4426-bdd5-688a7e328ee5 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:46.361683 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bc7c5-cb6c-4426-bdd5-688a7e328ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:46.361792 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bc7c5-cb6c-4426-bdd5-688a7e328ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:46.427333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3f2bc7c5-cb6c-4426-bdd5-688a7e328ee5 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:46.428518 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3f2bc7c5-cb6c-4426-bdd5-688a7e328ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:46.461029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:46.523782 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 535/1062] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:25:46.807209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9cf494-70db-49db-a58e-bb2863940636 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:25:46.808698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-be9cf494-70db-49db-a58e-bb2863940636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:46.884145 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:46.952666 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9cf494-70db-49db-a58e-bb2863940636 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:25:47.066277 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5627d6f-2a75-4381-88a6-963f5029e66d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:25:47.066843 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5627d6f-2a75-4381-88a6-963f5029e66d service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:47.067124 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5627d6f-2a75-4381-88a6-963f5029e66d service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:47.067401 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5627d6f-2a75-4381-88a6-963f5029e66d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:47.069050 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a5627d6f-2a75-4381-88a6-963f5029e66d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:47.113982 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:47.167818 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5627d6f-2a75-4381-88a6-963f5029e66d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:25:47.169415 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5627d6f-2a75-4381-88a6-963f5029e66d service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:25:47.188126 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 528/1063] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:25:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:25:47.210856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53593a-195c-40cb-a9e1-6f0ed17166c5 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:47.211214 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53593a-195c-40cb-a9e1-6f0ed17166c5 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:47.211490 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53593a-195c-40cb-a9e1-6f0ed17166c5 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:47.212841 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 536/1064] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:25:47.219101 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8982a-e060-441c-bd50-642d1d662121 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:47.219390 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8982a-e060-441c-bd50-642d1d662121 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:47.219662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8982a-e060-441c-bd50-642d1d662121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:47.292921 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a6c8982a-e060-441c-bd50-642d1d662121 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:47.294191 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a6c8982a-e060-441c-bd50-642d1d662121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:47.399136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 529/1065] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:25:47.696516 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ecc28-ef7e-44e9-8691-4356c49e1445 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:47.697006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ecc28-ef7e-44e9-8691-4356c49e1445 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:47.697145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ecc28-ef7e-44e9-8691-4356c49e1445 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:47.698520 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 537/1066] 10.222.0.18 () {54 vars in 962 bytes} [Mon Oct 31 12:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:25:47.704328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3aa7f-94bb-4d3e-be3c-45cd534de6a6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:47.704607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3aa7f-94bb-4d3e-be3c-45cd534de6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:47.704878 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3aa7f-94bb-4d3e-be3c-45cd534de6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:47.721357 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:47.782300 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b2e3aa7f-94bb-4d3e-be3c-45cd534de6a6 None None] MFA Rules not processed for user `d4c6b6b1cdc649dda3a9caa8d9713569`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:47.783493 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b2e3aa7f-94bb-4d3e-be3c-45cd534de6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:47.857640 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 530/1067] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Oct 31 12:25:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:25:47.865400 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ecc28-ef7e-44e9-8691-4356c49e1445 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:25:47.866923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f09ecc28-ef7e-44e9-8691-4356c49e1445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:47.970347 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ecc28-ef7e-44e9-8691-4356c49e1445 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:25:48.028586 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:48.044353 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a779fa-7552-4121-a43f-9798d47f5113 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c6b6b1cdc649dda3a9caa8d9713569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:25:48.044985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a779fa-7552-4121-a43f-9798d47f5113 service glance] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:48.045306 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a779fa-7552-4121-a43f-9798d47f5113 service glance] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:48.045578 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a779fa-7552-4121-a43f-9798d47f5113 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:48.047147 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f4a779fa-7552-4121-a43f-9798d47f5113 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:48.158327 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a779fa-7552-4121-a43f-9798d47f5113 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:25:48.159866 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a779fa-7552-4121-a43f-9798d47f5113 service glance] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:25:48.178072 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 538/1068] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:25:48.921799 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691708ac-eea9-4a3b-92db-572d207e7081 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:48.922290 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691708ac-eea9-4a3b-92db-572d207e7081 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:48.922445 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691708ac-eea9-4a3b-92db-572d207e7081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:48.990879 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-691708ac-eea9-4a3b-92db-572d207e7081 None None] MFA Rules not processed for user `912693f459f147a5a479ad01e2e8387a`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:48.992670 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-691708ac-eea9-4a3b-92db-572d207e7081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:49.052578 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:49.084816 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 531/1069] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 31 12:25:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:25:49.128898 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b44a3-9694-441a-884d-7e2dd24de5bc None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:49.129407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b44a3-9694-441a-884d-7e2dd24de5bc None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:49.129497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b44a3-9694-441a-884d-7e2dd24de5bc None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:49.130839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 539/1070] 10.222.0.18 () {54 vars in 943 bytes} [Mon Oct 31 12:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:25:49.137048 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa6e40-aa1e-4c01-8b6e-d469269427c3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:49.137363 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa6e40-aa1e-4c01-8b6e-d469269427c3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:49.137664 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa6e40-aa1e-4c01-8b6e-d469269427c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:49.213298 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-12aa6e40-aa1e-4c01-8b6e-d469269427c3 None None] MFA Rules not processed for user `188c4989dcfb4f99a04c3349e1a882d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:49.214421 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-12aa6e40-aa1e-4c01-8b6e-d469269427c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:49.342495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 532/1071] 10.222.0.18 () {58 vars in 1040 bytes} [Mon Oct 31 12:25:49 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:25:49.351457 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b44a3-9694-441a-884d-7e2dd24de5bc None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:25:49.352944 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5c8b44a3-9694-441a-884d-7e2dd24de5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:49.418496 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62aa3b2-d6a6-4e2a-90ba-2945a3e40080 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:49.418783 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62aa3b2-d6a6-4e2a-90ba-2945a3e40080 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:49.419063 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62aa3b2-d6a6-4e2a-90ba-2945a3e40080 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:49.421319 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 533/1072] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:25:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:25:49.426377 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f385a24-fb96-41a4-92b7-327f133835e1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:49.426661 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f385a24-fb96-41a4-92b7-327f133835e1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:49.426939 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f385a24-fb96-41a4-92b7-327f133835e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:49.444739 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:49.464946 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:49.495827 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b44a3-9694-441a-884d-7e2dd24de5bc None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:25:49.496617 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8f385a24-fb96-41a4-92b7-327f133835e1 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:49.497869 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8f385a24-fb96-41a4-92b7-327f133835e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:49.595960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 534/1073] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:25:49.600823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b923b-ffd5-491e-8489-2c7cd716a8f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188c4989dcfb4f99a04c3349e1a882d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:25:49.601256 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b923b-ffd5-491e-8489-2c7cd716a8f1 service swift] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:49.601538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b923b-ffd5-491e-8489-2c7cd716a8f1 service swift] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:49.601812 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b923b-ffd5-491e-8489-2c7cd716a8f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:49.603456 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-fd5b923b-ffd5-491e-8489-2c7cd716a8f1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:49.676399 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:49.688853 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b923b-ffd5-491e-8489-2c7cd716a8f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:25:49.690452 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b923b-ffd5-491e-8489-2c7cd716a8f1 service swift] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:25:49.698747 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 540/1074] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 31 12:25:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 12:25:49.889683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f385a24-fb96-41a4-92b7-327f133835e1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:25:49.890886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8f385a24-fb96-41a4-92b7-327f133835e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:50.008239 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:50.012425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f385a24-fb96-41a4-92b7-327f133835e1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:25:50.148116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c66d97-7f40-44f1-95da-3906b916d153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:25:50.150746 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c66d97-7f40-44f1-95da-3906b916d153 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:50.150746 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c66d97-7f40-44f1-95da-3906b916d153 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:50.150746 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c66d97-7f40-44f1-95da-3906b916d153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:50.151755 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-92c66d97-7f40-44f1-95da-3906b916d153 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:50.250920 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c66d97-7f40-44f1-95da-3906b916d153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:25:50.252512 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c66d97-7f40-44f1-95da-3906b916d153 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:25:50.272832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 535/1075] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:25:52.485692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c27671-d6f5-4f0c-8c49-a2aa346dc65f None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:52.486258 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c27671-d6f5-4f0c-8c49-a2aa346dc65f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:52.486469 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c27671-d6f5-4f0c-8c49-a2aa346dc65f None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:52.488025 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 541/1076] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:25:52.493391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e2b71-57b5-4eaa-b0ac-2be5fdffe97a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:52.493820 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e2b71-57b5-4eaa-b0ac-2be5fdffe97a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:52.494282 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e2b71-57b5-4eaa-b0ac-2be5fdffe97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:52.501395 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:52.571736 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-755e2b71-57b5-4eaa-b0ac-2be5fdffe97a None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:52.572967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-755e2b71-57b5-4eaa-b0ac-2be5fdffe97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:52.684799 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 536/1077] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:25:53.059586 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c27671-d6f5-4f0c-8c49-a2aa346dc65f None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:25:53.061327 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-27c27671-d6f5-4f0c-8c49-a2aa346dc65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:53.228960 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c27671-d6f5-4f0c-8c49-a2aa346dc65f None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:25:53.298987 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:53.369465 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e999db-489e-44b9-803f-fc40369f4317 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:25:53.370186 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e999db-489e-44b9-803f-fc40369f4317 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:53.370533 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e999db-489e-44b9-803f-fc40369f4317 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:53.370877 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e999db-489e-44b9-803f-fc40369f4317 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:53.372542 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f2e999db-489e-44b9-803f-fc40369f4317 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:53.476174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e999db-489e-44b9-803f-fc40369f4317 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:25:53.477810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e999db-489e-44b9-803f-fc40369f4317 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:25:53.496297 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 542/1078] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:25:55.718639 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f97678-7d06-43d0-921b-6fe2ca26a804 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:55.719219 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f97678-7d06-43d0-921b-6fe2ca26a804 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:55.719219 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f97678-7d06-43d0-921b-6fe2ca26a804 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:55.720518 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 537/1079] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:25:55.725820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5633d6-65b3-4175-b3ac-d1edcf55d793 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:55.726264 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5633d6-65b3-4175-b3ac-d1edcf55d793 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:55.726418 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5633d6-65b3-4175-b3ac-d1edcf55d793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:55.799188 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-6b5633d6-65b3-4175-b3ac-d1edcf55d793 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:55.800412 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6b5633d6-65b3-4175-b3ac-d1edcf55d793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:55.828398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:55.909256 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 543/1080] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:25:56.198646 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f97678-7d06-43d0-921b-6fe2ca26a804 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:25:56.200216 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-78f97678-7d06-43d0-921b-6fe2ca26a804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:56.293274 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:56.376870 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f97678-7d06-43d0-921b-6fe2ca26a804 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:25:56.509172 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c411a-e16d-43df-a8eb-7722af05251e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:25:56.509791 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c411a-e16d-43df-a8eb-7722af05251e service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:56.510075 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c411a-e16d-43df-a8eb-7722af05251e service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:56.510349 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c411a-e16d-43df-a8eb-7722af05251e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:56.511942 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e22c411a-e16d-43df-a8eb-7722af05251e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:56.564771 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:56.621366 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c411a-e16d-43df-a8eb-7722af05251e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:25:56.623253 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c411a-e16d-43df-a8eb-7722af05251e service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:25:56.644086 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 538/1081] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:25:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:25:58.993385 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5a13e-e60e-4723-aa38-dadad0c94f8f None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:58.993959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5a13e-e60e-4723-aa38-dadad0c94f8f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:58.993959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5a13e-e60e-4723-aa38-dadad0c94f8f None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:58.995969 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 544/1082] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:25:59.002878 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18d64e-9e42-4522-8041-ed230a1e8dac None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:59.003374 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18d64e-9e42-4522-8041-ed230a1e8dac None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:59.003477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18d64e-9e42-4522-8041-ed230a1e8dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:59.083102 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8a18d64e-9e42-4522-8041-ed230a1e8dac None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:25:59.084379 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8a18d64e-9e42-4522-8041-ed230a1e8dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:59.192803 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 539/1083] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:25:59.480406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5a13e-e60e-4723-aa38-dadad0c94f8f None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:25:59.481940 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8ec5a13e-e60e-4723-aa38-dadad0c94f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:59.653420 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5a13e-e60e-4723-aa38-dadad0c94f8f None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:25:59.663639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:25:59.777656 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c0186-3038-4fbe-929f-a43494d71d7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:25:59.778536 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c0186-3038-4fbe-929f-a43494d71d7e service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:25:59.778815 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c0186-3038-4fbe-929f-a43494d71d7e service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:25:59.779086 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c0186-3038-4fbe-929f-a43494d71d7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:25:59.781364 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5b1c0186-3038-4fbe-929f-a43494d71d7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:25:59.884463 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c0186-3038-4fbe-929f-a43494d71d7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:25:59.886223 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c0186-3038-4fbe-929f-a43494d71d7e service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:25:59.909402 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 545/1084] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:25:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:26:09.191241 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:09.903320 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=94 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:12.184206 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0802c2-7cf4-40df-a3a2-267f57f23e06 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:12.184781 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0802c2-7cf4-40df-a3a2-267f57f23e06 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:12.184781 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0802c2-7cf4-40df-a3a2-267f57f23e06 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:12.186641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 540/1085] 10.222.0.18 () {54 vars in 918 bytes} [Mon Oct 31 12:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:26:12.191984 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5ccf7-fc6c-46cf-bdb1-c976f9628f9c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:12.192434 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5ccf7-fc6c-46cf-bdb1-c976f9628f9c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:12.192534 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5ccf7-fc6c-46cf-bdb1-c976f9628f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:12.267290 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-18e5ccf7-fc6c-46cf-bdb1-c976f9628f9c None None] MFA Rules not processed for user `18c015b8317b4517911f69bef21a0573`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:26:12.268493 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-18e5ccf7-fc6c-46cf-bdb1-c976f9628f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:12.374202 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 546/1086] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Oct 31 12:26:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:26:12.388053 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c46eec-ddb1-48d8-8d2c-b040e608c394 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:12.388344 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c46eec-ddb1-48d8-8d2c-b040e608c394 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:12.388622 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c46eec-ddb1-48d8-8d2c-b040e608c394 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:12.389998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 541/1087] 10.222.0.18 () {54 vars in 918 bytes} [Mon Oct 31 12:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:26:12.394387 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcccc0b-bdfb-4c07-ba4d-1462a8eddf11 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:12.394678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcccc0b-bdfb-4c07-ba4d-1462a8eddf11 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:12.394952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcccc0b-bdfb-4c07-ba4d-1462a8eddf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:12.466313 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:12.469583 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ddcccc0b-bdfb-4c07-ba4d-1462a8eddf11 None None] MFA Rules not processed for user `d93ce5759e0648a1934ff4d9c9d8fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:26:12.471392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ddcccc0b-bdfb-4c07-ba4d-1462a8eddf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:12.583559 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 547/1088] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Oct 31 12:26:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:26:15.136238 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ed138-ae93-4905-ac69-152ea6912309 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:15.136771 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ed138-ae93-4905-ac69-152ea6912309 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:15.136771 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ed138-ae93-4905-ac69-152ea6912309 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:15.139008 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 542/1089] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 12:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:26:15.144486 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b5fe2-6ba9-4dd1-9cfd-53ee9bdea2d6 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:15.144922 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b5fe2-6ba9-4dd1-9cfd-53ee9bdea2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:15.145017 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b5fe2-6ba9-4dd1-9cfd-53ee9bdea2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:15.209613 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-a01b5fe2-6ba9-4dd1-9cfd-53ee9bdea2d6 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:26:15.210797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a01b5fe2-6ba9-4dd1-9cfd-53ee9bdea2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:15.264552 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:15.306440 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 548/1090] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 12:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:26:15.593934 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ed138-ae93-4905-ac69-152ea6912309 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:26:15.595518 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d85ed138-ae93-4905-ac69-152ea6912309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:15.740590 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ed138-ae93-4905-ac69-152ea6912309 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:26:15.811765 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:15.851407 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06432488-fcc3-478f-8c45-8ebaeb5dc8e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:26:15.852014 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06432488-fcc3-478f-8c45-8ebaeb5dc8e6 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:15.852294 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06432488-fcc3-478f-8c45-8ebaeb5dc8e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:15.852567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06432488-fcc3-478f-8c45-8ebaeb5dc8e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:15.854173 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-06432488-fcc3-478f-8c45-8ebaeb5dc8e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:15.945250 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06432488-fcc3-478f-8c45-8ebaeb5dc8e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:26:15.947076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06432488-fcc3-478f-8c45-8ebaeb5dc8e6 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:26:15.964484 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 543/1091] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:26:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:26:17.083479 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbba25b-1a47-4bb3-8ded-781951ec8dc3 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:17.083969 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbba25b-1a47-4bb3-8ded-781951ec8dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:17.084070 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbba25b-1a47-4bb3-8ded-781951ec8dc3 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:17.085414 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 549/1092] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 12:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:26:17.090425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01165e-1cb8-48ab-a335-10b126f4df8b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:17.090860 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01165e-1cb8-48ab-a335-10b126f4df8b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:17.090966 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01165e-1cb8-48ab-a335-10b126f4df8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:17.164735 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-cb01165e-1cb8-48ab-a335-10b126f4df8b None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:26:17.165948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cb01165e-1cb8-48ab-a335-10b126f4df8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:17.192906 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:17.261337 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 544/1093] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 12:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:26:17.424590 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbba25b-1a47-4bb3-8ded-781951ec8dc3 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:26:17.426105 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0dbba25b-1a47-4bb3-8ded-781951ec8dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:17.568866 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbba25b-1a47-4bb3-8ded-781951ec8dc3 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:26:17.608497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:17.680069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23131b-b06a-49dd-bede-73328b942616 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:26:17.680596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23131b-b06a-49dd-bede-73328b942616 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:17.680869 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23131b-b06a-49dd-bede-73328b942616 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:17.681163 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23131b-b06a-49dd-bede-73328b942616 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:17.682738 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-fa23131b-b06a-49dd-bede-73328b942616 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:17.769664 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23131b-b06a-49dd-bede-73328b942616 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:26:17.771231 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23131b-b06a-49dd-bede-73328b942616 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:26:17.789729 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 550/1094] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:26:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:26:18.898774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86e9a4-b0ad-4276-bffb-59cc94b68f3e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:18.899337 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86e9a4-b0ad-4276-bffb-59cc94b68f3e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:18.899337 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86e9a4-b0ad-4276-bffb-59cc94b68f3e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:18.900689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 545/1095] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 12:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:26:18.905716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d9594-91c0-40d2-9cc5-fc835e014f25 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:18.906105 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d9594-91c0-40d2-9cc5-fc835e014f25 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:18.906259 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d9594-91c0-40d2-9cc5-fc835e014f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:18.960545 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:18.982309 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f61d9594-91c0-40d2-9cc5-fc835e014f25 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:26:18.983516 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f61d9594-91c0-40d2-9cc5-fc835e014f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:19.080919 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 551/1096] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 12:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:26:19.229912 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86e9a4-b0ad-4276-bffb-59cc94b68f3e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:26:19.231353 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5f86e9a4-b0ad-4276-bffb-59cc94b68f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:19.376857 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86e9a4-b0ad-4276-bffb-59cc94b68f3e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:26:19.388868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:19.486279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6843153-c7e5-43d3-a892-5375f2cecba1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:26:19.486805 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6843153-c7e5-43d3-a892-5375f2cecba1 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:19.487080 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6843153-c7e5-43d3-a892-5375f2cecba1 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:19.487348 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6843153-c7e5-43d3-a892-5375f2cecba1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:19.488902 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c6843153-c7e5-43d3-a892-5375f2cecba1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:19.576040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6843153-c7e5-43d3-a892-5375f2cecba1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:26:19.577642 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6843153-c7e5-43d3-a892-5375f2cecba1 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:26:19.595607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 546/1097] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:26:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:26:20.693546 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c2f17-5a4d-4f01-99ad-622a6f0d2a3c None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:20.694081 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c2f17-5a4d-4f01-99ad-622a6f0d2a3c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:20.694204 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c2f17-5a4d-4f01-99ad-622a6f0d2a3c None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:20.695453 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 552/1098] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 12:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:26:20.700288 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b026fe0-e29a-4504-8dcb-d8bdeab13e7e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:20.700703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b026fe0-e29a-4504-8dcb-d8bdeab13e7e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:20.700879 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b026fe0-e29a-4504-8dcb-d8bdeab13e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:20.720154 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:20.775872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2b026fe0-e29a-4504-8dcb-d8bdeab13e7e None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:26:20.777076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2b026fe0-e29a-4504-8dcb-d8bdeab13e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:20.871970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 547/1099] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 12:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:26:21.021610 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c2f17-5a4d-4f01-99ad-622a6f0d2a3c None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:26:21.023110 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f29c2f17-5a4d-4f01-99ad-622a6f0d2a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:21.133185 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:21.168283 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c2f17-5a4d-4f01-99ad-622a6f0d2a3c None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:26:21.277759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ad692-cd20-4ba8-90e7-e0a222dbde8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:26:21.278358 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ad692-cd20-4ba8-90e7-e0a222dbde8d service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:21.278636 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ad692-cd20-4ba8-90e7-e0a222dbde8d service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:21.279386 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ad692-cd20-4ba8-90e7-e0a222dbde8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:21.280975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-969ad692-cd20-4ba8-90e7-e0a222dbde8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:21.356860 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:21.369820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ad692-cd20-4ba8-90e7-e0a222dbde8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:26:21.371379 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ad692-cd20-4ba8-90e7-e0a222dbde8d service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:26:21.389319 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 553/1100] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:26:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:26:22.487117 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426e713-621c-4d0c-a8ef-8efe6b058ecf None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:22.487718 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426e713-621c-4d0c-a8ef-8efe6b058ecf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:22.487718 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426e713-621c-4d0c-a8ef-8efe6b058ecf None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:22.489025 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 548/1101] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 12:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:26:22.493964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffc5de-271a-44f2-a2ea-55dcd911b275 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:22.494369 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffc5de-271a-44f2-a2ea-55dcd911b275 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:22.494513 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffc5de-271a-44f2-a2ea-55dcd911b275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:22.569441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-42ffc5de-271a-44f2-a2ea-55dcd911b275 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:26:22.570655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-42ffc5de-271a-44f2-a2ea-55dcd911b275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:22.666520 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 554/1102] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 12:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:26:22.817611 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426e713-621c-4d0c-a8ef-8efe6b058ecf None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:26:22.819024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f426e713-621c-4d0c-a8ef-8efe6b058ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:22.900863 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:22.961531 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426e713-621c-4d0c-a8ef-8efe6b058ecf None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:26:23.070775 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25766e-725a-47c2-82a0-59103652723f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:26:23.071303 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25766e-725a-47c2-82a0-59103652723f service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:23.071587 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25766e-725a-47c2-82a0-59103652723f service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:23.071853 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25766e-725a-47c2-82a0-59103652723f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:23.073462 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fa25766e-725a-47c2-82a0-59103652723f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:23.120494 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:23.160720 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25766e-725a-47c2-82a0-59103652723f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:26:23.162582 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25766e-725a-47c2-82a0-59103652723f service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:26:23.180675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 549/1103] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:26:24.215897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c337b8-5185-4c1d-8aa7-4a479ad556a8 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:24.216436 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c337b8-5185-4c1d-8aa7-4a479ad556a8 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:24.216532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c337b8-5185-4c1d-8aa7-4a479ad556a8 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:24.217884 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 555/1104] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 12:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:26:24.222682 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d587d2-d2ac-4514-8af7-c7cbd0aef999 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:24.223136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d587d2-d2ac-4514-8af7-c7cbd0aef999 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:24.223234 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d587d2-d2ac-4514-8af7-c7cbd0aef999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:24.301227 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-27d587d2-d2ac-4514-8af7-c7cbd0aef999 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:26:24.302442 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-27d587d2-d2ac-4514-8af7-c7cbd0aef999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:24.398095 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 550/1105] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 12:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:26:24.547983 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c337b8-5185-4c1d-8aa7-4a479ad556a8 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:26:24.549517 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-06c337b8-5185-4c1d-8aa7-4a479ad556a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:24.596996 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:24.692532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c337b8-5185-4c1d-8aa7-4a479ad556a8 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:26:24.804793 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485eae1-3d30-442b-a857-7d74f7becaed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:26:24.805427 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485eae1-3d30-442b-a857-7d74f7becaed service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:24.805711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485eae1-3d30-442b-a857-7d74f7becaed service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:24.805988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485eae1-3d30-442b-a857-7d74f7becaed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:24.807568 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d485eae1-3d30-442b-a857-7d74f7becaed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:24.814997 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:24.897043 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485eae1-3d30-442b-a857-7d74f7becaed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:26:24.898637 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485eae1-3d30-442b-a857-7d74f7becaed service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:26:24.916417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 556/1106] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:26:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:26:25.946660 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cf46a-8000-4594-8532-5b8b17514c4c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:25.947208 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cf46a-8000-4594-8532-5b8b17514c4c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:25.947299 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cf46a-8000-4594-8532-5b8b17514c4c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:25.948583 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 551/1107] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 12:26:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:26:25.954222 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75320b9-e5e8-461c-8965-ccae6657587c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:25.954696 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75320b9-e5e8-461c-8965-ccae6657587c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:25.954801 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75320b9-e5e8-461c-8965-ccae6657587c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:26.030030 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d75320b9-e5e8-461c-8965-ccae6657587c None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:26:26.031228 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d75320b9-e5e8-461c-8965-ccae6657587c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:26.099862 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:26.127952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 557/1108] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 12:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:26:26.279583 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cf46a-8000-4594-8532-5b8b17514c4c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:26:26.281021 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a16cf46a-8000-4594-8532-5b8b17514c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:26.298755 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:26.423460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cf46a-8000-4594-8532-5b8b17514c4c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:26:26.507965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:26.533857 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0f7e1-dff3-49fe-9947-b2f5aa286f25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:26:26.534396 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0f7e1-dff3-49fe-9947-b2f5aa286f25 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:26.534674 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0f7e1-dff3-49fe-9947-b2f5aa286f25 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:26.534943 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0f7e1-dff3-49fe-9947-b2f5aa286f25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:26.536766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-faa0f7e1-dff3-49fe-9947-b2f5aa286f25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:26.624832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0f7e1-dff3-49fe-9947-b2f5aa286f25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:26:26.626445 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0f7e1-dff3-49fe-9947-b2f5aa286f25 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:26:26.643974 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 552/1109] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:26:27.687741 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5eb576-b16b-4db9-8983-795d647761ac None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:27.688569 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5eb576-b16b-4db9-8983-795d647761ac None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:27.688728 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5eb576-b16b-4db9-8983-795d647761ac None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:27.690229 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 558/1110] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 12:26:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:26:27.695164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34344cd4-de8b-45df-824f-d50dd7a49cba None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:27.695581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34344cd4-de8b-45df-824f-d50dd7a49cba None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:27.695723 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34344cd4-de8b-45df-824f-d50dd7a49cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:27.770980 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-34344cd4-de8b-45df-824f-d50dd7a49cba None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:26:27.772101 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-34344cd4-de8b-45df-824f-d50dd7a49cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:27.813774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:27.868224 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 553/1111] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 12:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:26:28.022144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5eb576-b16b-4db9-8983-795d647761ac None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:26:28.023568 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7d5eb576-b16b-4db9-8983-795d647761ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:28.167099 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5eb576-b16b-4db9-8983-795d647761ac None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:26:28.219828 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:28.276386 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bff24-2f4c-4e24-bf2d-3dcdf8d76e01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:26:28.276926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bff24-2f4c-4e24-bf2d-3dcdf8d76e01 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:28.277230 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bff24-2f4c-4e24-bf2d-3dcdf8d76e01 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:28.277497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bff24-2f4c-4e24-bf2d-3dcdf8d76e01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:28.279046 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c33bff24-2f4c-4e24-bf2d-3dcdf8d76e01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:28.366019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bff24-2f4c-4e24-bf2d-3dcdf8d76e01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:26:28.367577 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bff24-2f4c-4e24-bf2d-3dcdf8d76e01 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:26:28.385824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 559/1112] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:26:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:26:29.425055 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c51a73-73a5-4249-9166-a7c23c0ae99e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:29.425619 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c51a73-73a5-4249-9166-a7c23c0ae99e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:29.425714 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c51a73-73a5-4249-9166-a7c23c0ae99e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:29.426983 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 554/1113] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 12:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:26:29.431882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dd775-942f-49fd-a429-7163c3bdadd5 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:29.432263 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dd775-942f-49fd-a429-7163c3bdadd5 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:29.432411 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dd775-942f-49fd-a429-7163c3bdadd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:29.508193 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-dd9dd775-942f-49fd-a429-7163c3bdadd5 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:26:29.509417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-dd9dd775-942f-49fd-a429-7163c3bdadd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:29.511439 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:29.604497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 560/1114] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 12:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:26:29.754511 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c51a73-73a5-4249-9166-a7c23c0ae99e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:26:29.756023 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-41c51a73-73a5-4249-9166-a7c23c0ae99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:29.898146 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c51a73-73a5-4249-9166-a7c23c0ae99e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:26:29.924375 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:30.008293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df22832-4c2b-4f81-a54b-d4096d35eda1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:26:30.008892 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df22832-4c2b-4f81-a54b-d4096d35eda1 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:30.009191 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df22832-4c2b-4f81-a54b-d4096d35eda1 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:30.009464 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df22832-4c2b-4f81-a54b-d4096d35eda1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:30.011024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5df22832-4c2b-4f81-a54b-d4096d35eda1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:30.098282 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df22832-4c2b-4f81-a54b-d4096d35eda1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:26:30.099855 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df22832-4c2b-4f81-a54b-d4096d35eda1 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:26:30.118004 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 555/1115] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:26:32.170045 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492a31f-33a4-41e1-9769-cdd003263a27 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:32.170613 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492a31f-33a4-41e1-9769-cdd003263a27 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:32.170613 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492a31f-33a4-41e1-9769-cdd003263a27 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:32.172014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 561/1116] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 12:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:26:32.177383 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa74f61-909a-44f6-9be0-41b223abb002 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:32.177794 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa74f61-909a-44f6-9be0-41b223abb002 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:32.177939 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa74f61-909a-44f6-9be0-41b223abb002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:32.218425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:32.243294 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ffa74f61-909a-44f6-9be0-41b223abb002 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:26:32.244482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ffa74f61-909a-44f6-9be0-41b223abb002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:32.339087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 556/1117] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 12:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:26:32.625212 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492a31f-33a4-41e1-9769-cdd003263a27 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:26:32.626735 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8492a31f-33a4-41e1-9769-cdd003263a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:32.728128 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492a31f-33a4-41e1-9769-cdd003263a27 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:26:32.758832 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:32.805529 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae21f5-e35f-4369-9a73-64cd184cd3eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:26:32.806139 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae21f5-e35f-4369-9a73-64cd184cd3eb service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:32.806415 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae21f5-e35f-4369-9a73-64cd184cd3eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:32.806683 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae21f5-e35f-4369-9a73-64cd184cd3eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:32.808258 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8eae21f5-e35f-4369-9a73-64cd184cd3eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:32.914894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae21f5-e35f-4369-9a73-64cd184cd3eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:26:32.916249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae21f5-e35f-4369-9a73-64cd184cd3eb service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:26:32.933681 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 562/1118] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:26:35.231219 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05acfaf-c0bc-4b20-8192-1a70d0aea170 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:35.231837 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05acfaf-c0bc-4b20-8192-1a70d0aea170 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:35.231837 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05acfaf-c0bc-4b20-8192-1a70d0aea170 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:35.233813 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 557/1119] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 12:26:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:26:35.239088 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43175500-a545-4056-97ee-cc6f5193116b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:35.239531 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43175500-a545-4056-97ee-cc6f5193116b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:35.239634 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43175500-a545-4056-97ee-cc6f5193116b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:35.305190 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-43175500-a545-4056-97ee-cc6f5193116b None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:26:35.306381 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-43175500-a545-4056-97ee-cc6f5193116b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:35.318713 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:35.402897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 563/1120] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 12:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:26:35.687153 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05acfaf-c0bc-4b20-8192-1a70d0aea170 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:26:35.688679 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e05acfaf-c0bc-4b20-8192-1a70d0aea170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:35.790966 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05acfaf-c0bc-4b20-8192-1a70d0aea170 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:26:35.803749 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:35.864868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9ab6f-18c0-4e05-bdce-dd436c8d2fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:26:35.865504 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9ab6f-18c0-4e05-bdce-dd436c8d2fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:35.865784 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9ab6f-18c0-4e05-bdce-dd436c8d2fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:35.866056 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9ab6f-18c0-4e05-bdce-dd436c8d2fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:35.867638 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e2e9ab6f-18c0-4e05-bdce-dd436c8d2fd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:35.974871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9ab6f-18c0-4e05-bdce-dd436c8d2fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:26:35.976211 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9ab6f-18c0-4e05-bdce-dd436c8d2fd3 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:26:35.993684 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 558/1121] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:26:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:26:38.435603 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fac909-433f-4e99-97f4-791f6db882d7 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:38.436147 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fac909-433f-4e99-97f4-791f6db882d7 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:38.436147 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fac909-433f-4e99-97f4-791f6db882d7 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:38.437539 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 564/1122] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 12:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:26:38.442813 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7840ad-45ea-4f62-8dec-f23e3d13c608 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:38.443213 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7840ad-45ea-4f62-8dec-f23e3d13c608 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:38.443368 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7840ad-45ea-4f62-8dec-f23e3d13c608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:38.490629 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:38.508413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8e7840ad-45ea-4f62-8dec-f23e3d13c608 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:26:38.509653 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8e7840ad-45ea-4f62-8dec-f23e3d13c608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:38.605337 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 559/1123] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 12:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:26:38.900910 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e103c7-4251-49c8-b5b2-1f319d3c9072 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:38.901251 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e103c7-4251-49c8-b5b2-1f319d3c9072 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:38.901525 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e103c7-4251-49c8-b5b2-1f319d3c9072 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:38.902872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 565/1124] 10.222.0.18 () {54 vars in 965 bytes} [Mon Oct 31 12:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:26:38.909007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f33df-af01-4aae-a527-e095145f668b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:38.909321 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f33df-af01-4aae-a527-e095145f668b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:38.909596 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f33df-af01-4aae-a527-e095145f668b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:38.984253 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b95f33df-af01-4aae-a527-e095145f668b None None] MFA Rules not processed for user `7179d21011064d5b91d0e35a51b8adae`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:26:38.985509 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b95f33df-af01-4aae-a527-e095145f668b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:39.044213 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:39.061750 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 560/1125] 10.222.0.18 () {58 vars in 1062 bytes} [Mon Oct 31 12:26:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:26:39.070817 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e103c7-4251-49c8-b5b2-1f319d3c9072 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:26:39.072577 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-96e103c7-4251-49c8-b5b2-1f319d3c9072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:39.174504 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e103c7-4251-49c8-b5b2-1f319d3c9072 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:26:39.214739 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:39.248500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525bad5-b278-4479-8b62-e7eb5c48e388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:26:39.249092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525bad5-b278-4479-8b62-e7eb5c48e388 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:39.249395 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525bad5-b278-4479-8b62-e7eb5c48e388 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:39.249664 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525bad5-b278-4479-8b62-e7eb5c48e388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:39.251220 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c525bad5-b278-4479-8b62-e7eb5c48e388 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:39.357540 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525bad5-b278-4479-8b62-e7eb5c48e388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:26:39.358978 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525bad5-b278-4479-8b62-e7eb5c48e388 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:26:39.377741 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 566/1126] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:26:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:26:42.034086 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eb06e-57f8-4c29-9c79-98f94fcb8aa4 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:42.034651 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eb06e-57f8-4c29-9c79-98f94fcb8aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:42.034651 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eb06e-57f8-4c29-9c79-98f94fcb8aa4 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:42.035970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 561/1127] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 12:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:26:42.041445 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5cd34-7aa2-49b1-8bf1-79e647bf5186 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:42.041894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5cd34-7aa2-49b1-8bf1-79e647bf5186 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:42.041998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5cd34-7aa2-49b1-8bf1-79e647bf5186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:42.107497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-6cc5cd34-7aa2-49b1-8bf1-79e647bf5186 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:26:42.108757 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6cc5cd34-7aa2-49b1-8bf1-79e647bf5186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:42.128719 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:42.204688 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 567/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 12:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:26:42.488786 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2eb06e-57f8-4c29-9c79-98f94fcb8aa4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:26:42.490356 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ef2eb06e-57f8-4c29-9c79-98f94fcb8aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:42.592921 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2eb06e-57f8-4c29-9c79-98f94fcb8aa4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:26:42.664193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3423626-db1a-43de-9c9a-9bdc7f1c8fb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:26:42.664790 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3423626-db1a-43de-9c9a-9bdc7f1c8fb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:42.665064 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3423626-db1a-43de-9c9a-9bdc7f1c8fb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:42.665358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3423626-db1a-43de-9c9a-9bdc7f1c8fb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:42.666916 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e3423626-db1a-43de-9c9a-9bdc7f1c8fb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:42.706424 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:42.773700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3423626-db1a-43de-9c9a-9bdc7f1c8fb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:26:42.775040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3423626-db1a-43de-9c9a-9bdc7f1c8fb7 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:26:42.794506 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 562/1129] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:26:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:26:44.996359 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3267f5-e37b-4d5a-96c5-981b13231a51 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:44.996887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3267f5-e37b-4d5a-96c5-981b13231a51 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:44.996887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3267f5-e37b-4d5a-96c5-981b13231a51 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:44.998693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 568/1130] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 12:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:26:45.004054 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda171d-3eb7-4ec3-a4aa-76e15ab6c159 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:45.004556 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda171d-3eb7-4ec3-a4aa-76e15ab6c159 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:45.004655 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda171d-3eb7-4ec3-a4aa-76e15ab6c159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:45.069631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7fda171d-3eb7-4ec3-a4aa-76e15ab6c159 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:26:45.070870 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7fda171d-3eb7-4ec3-a4aa-76e15ab6c159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:45.159983 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:45.166538 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 563/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 12:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:26:45.451893 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3267f5-e37b-4d5a-96c5-981b13231a51 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:26:45.453450 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0f3267f5-e37b-4d5a-96c5-981b13231a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:45.552875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3267f5-e37b-4d5a-96c5-981b13231a51 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:26:45.599924 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:45.623728 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b933e585-23f5-43d2-b03a-76321478e019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:26:45.624335 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933e585-23f5-43d2-b03a-76321478e019 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:45.624615 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933e585-23f5-43d2-b03a-76321478e019 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:45.624885 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933e585-23f5-43d2-b03a-76321478e019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:45.626525 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b933e585-23f5-43d2-b03a-76321478e019 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:45.732976 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b933e585-23f5-43d2-b03a-76321478e019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:26:45.734415 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b933e585-23f5-43d2-b03a-76321478e019 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:26:45.752145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 569/1132] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:26:48.034166 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fffb85-3534-4f91-9516-75ae0aaad9e0 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:48.034761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fffb85-3534-4f91-9516-75ae0aaad9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:48.034761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fffb85-3534-4f91-9516-75ae0aaad9e0 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:48.036056 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 564/1133] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 12:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:26:48.041741 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8c93c-1d1f-4197-913f-1637189956b8 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:48.042147 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8c93c-1d1f-4197-913f-1637189956b8 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:48.042287 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8c93c-1d1f-4197-913f-1637189956b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:48.107124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3ed8c93c-1d1f-4197-913f-1637189956b8 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:26:48.108304 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3ed8c93c-1d1f-4197-913f-1637189956b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:48.137348 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:48.204572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 570/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 12:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:26:48.490606 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fffb85-3534-4f91-9516-75ae0aaad9e0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:26:48.492174 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c3fffb85-3534-4f91-9516-75ae0aaad9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:48.594236 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fffb85-3534-4f91-9516-75ae0aaad9e0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:26:48.665435 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d4f30-4220-4ba5-9312-8db496f46891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:26:48.666032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d4f30-4220-4ba5-9312-8db496f46891 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:48.666308 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d4f30-4220-4ba5-9312-8db496f46891 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:48.666574 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d4f30-4220-4ba5-9312-8db496f46891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:48.668119 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ea4d4f30-4220-4ba5-9312-8db496f46891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:48.717369 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:48.775175 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d4f30-4220-4ba5-9312-8db496f46891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:26:48.776562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d4f30-4220-4ba5-9312-8db496f46891 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:26:48.795921 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 565/1135] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:26:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:26:50.987445 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f0991-5f41-4d20-b623-2c1ef9687a5d None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:50.988016 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f0991-5f41-4d20-b623-2c1ef9687a5d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:50.988016 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f0991-5f41-4d20-b623-2c1ef9687a5d None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:50.989386 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 571/1136] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 12:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:26:50.994657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f113000-ef54-41e1-95c6-1e5cfe1a7a44 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:50.995082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f113000-ef54-41e1-95c6-1e5cfe1a7a44 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:50.995177 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f113000-ef54-41e1-95c6-1e5cfe1a7a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:51.058910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1f113000-ef54-41e1-95c6-1e5cfe1a7a44 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:26:51.060118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1f113000-ef54-41e1-95c6-1e5cfe1a7a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:51.154163 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 566/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 12:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:26:51.441178 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f0991-5f41-4d20-b623-2c1ef9687a5d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:26:51.442780 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-765f0991-5f41-4d20-b623-2c1ef9687a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:51.546688 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f0991-5f41-4d20-b623-2c1ef9687a5d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:26:51.601911 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:51.619724 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758653e-592a-4c1b-9e50-fc7668422d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:26:51.620324 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758653e-592a-4c1b-9e50-fc7668422d2f service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:51.620600 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758653e-592a-4c1b-9e50-fc7668422d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:51.620867 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758653e-592a-4c1b-9e50-fc7668422d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:51.622498 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c758653e-592a-4c1b-9e50-fc7668422d2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:51.728411 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758653e-592a-4c1b-9e50-fc7668422d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:26:51.729862 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758653e-592a-4c1b-9e50-fc7668422d2f service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:26:51.747869 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 572/1138] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:26:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:26:53.930427 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfacdee-4ff9-43b1-b70f-739171d11fb1 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:53.931024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfacdee-4ff9-43b1-b70f-739171d11fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:53.931024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfacdee-4ff9-43b1-b70f-739171d11fb1 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:53.932359 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 567/1139] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 12:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:26:53.938224 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bf54d-9ad1-47a6-b821-792087d94d23 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:53.938609 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bf54d-9ad1-47a6-b821-792087d94d23 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:53.938779 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bf54d-9ad1-47a6-b821-792087d94d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:54.004204 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f32bf54d-9ad1-47a6-b821-792087d94d23 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:26:54.005435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f32bf54d-9ad1-47a6-b821-792087d94d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:54.043374 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:54.100950 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 573/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 12:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:26:54.381889 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfacdee-4ff9-43b1-b70f-739171d11fb1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:26:54.383411 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-acfacdee-4ff9-43b1-b70f-739171d11fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:54.387210 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:54.485310 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfacdee-4ff9-43b1-b70f-739171d11fb1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:26:54.557013 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e79ce-c6bc-4ecc-bfbd-98d25bb9112a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:26:54.557568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e79ce-c6bc-4ecc-bfbd-98d25bb9112a service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:54.557845 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e79ce-c6bc-4ecc-bfbd-98d25bb9112a service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:54.558113 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e79ce-c6bc-4ecc-bfbd-98d25bb9112a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:54.559708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f72e79ce-c6bc-4ecc-bfbd-98d25bb9112a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:54.616543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:54.666964 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e79ce-c6bc-4ecc-bfbd-98d25bb9112a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:26:54.668372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e79ce-c6bc-4ecc-bfbd-98d25bb9112a service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:26:54.686512 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 568/1141] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:26:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:26:56.889432 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f9756-f729-4e38-8519-dc123c81b502 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:56.890010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f9756-f729-4e38-8519-dc123c81b502 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:56.890010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f9756-f729-4e38-8519-dc123c81b502 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:56.891322 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 574/1142] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 12:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:26:56.896574 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f325f-87ec-40cc-a15c-7cd76d011309 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:56.896982 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f325f-87ec-40cc-a15c-7cd76d011309 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:56.897149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f325f-87ec-40cc-a15c-7cd76d011309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:56.963222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b69f325f-87ec-40cc-a15c-7cd76d011309 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:26:56.964423 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b69f325f-87ec-40cc-a15c-7cd76d011309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:57.058491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 569/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 12:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:26:57.338425 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f9756-f729-4e38-8519-dc123c81b502 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:26:57.339947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-cb6f9756-f729-4e38-8519-dc123c81b502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:57.442387 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f9756-f729-4e38-8519-dc123c81b502 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:26:57.516639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:26:57.523339 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c9032-646f-464a-b087-4ab6cbb0af40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:26:57.523938 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c9032-646f-464a-b087-4ab6cbb0af40 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:57.524216 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c9032-646f-464a-b087-4ab6cbb0af40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:57.524483 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c9032-646f-464a-b087-4ab6cbb0af40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:57.526083 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5e8c9032-646f-464a-b087-4ab6cbb0af40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:57.633305 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c9032-646f-464a-b087-4ab6cbb0af40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:26:57.634745 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c9032-646f-464a-b087-4ab6cbb0af40 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:26:57.652836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 575/1144] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:26:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:26:59.840001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd35275-b053-4bc5-8f7a-98698421e491 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:59.841255 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd35275-b053-4bc5-8f7a-98698421e491 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:59.841255 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd35275-b053-4bc5-8f7a-98698421e491 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:59.842478 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 570/1145] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 12:26:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:26:59.847815 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b862898-5ed3-43c1-b43f-c29a36b1ea1d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:26:59.848248 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b862898-5ed3-43c1-b43f-c29a36b1ea1d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:26:59.848362 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b862898-5ed3-43c1-b43f-c29a36b1ea1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:26:59.913543 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-5b862898-5ed3-43c1-b43f-c29a36b1ea1d None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:26:59.914725 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5b862898-5ed3-43c1-b43f-c29a36b1ea1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:26:59.962524 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:27:00.010674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 576/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 12:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:27:00.296662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd35275-b053-4bc5-8f7a-98698421e491 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:27:00.298212 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5bd35275-b053-4bc5-8f7a-98698421e491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:27:00.312086 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:27:00.399296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd35275-b053-4bc5-8f7a-98698421e491 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:27:00.470641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d552e61-f016-4757-badb-1a3a4e43e304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:27:00.471237 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d552e61-f016-4757-badb-1a3a4e43e304 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:00.471512 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d552e61-f016-4757-badb-1a3a4e43e304 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:00.471783 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d552e61-f016-4757-badb-1a3a4e43e304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:00.473414 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1d552e61-f016-4757-badb-1a3a4e43e304 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:27:00.538699 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:27:00.579688 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d552e61-f016-4757-badb-1a3a4e43e304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:27:00.581044 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d552e61-f016-4757-badb-1a3a4e43e304 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:27:00.599444 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 571/1147] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:27:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:27:10.009120 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=22 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:27:10.597035 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=25 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:27:20.376894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2b50d-e231-4547-ae3b-03749d90a41d None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:20.377489 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2b50d-e231-4547-ae3b-03749d90a41d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:20.377489 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2b50d-e231-4547-ae3b-03749d90a41d None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:20.378877 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 577/1148] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:27:20.384228 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ccb6c-9619-48fb-b570-bc4f9a01fbe0 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:20.384637 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ccb6c-9619-48fb-b570-bc4f9a01fbe0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:20.384791 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ccb6c-9619-48fb-b570-bc4f9a01fbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:20.451332 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2c8ccb6c-9619-48fb-b570-bc4f9a01fbe0 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:27:20.452536 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2c8ccb6c-9619-48fb-b570-bc4f9a01fbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:27:20.545129 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 572/1149] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:27:20.841815 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6aa80e-e0f6-41a5-839f-ad602d998164 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:20.842109 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6aa80e-e0f6-41a5-839f-ad602d998164 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:20.842410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6aa80e-e0f6-41a5-839f-ad602d998164 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:20.843735 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 578/1150] 10.222.0.18 () {54 vars in 962 bytes} [Mon Oct 31 12:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:27:20.848737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8a200-2add-442f-8722-7551720e50de None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:20.849022 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8a200-2add-442f-8722-7551720e50de None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:20.849326 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8a200-2add-442f-8722-7551720e50de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:20.924513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-29f8a200-2add-442f-8722-7551720e50de None None] MFA Rules not processed for user `d4c6b6b1cdc649dda3a9caa8d9713569`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:27:20.925739 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-29f8a200-2add-442f-8722-7551720e50de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:27:20.950643 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:27:21.000994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 573/1151] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Oct 31 12:27:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:27:21.008772 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6aa80e-e0f6-41a5-839f-ad602d998164 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:27:21.010294 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8a6aa80e-e0f6-41a5-839f-ad602d998164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:27:21.112725 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6aa80e-e0f6-41a5-839f-ad602d998164 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:27:21.185012 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c0ace-a5bd-4846-b7aa-4f5eeec4d65f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c6b6b1cdc649dda3a9caa8d9713569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:27:21.185635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c0ace-a5bd-4846-b7aa-4f5eeec4d65f service glance] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:21.185909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c0ace-a5bd-4846-b7aa-4f5eeec4d65f service glance] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:21.186175 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c0ace-a5bd-4846-b7aa-4f5eeec4d65f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:21.187728 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c37c0ace-a5bd-4846-b7aa-4f5eeec4d65f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:27:21.240680 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:27:21.293963 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c0ace-a5bd-4846-b7aa-4f5eeec4d65f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:27:21.295413 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c0ace-a5bd-4846-b7aa-4f5eeec4d65f service glance] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:27:21.313408 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 579/1152] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:27:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:27:23.548791 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765aecd-7769-49bd-b9ac-65f1dd8dcee6 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:23.549396 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765aecd-7769-49bd-b9ac-65f1dd8dcee6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:23.549516 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765aecd-7769-49bd-b9ac-65f1dd8dcee6 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:23.551943 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 574/1153] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:27:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:27:23.559140 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08a3ac-d7fc-438c-baee-de1c44c9b767 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:23.559580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08a3ac-d7fc-438c-baee-de1c44c9b767 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:23.559696 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08a3ac-d7fc-438c-baee-de1c44c9b767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:23.624465 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-2b08a3ac-d7fc-438c-baee-de1c44c9b767 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:27:23.625699 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2b08a3ac-d7fc-438c-baee-de1c44c9b767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:27:23.720723 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 580/1154] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:27:23.994703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765aecd-7769-49bd-b9ac-65f1dd8dcee6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:27:23.996228 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7765aecd-7769-49bd-b9ac-65f1dd8dcee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:27:24.117903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765aecd-7769-49bd-b9ac-65f1dd8dcee6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:27:24.165680 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:27:24.208829 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed25d28-8712-4e8c-b329-75546e12dcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:27:24.209388 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed25d28-8712-4e8c-b329-75546e12dcd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:24.209661 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed25d28-8712-4e8c-b329-75546e12dcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:24.209927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed25d28-8712-4e8c-b329-75546e12dcd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:24.210554 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed25d28-8712-4e8c-b329-75546e12dcd9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:27:24.211637 dv-cinder-796170-6-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-eed25d28-8712-4e8c-b329-75546e12dcd9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 12:27:24.211637 dv-cinder-796170-6-smb devstack@keystone.service[81458]: warnings.warn(msg) Oct 31 12:27:24.211637 dv-cinder-796170-6-smb devstack@keystone.service[81458]: Oct 31 12:27:24.212757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed25d28-8712-4e8c-b329-75546e12dcd9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:27:24.233176 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 575/1155] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Oct 31 12:27:23 2022] GET /identity/v3/projects => generated 2553 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:27:26.419536 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb49ae9-4042-416a-9db1-7a3451a1e619 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:26.420099 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb49ae9-4042-416a-9db1-7a3451a1e619 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:26.420099 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb49ae9-4042-416a-9db1-7a3451a1e619 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:26.421478 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 581/1156] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:27:26.426797 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8d52c-d986-461b-bfc7-e3ec141ca4e8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:26.427201 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8d52c-d986-461b-bfc7-e3ec141ca4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:26.427354 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8d52c-d986-461b-bfc7-e3ec141ca4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:26.492748 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3bd8d52c-d986-461b-bfc7-e3ec141ca4e8 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:27:26.494002 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3bd8d52c-d986-461b-bfc7-e3ec141ca4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:27:26.588517 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 576/1157] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:27:26.886228 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb49ae9-4042-416a-9db1-7a3451a1e619 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:27:26.887822 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3bb49ae9-4042-416a-9db1-7a3451a1e619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:27:26.897580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:27:27.030554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb49ae9-4042-416a-9db1-7a3451a1e619 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:27:27.110290 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:27:27.143575 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fb000-841d-47ff-a0b6-5eb9d4087e43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:27:27.144121 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fb000-841d-47ff-a0b6-5eb9d4087e43 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:27.144429 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fb000-841d-47ff-a0b6-5eb9d4087e43 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:27.144802 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fb000-841d-47ff-a0b6-5eb9d4087e43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:27.146416 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-fb4fb000-841d-47ff-a0b6-5eb9d4087e43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:27:27.235024 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fb000-841d-47ff-a0b6-5eb9d4087e43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:27:27.236600 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fb000-841d-47ff-a0b6-5eb9d4087e43 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:27:27.254306 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 582/1158] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:27:29.569802 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98000f2f-9b0a-4a2c-a78c-68b840c2a985 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:29.570372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98000f2f-9b0a-4a2c-a78c-68b840c2a985 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:29.570372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98000f2f-9b0a-4a2c-a78c-68b840c2a985 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:29.571696 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 577/1159] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:27:29.576991 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef915b-0e46-4860-96ce-0a6d4bf4adb4 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:29.577461 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef915b-0e46-4860-96ce-0a6d4bf4adb4 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:29.577583 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef915b-0e46-4860-96ce-0a6d4bf4adb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:29.642276 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-a0ef915b-0e46-4860-96ce-0a6d4bf4adb4 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:27:29.643480 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a0ef915b-0e46-4860-96ce-0a6d4bf4adb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:27:29.688834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:27:29.738761 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 583/1160] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:27:30.023892 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98000f2f-9b0a-4a2c-a78c-68b840c2a985 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:27:30.025501 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-98000f2f-9b0a-4a2c-a78c-68b840c2a985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:27:30.050315 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:27:30.128367 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98000f2f-9b0a-4a2c-a78c-68b840c2a985 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:27:30.199096 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4129c6-cf73-412a-aa00-80b9e4baf6e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:27:30.199689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4129c6-cf73-412a-aa00-80b9e4baf6e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:30.199962 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4129c6-cf73-412a-aa00-80b9e4baf6e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:30.200226 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4129c6-cf73-412a-aa00-80b9e4baf6e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:30.201806 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9c4129c6-cf73-412a-aa00-80b9e4baf6e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:27:30.273999 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:27:30.309698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4129c6-cf73-412a-aa00-80b9e4baf6e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:27:30.311146 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4129c6-cf73-412a-aa00-80b9e4baf6e7 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:27:30.330841 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 578/1161] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:27:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:27:32.530497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfec6d-1a82-409b-a6f1-814c92dba638 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:32.531043 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfec6d-1a82-409b-a6f1-814c92dba638 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:32.531043 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfec6d-1a82-409b-a6f1-814c92dba638 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:32.532382 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 584/1162] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:27:32.537847 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fdffa-fdab-4240-b44f-70e9d1cb3acb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:32.538251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fdffa-fdab-4240-b44f-70e9d1cb3acb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:32.538364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fdffa-fdab-4240-b44f-70e9d1cb3acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:32.602209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-419fdffa-fdab-4240-b44f-70e9d1cb3acb None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:27:32.603400 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-419fdffa-fdab-4240-b44f-70e9d1cb3acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:27:32.698012 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 579/1163] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:27:32.987478 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfec6d-1a82-409b-a6f1-814c92dba638 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:27:32.988987 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8dcfec6d-1a82-409b-a6f1-814c92dba638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:27:33.090896 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfec6d-1a82-409b-a6f1-814c92dba638 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:27:33.160415 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:27:33.162122 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e34cf-5e30-476a-92e8-0260e743d6a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:27:33.162731 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e34cf-5e30-476a-92e8-0260e743d6a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:33.163196 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e34cf-5e30-476a-92e8-0260e743d6a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:33.163648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e34cf-5e30-476a-92e8-0260e743d6a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:33.165400 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8e7e34cf-5e30-476a-92e8-0260e743d6a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:27:33.271057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e34cf-5e30-476a-92e8-0260e743d6a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:27:33.272414 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e34cf-5e30-476a-92e8-0260e743d6a7 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:27:33.290711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 585/1164] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:27:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:27:35.503523 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cba73-0fd7-4200-84fb-9e8e2ac4acb6 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:35.504117 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cba73-0fd7-4200-84fb-9e8e2ac4acb6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:35.504117 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cba73-0fd7-4200-84fb-9e8e2ac4acb6 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:35.505457 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 580/1165] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:27:35.510621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19360a93-8196-426f-842f-2dc4f33e7455 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:35.511056 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19360a93-8196-426f-842f-2dc4f33e7455 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:35.511753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19360a93-8196-426f-842f-2dc4f33e7455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:35.576073 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-19360a93-8196-426f-842f-2dc4f33e7455 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:27:35.577299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-19360a93-8196-426f-842f-2dc4f33e7455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:27:35.629619 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:27:35.672639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 586/1166] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:27:35.963206 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cba73-0fd7-4200-84fb-9e8e2ac4acb6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:27:35.965270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b16cba73-0fd7-4200-84fb-9e8e2ac4acb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:27:36.000998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:27:36.068622 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cba73-0fd7-4200-84fb-9e8e2ac4acb6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:27:36.140676 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72d0ae-0e53-4c31-bf27-231ffcbfaad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:27:36.141307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72d0ae-0e53-4c31-bf27-231ffcbfaad0 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:36.141590 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72d0ae-0e53-4c31-bf27-231ffcbfaad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:36.141866 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72d0ae-0e53-4c31-bf27-231ffcbfaad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:36.143434 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cf72d0ae-0e53-4c31-bf27-231ffcbfaad0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:27:36.223033 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:27:36.252252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72d0ae-0e53-4c31-bf27-231ffcbfaad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:27:36.253699 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72d0ae-0e53-4c31-bf27-231ffcbfaad0 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:27:36.271523 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 581/1167] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:27:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:27:38.698771 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0d9b6-7f1c-4e1d-8b73-9cd65638a919 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:38.699341 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0d9b6-7f1c-4e1d-8b73-9cd65638a919 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:38.699341 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0d9b6-7f1c-4e1d-8b73-9cd65638a919 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:38.700669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 587/1168] 10.222.0.18 () {54 vars in 927 bytes} [Mon Oct 31 12:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:27:38.706163 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee485a-b2a0-404d-9638-13efbe247e88 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:38.706609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee485a-b2a0-404d-9638-13efbe247e88 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:38.706720 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee485a-b2a0-404d-9638-13efbe247e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:38.772103 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-66ee485a-b2a0-404d-9638-13efbe247e88 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:27:38.773327 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-66ee485a-b2a0-404d-9638-13efbe247e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:27:38.869907 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 582/1169] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Oct 31 12:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:27:39.162870 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0d9b6-7f1c-4e1d-8b73-9cd65638a919 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:27:39.164385 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-17a0d9b6-7f1c-4e1d-8b73-9cd65638a919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:27:39.264611 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0d9b6-7f1c-4e1d-8b73-9cd65638a919 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:27:39.336570 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2006ff1-559f-490e-8d6d-00c7dd174db9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:27:39.337200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2006ff1-559f-490e-8d6d-00c7dd174db9 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:27:39.337473 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2006ff1-559f-490e-8d6d-00c7dd174db9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:27:39.337737 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2006ff1-559f-490e-8d6d-00c7dd174db9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:27:39.339837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d2006ff1-559f-490e-8d6d-00c7dd174db9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:27:39.348355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:27:39.447355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2006ff1-559f-490e-8d6d-00c7dd174db9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:27:39.449337 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2006ff1-559f-490e-8d6d-00c7dd174db9 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:27:39.467578 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 588/1170] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:27:48.868342 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=82 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:27:49.465405 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=50 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:28:58.882881 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80661bbb-efbe-4a42-b8ea-9ecad0f2905d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:28:58.883473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80661bbb-efbe-4a42-b8ea-9ecad0f2905d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:28:58.883473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80661bbb-efbe-4a42-b8ea-9ecad0f2905d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:28:58.958543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-80661bbb-efbe-4a42-b8ea-9ecad0f2905d None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:28:58.959750 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-80661bbb-efbe-4a42-b8ea-9ecad0f2905d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:28:59.055264 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 583/1171] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:28:59.063980 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d95099-d9bd-48db-8be0-7756ba568513 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:28:59.064487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d95099-d9bd-48db-8be0-7756ba568513 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:28:59.064592 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d95099-d9bd-48db-8be0-7756ba568513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:28:59.138898 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-78d95099-d9bd-48db-8be0-7756ba568513 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:28:59.140033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-78d95099-d9bd-48db-8be0-7756ba568513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:28:59.235899 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 589/1172] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:28:59.240724 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80661bbb-efbe-4a42-b8ea-9ecad0f2905d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:28:59.241984 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-80661bbb-efbe-4a42-b8ea-9ecad0f2905d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:28:59.253240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80661bbb-efbe-4a42-b8ea-9ecad0f2905d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:28:59.313908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:28:59.347344 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2e233-b881-431e-932f-2087443d8fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:28:59.347949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2e233-b881-431e-932f-2087443d8fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:28:59.348239 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2e233-b881-431e-932f-2087443d8fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:28:59.348507 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2e233-b881-431e-932f-2087443d8fd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:28:59.349173 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2e233-b881-431e-932f-2087443d8fd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:28:59.349478 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2e233-b881-431e-932f-2087443d8fd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:28:59.350474 dv-cinder-796170-6-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-59b2e233-b881-431e-932f-2087443d8fd5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 12:28:59.350474 dv-cinder-796170-6-smb devstack@keystone.service[81458]: warnings.warn(msg) Oct 31 12:28:59.350474 dv-cinder-796170-6-smb devstack@keystone.service[81458]: Oct 31 12:28:59.351356 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2e233-b881-431e-932f-2087443d8fd5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:28:59.362801 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 584/1173] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:28:59.372100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d95099-d9bd-48db-8be0-7756ba568513 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:28:59.381294 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d95099-d9bd-48db-8be0-7756ba568513 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:28:59.442085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:28:59.475169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14985a-5089-4bee-ad51-3d0816b33de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:28:59.475763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14985a-5089-4bee-ad51-3d0816b33de4 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:28:59.476040 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14985a-5089-4bee-ad51-3d0816b33de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:28:59.476305 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14985a-5089-4bee-ad51-3d0816b33de4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:28:59.476929 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14985a-5089-4bee-ad51-3d0816b33de4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:28:59.478261 dv-cinder-796170-6-smb devstack@keystone.service[81457]: WARNING py.warnings [None req-fe14985a-5089-4bee-ad51-3d0816b33de4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 12:28:59.478261 dv-cinder-796170-6-smb devstack@keystone.service[81457]: warnings.warn(msg) Oct 31 12:28:59.478261 dv-cinder-796170-6-smb devstack@keystone.service[81457]: Oct 31 12:28:59.480058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14985a-5089-4bee-ad51-3d0816b33de4 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:28:59.534758 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 590/1174] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:28:59 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:28:59.539220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2e233-b881-431e-932f-2087443d8fd5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:28:59.540714 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-59b2e233-b881-431e-932f-2087443d8fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:28:59.573510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2e233-b881-431e-932f-2087443d8fd5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:28:59.666785 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5463b35-a4bb-4b75-99a3-ac39de605dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:28:59.667313 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5463b35-a4bb-4b75-99a3-ac39de605dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:28:59.667588 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5463b35-a4bb-4b75-99a3-ac39de605dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:28:59.667857 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5463b35-a4bb-4b75-99a3-ac39de605dd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:28:59.668481 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5463b35-a4bb-4b75-99a3-ac39de605dd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:28:59.669504 dv-cinder-796170-6-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-b5463b35-a4bb-4b75-99a3-ac39de605dd0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 12:28:59.669504 dv-cinder-796170-6-smb devstack@keystone.service[81458]: warnings.warn(msg) Oct 31 12:28:59.669504 dv-cinder-796170-6-smb devstack@keystone.service[81458]: Oct 31 12:28:59.670735 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5463b35-a4bb-4b75-99a3-ac39de605dd0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:28:59.712021 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 585/1175] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:28:59 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:28:59.716628 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14985a-5089-4bee-ad51-3d0816b33de4 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:28:59.718148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-fe14985a-5089-4bee-ad51-3d0816b33de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:28:59.778909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14985a-5089-4bee-ad51-3d0816b33de4 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:28:59.863234 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:28:59.875360 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f70445-0600-4dcb-af50-27324c161d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:28:59.875958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f70445-0600-4dcb-af50-27324c161d04 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:28:59.876235 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f70445-0600-4dcb-af50-27324c161d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:28:59.876502 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f70445-0600-4dcb-af50-27324c161d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:28:59.877165 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f70445-0600-4dcb-af50-27324c161d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:28:59.878786 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f70445-0600-4dcb-af50-27324c161d04 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:28:59.891313 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 591/1176] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:28:59.895517 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5463b35-a4bb-4b75-99a3-ac39de605dd0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:28:59.897093 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b5463b35-a4bb-4b75-99a3-ac39de605dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:28:59.908252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5463b35-a4bb-4b75-99a3-ac39de605dd0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:28:59.932824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:29:00.002746 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd218d90-9d54-4eac-9403-cd55a31b863b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:29:00.003362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd218d90-9d54-4eac-9403-cd55a31b863b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:29:00.003623 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd218d90-9d54-4eac-9403-cd55a31b863b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:29:00.003889 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd218d90-9d54-4eac-9403-cd55a31b863b admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:29:00.004527 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd218d90-9d54-4eac-9403-cd55a31b863b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:29:00.006129 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd218d90-9d54-4eac-9403-cd55a31b863b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:29:00.018704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 586/1177] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:29:00.023002 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f70445-0600-4dcb-af50-27324c161d04 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:29:00.024516 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d8f70445-0600-4dcb-af50-27324c161d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:29:00.058168 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f70445-0600-4dcb-af50-27324c161d04 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:29:00.150497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e94add-66d0-41bc-8965-37ef0d9931d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:29:00.151198 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e94add-66d0-41bc-8965-37ef0d9931d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:29:00.151479 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e94add-66d0-41bc-8965-37ef0d9931d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:29:00.151750 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e94add-66d0-41bc-8965-37ef0d9931d7 admin admin] PATH_INFO: `/v3/projects/68b14f04cb314db687ecfe6206bd7976/users/c036bf8fd05d4232b1e74cffd7eb11a5/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:29:00.173890 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e94add-66d0-41bc-8965-37ef0d9931d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b14f04cb314db687ecfe6206bd7976, user_id=c036bf8fd05d4232b1e74cffd7eb11a5, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:29:00.176536 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e94add-66d0-41bc-8965-37ef0d9931d7 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:29:00.201539 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 592/1178] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:29:00 2022] PUT /identity/v3/projects/68b14f04cb314db687ecfe6206bd7976/users/c036bf8fd05d4232b1e74cffd7eb11a5/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:29:00.212608 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9dee1-09be-4205-b0c1-e415d1ac430a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:29:00.212894 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9dee1-09be-4205-b0c1-e415d1ac430a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:29:00.213206 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9dee1-09be-4205-b0c1-e415d1ac430a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:29:00.268598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-65e9dee1-09be-4205-b0c1-e415d1ac430a None None] MFA Rules not processed for user `c036bf8fd05d4232b1e74cffd7eb11a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:29:00.269818 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-65e9dee1-09be-4205-b0c1-e415d1ac430a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:29:00.343940 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 587/1179] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:29:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:29:00.357403 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b8368-6133-4edf-8209-dfa1514eb90a None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:29:00.357691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b8368-6133-4edf-8209-dfa1514eb90a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:29:00.357969 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b8368-6133-4edf-8209-dfa1514eb90a None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:29:00.359298 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 593/1180] 10.222.0.18 () {54 vars in 963 bytes} [Mon Oct 31 12:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:29:00.363818 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5bc90-f52a-4e46-a2eb-c686ac345e64 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:29:00.364101 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5bc90-f52a-4e46-a2eb-c686ac345e64 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:29:00.364374 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5bc90-f52a-4e46-a2eb-c686ac345e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:29:00.395292 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:29:00.439530 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-59c5bc90-f52a-4e46-a2eb-c686ac345e64 None None] MFA Rules not processed for user `b2ffd08478684105b83c4e74566ca6a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:29:00.440714 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-59c5bc90-f52a-4e46-a2eb-c686ac345e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:29:00.514780 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 588/1181] 10.222.0.18 () {58 vars in 1060 bytes} [Mon Oct 31 12:29:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:29:00.522392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b8368-6133-4edf-8209-dfa1514eb90a None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:29:00.523900 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a60b8368-6133-4edf-8209-dfa1514eb90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:29:00.573416 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:29:00.627895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b8368-6133-4edf-8209-dfa1514eb90a None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:29:00.700042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3069080-6617-421f-af80-9c9166267e58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:29:00.700644 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3069080-6617-421f-af80-9c9166267e58 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:29:00.700921 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3069080-6617-421f-af80-9c9166267e58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:29:00.701222 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3069080-6617-421f-af80-9c9166267e58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:29:00.702786 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c3069080-6617-421f-af80-9c9166267e58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:29:00.799231 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3069080-6617-421f-af80-9c9166267e58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:29:00.800566 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3069080-6617-421f-af80-9c9166267e58 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:29:00.804079 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:29:00.818513 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 594/1182] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:29:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:29:00.863553 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6796b-fd44-47f4-9054-96aab89a6bec None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:29:00.863845 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6796b-fd44-47f4-9054-96aab89a6bec None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:29:00.864125 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6796b-fd44-47f4-9054-96aab89a6bec None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:29:00.865442 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 589/1183] 10.222.0.18 () {52 vars in 830 bytes} [Mon Oct 31 12:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:29:00.868889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3069080-6617-421f-af80-9c9166267e58 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:29:00.870149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c3069080-6617-421f-af80-9c9166267e58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:29:00.966369 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3069080-6617-421f-af80-9c9166267e58 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:29:01.061671 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b121b-8b50-4ec3-9c84-58e9f5fbf96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:29:01.062201 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b121b-8b50-4ec3-9c84-58e9f5fbf96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:29:01.062474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b121b-8b50-4ec3-9c84-58e9f5fbf96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:29:01.062737 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b121b-8b50-4ec3-9c84-58e9f5fbf96f admin admin] PATH_INFO: `/v3/users/c036bf8fd05d4232b1e74cffd7eb11a5` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:29:01.076330 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b121b-8b50-4ec3-9c84-58e9f5fbf96f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c036bf8fd05d4232b1e74cffd7eb11a5)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:29:01.077295 dv-cinder-796170-6-smb devstack@keystone.service[81457]: WARNING py.warnings [None req-ea1b121b-8b50-4ec3-9c84-58e9f5fbf96f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 12:29:01.077295 dv-cinder-796170-6-smb devstack@keystone.service[81457]: warnings.warn(msg) Oct 31 12:29:01.077295 dv-cinder-796170-6-smb devstack@keystone.service[81457]: Oct 31 12:29:01.078493 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b121b-8b50-4ec3-9c84-58e9f5fbf96f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:29:01.088045 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:29:01.143297 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ea1b121b-8b50-4ec3-9c84-58e9f5fbf96f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c036bf8fd05d4232b1e74cffd7eb11a5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:29:01.143838 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ea1b121b-8b50-4ec3-9c84-58e9f5fbf96f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c036bf8fd05d4232b1e74cffd7eb11a5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:29:01.144256 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ea1b121b-8b50-4ec3-9c84-58e9f5fbf96f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c036bf8fd05d4232b1e74cffd7eb11a5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:29:01.158552 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ea1b121b-8b50-4ec3-9c84-58e9f5fbf96f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c036bf8fd05d4232b1e74cffd7eb11a5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:29:01.168128 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ea1b121b-8b50-4ec3-9c84-58e9f5fbf96f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c036bf8fd05d4232b1e74cffd7eb11a5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:29:01.196568 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 595/1184] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:29:00 2022] DELETE /identity/v3/users/c036bf8fd05d4232b1e74cffd7eb11a5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:29:01.201504 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a54cf6-34c0-4514-88d2-b2f2db4c20e9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:29:01.201978 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a54cf6-34c0-4514-88d2-b2f2db4c20e9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:29:01.202073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a54cf6-34c0-4514-88d2-b2f2db4c20e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:29:01.258394 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-36a54cf6-34c0-4514-88d2-b2f2db4c20e9 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:29:01.259601 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-36a54cf6-34c0-4514-88d2-b2f2db4c20e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:29:01.333920 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:29:01.346729 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 590/1185] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:29:01.357220 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b121b-8b50-4ec3-9c84-58e9f5fbf96f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:29:01.358475 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ea1b121b-8b50-4ec3-9c84-58e9f5fbf96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:29:01.458432 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b121b-8b50-4ec3-9c84-58e9f5fbf96f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:29:01.511437 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:29:01.532197 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702518d2-c0a4-46b5-aaf9-88a7ba0f6288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:29:01.532805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702518d2-c0a4-46b5-aaf9-88a7ba0f6288 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:29:01.533084 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702518d2-c0a4-46b5-aaf9-88a7ba0f6288 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:29:01.533386 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702518d2-c0a4-46b5-aaf9-88a7ba0f6288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:29:01.534982 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-702518d2-c0a4-46b5-aaf9-88a7ba0f6288 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:29:01.641822 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702518d2-c0a4-46b5-aaf9-88a7ba0f6288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:29:01.643248 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702518d2-c0a4-46b5-aaf9-88a7ba0f6288 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:29:01.662140 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 596/1186] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:29:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:29:02.014491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a54cf6-34c0-4514-88d2-b2f2db4c20e9 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:29:02.015772 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-36a54cf6-34c0-4514-88d2-b2f2db4c20e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:29:02.027649 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a54cf6-34c0-4514-88d2-b2f2db4c20e9 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:29:02.132851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32900f-ec65-434a-b4fe-ce5c548516c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:29:02.133508 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32900f-ec65-434a-b4fe-ce5c548516c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:29:02.133791 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32900f-ec65-434a-b4fe-ce5c548516c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:29:02.134067 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32900f-ec65-434a-b4fe-ce5c548516c8 admin admin] PATH_INFO: `/v3/projects/68b14f04cb314db687ecfe6206bd7976` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:29:02.144518 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32900f-ec65-434a-b4fe-ce5c548516c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68b14f04cb314db687ecfe6206bd7976)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:29:02.145575 dv-cinder-796170-6-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-ff32900f-ec65-434a-b4fe-ce5c548516c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 12:29:02.145575 dv-cinder-796170-6-smb devstack@keystone.service[81458]: warnings.warn(msg) Oct 31 12:29:02.145575 dv-cinder-796170-6-smb devstack@keystone.service[81458]: Oct 31 12:29:02.146769 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32900f-ec65-434a-b4fe-ce5c548516c8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:29:02.204232 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ff32900f-ec65-434a-b4fe-ce5c548516c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68b14f04cb314db687ecfe6206bd7976', 'request_id': 'req-ff32900f-ec65-434a-b4fe-ce5c548516c8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:29:02.213662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ff32900f-ec65-434a-b4fe-ce5c548516c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68b14f04cb314db687ecfe6206bd7976', 'request_id': 'req-ff32900f-ec65-434a-b4fe-ce5c548516c8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:29:02.219616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ff32900f-ec65-434a-b4fe-ce5c548516c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68b14f04cb314db687ecfe6206bd7976', 'request_id': 'req-ff32900f-ec65-434a-b4fe-ce5c548516c8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:29:02.248746 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ff32900f-ec65-434a-b4fe-ce5c548516c8 admin admin] The token cache is being invalidate because project 68b14f04cb314db687ecfe6206bd7976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:29:02.249037 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ff32900f-ec65-434a-b4fe-ce5c548516c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:29:02.249577 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ff32900f-ec65-434a-b4fe-ce5c548516c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:29:02.250874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 591/1187] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:29:02 2022] DELETE /identity/v3/projects/68b14f04cb314db687ecfe6206bd7976 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:29:11.659674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=62 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:29:12.246757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:30:32.642191 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76494c67-dc32-4926-aceb-8ae58c9bdb29 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:32.642776 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76494c67-dc32-4926-aceb-8ae58c9bdb29 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:32.642776 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76494c67-dc32-4926-aceb-8ae58c9bdb29 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:32.644153 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 597/1188] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 12:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:30:32.649131 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17962e-e082-4da0-8d5b-0b1488484dd6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:32.649593 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17962e-e082-4da0-8d5b-0b1488484dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:32.649691 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17962e-e082-4da0-8d5b-0b1488484dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:32.735720 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ee17962e-e082-4da0-8d5b-0b1488484dd6 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:30:32.736956 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ee17962e-e082-4da0-8d5b-0b1488484dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:30:32.849020 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 592/1189] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 12:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:30:33.008191 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76494c67-dc32-4926-aceb-8ae58c9bdb29 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:30:33.010413 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-76494c67-dc32-4926-aceb-8ae58c9bdb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:30:33.148903 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76494c67-dc32-4926-aceb-8ae58c9bdb29 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:30:33.155105 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c2ae2-4502-4e48-b413-41fec6cce6e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:30:33.155742 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c2ae2-4502-4e48-b413-41fec6cce6e0 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:33.156028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c2ae2-4502-4e48-b413-41fec6cce6e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:33.156311 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c2ae2-4502-4e48-b413-41fec6cce6e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:33.166877 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c2ae2-4502-4e48-b413-41fec6cce6e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:30:33.169212 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c2ae2-4502-4e48-b413-41fec6cce6e0 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:30:33.181059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 598/1190] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:30:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:30:33.694351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e058bc-d1e7-4f04-887b-3add55a6ae98 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:33.694904 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e058bc-d1e7-4f04-887b-3add55a6ae98 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:33.694904 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e058bc-d1e7-4f04-887b-3add55a6ae98 None None] PATH_INFO: `/v3` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:33.696346 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 593/1191] 10.222.0.26 () {54 vars in 925 bytes} [Mon Oct 31 12:30:33 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:30:33.702663 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf1252-2810-4bf0-b115-0be8b1eb6aff None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:33.703133 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf1252-2810-4bf0-b115-0be8b1eb6aff None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:33.703230 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf1252-2810-4bf0-b115-0be8b1eb6aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:33.773352 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-68bf1252-2810-4bf0-b115-0be8b1eb6aff None None] MFA Rules not processed for user `18c015b8317b4517911f69bef21a0573`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:30:33.774598 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-68bf1252-2810-4bf0-b115-0be8b1eb6aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:30:33.849542 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:30:33.856065 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 599/1192] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Oct 31 12:30:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:30:34.283801 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a6546-20ac-436f-b7fc-c6f26af239ed None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:34.284090 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a6546-20ac-436f-b7fc-c6f26af239ed None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:34.284392 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a6546-20ac-436f-b7fc-c6f26af239ed None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:34.286137 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 594/1193] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 12:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:30:34.291013 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf212792-3ba3-49f1-8eb3-7f4a7f18ec9a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:34.291298 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf212792-3ba3-49f1-8eb3-7f4a7f18ec9a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:34.291580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf212792-3ba3-49f1-8eb3-7f4a7f18ec9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:34.312000 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-bf212792-3ba3-49f1-8eb3-7f4a7f18ec9a None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:30:34.313279 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-bf212792-3ba3-49f1-8eb3-7f4a7f18ec9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:30:34.321292 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 600/1194] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 12:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:30:34.472462 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a6546-20ac-436f-b7fc-c6f26af239ed None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:30:34.487349 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a6546-20ac-436f-b7fc-c6f26af239ed None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:30:34.493146 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3107031-f728-4e49-83e6-2ba59ba4a0f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:30:34.493750 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3107031-f728-4e49-83e6-2ba59ba4a0f7 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:34.494031 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3107031-f728-4e49-83e6-2ba59ba4a0f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:34.494300 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3107031-f728-4e49-83e6-2ba59ba4a0f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:34.503363 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3107031-f728-4e49-83e6-2ba59ba4a0f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:30:34.504941 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3107031-f728-4e49-83e6-2ba59ba4a0f7 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:30:34.515104 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 595/1195] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:30:37.320981 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e898b18-97ff-4739-ba07-7e6015ea58aa None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:37.321507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e898b18-97ff-4739-ba07-7e6015ea58aa None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:37.321602 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e898b18-97ff-4739-ba07-7e6015ea58aa None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:37.322939 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 601/1196] 10.222.0.18 () {54 vars in 961 bytes} [Mon Oct 31 12:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:30:37.328697 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ace267-ccf2-4bb7-b758-583bb04028a7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:37.329189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ace267-ccf2-4bb7-b758-583bb04028a7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:37.329189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ace267-ccf2-4bb7-b758-583bb04028a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:37.350646 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-41ace267-ccf2-4bb7-b758-583bb04028a7 None None] MFA Rules not processed for user `18c015b8317b4517911f69bef21a0573`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:30:37.351822 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-41ace267-ccf2-4bb7-b758-583bb04028a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:30:37.360886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 596/1197] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Oct 31 12:30:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:30:37.368566 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e898b18-97ff-4739-ba07-7e6015ea58aa None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:30:37.382675 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e898b18-97ff-4739-ba07-7e6015ea58aa None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:30:37.389063 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510e1a9-807e-4ed4-a6a1-988b5b9e09c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18c015b8317b4517911f69bef21a0573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:30:37.389793 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510e1a9-807e-4ed4-a6a1-988b5b9e09c6 service placement] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:37.390138 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510e1a9-807e-4ed4-a6a1-988b5b9e09c6 service placement] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:37.390472 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510e1a9-807e-4ed4-a6a1-988b5b9e09c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:37.399259 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510e1a9-807e-4ed4-a6a1-988b5b9e09c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:30:37.400910 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510e1a9-807e-4ed4-a6a1-988b5b9e09c6 service placement] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:30:37.410549 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 602/1198] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:30:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:30:46.001369 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76440129-6c30-494e-bcfb-850a799e0f0c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:46.001971 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76440129-6c30-494e-bcfb-850a799e0f0c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:46.001971 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76440129-6c30-494e-bcfb-850a799e0f0c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:46.003257 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 597/1199] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 12:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:30:46.008084 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c85a34-2d8a-4d26-bf55-3aa17e2e8fdd None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:46.008528 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c85a34-2d8a-4d26-bf55-3aa17e2e8fdd None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:46.008635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c85a34-2d8a-4d26-bf55-3aa17e2e8fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:46.028886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-25c85a34-2d8a-4d26-bf55-3aa17e2e8fdd None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:30:46.030113 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-25c85a34-2d8a-4d26-bf55-3aa17e2e8fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:30:46.038102 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 603/1200] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 12:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:30:46.193261 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76440129-6c30-494e-bcfb-850a799e0f0c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:30:46.207347 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76440129-6c30-494e-bcfb-850a799e0f0c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:30:46.212697 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653142ec-7d7a-413d-bbb4-05b45a8f3f30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:30:46.213330 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653142ec-7d7a-413d-bbb4-05b45a8f3f30 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:46.213608 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653142ec-7d7a-413d-bbb4-05b45a8f3f30 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:46.213879 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653142ec-7d7a-413d-bbb4-05b45a8f3f30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:46.222122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653142ec-7d7a-413d-bbb4-05b45a8f3f30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:30:46.223711 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653142ec-7d7a-413d-bbb4-05b45a8f3f30 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:30:46.233712 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 598/1201] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:30:47.290745 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f3878-3899-430c-8f7a-460e08e5aee8 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:47.291280 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f3878-3899-430c-8f7a-460e08e5aee8 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:47.291280 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f3878-3899-430c-8f7a-460e08e5aee8 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:47.292585 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 604/1202] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 12:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:30:47.297345 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85599e37-fb50-4856-91c3-2f757cffeab1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:47.297734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85599e37-fb50-4856-91c3-2f757cffeab1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:47.297893 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85599e37-fb50-4856-91c3-2f757cffeab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:47.317311 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-85599e37-fb50-4856-91c3-2f757cffeab1 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:30:47.318495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-85599e37-fb50-4856-91c3-2f757cffeab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:30:47.326817 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 599/1203] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 12:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:30:47.478080 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f3878-3899-430c-8f7a-460e08e5aee8 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:30:47.493180 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f3878-3899-430c-8f7a-460e08e5aee8 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:30:47.499327 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c5147-aa6f-42f8-8b8c-749ddb8ab80b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:30:47.499940 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c5147-aa6f-42f8-8b8c-749ddb8ab80b service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:47.500223 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c5147-aa6f-42f8-8b8c-749ddb8ab80b service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:47.500497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c5147-aa6f-42f8-8b8c-749ddb8ab80b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:47.508604 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c5147-aa6f-42f8-8b8c-749ddb8ab80b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:30:47.510223 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c5147-aa6f-42f8-8b8c-749ddb8ab80b service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:30:47.519430 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 605/1204] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:30:51.252064 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493a9af-a0c2-4010-8b0e-4d6ef333b7a3 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:51.252639 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493a9af-a0c2-4010-8b0e-4d6ef333b7a3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:51.252639 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493a9af-a0c2-4010-8b0e-4d6ef333b7a3 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:51.253990 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 600/1205] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 12:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:30:51.259154 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e68f8-2575-4bfb-be43-6c6eaf36951a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:51.259550 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e68f8-2575-4bfb-be43-6c6eaf36951a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:51.259703 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e68f8-2575-4bfb-be43-6c6eaf36951a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:51.279860 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-858e68f8-2575-4bfb-be43-6c6eaf36951a None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:30:51.281056 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-858e68f8-2575-4bfb-be43-6c6eaf36951a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:30:51.289069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 606/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 12:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:30:51.575200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493a9af-a0c2-4010-8b0e-4d6ef333b7a3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:30:51.576905 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b493a9af-a0c2-4010-8b0e-4d6ef333b7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:30:51.609053 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:30:51.654366 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493a9af-a0c2-4010-8b0e-4d6ef333b7a3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:30:51.657947 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa6f11-31b3-4d4a-9413-e1ee5fdca972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:30:51.658550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa6f11-31b3-4d4a-9413-e1ee5fdca972 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:51.658830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa6f11-31b3-4d4a-9413-e1ee5fdca972 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:51.659106 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa6f11-31b3-4d4a-9413-e1ee5fdca972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:51.668393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa6f11-31b3-4d4a-9413-e1ee5fdca972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:30:51.669847 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa6f11-31b3-4d4a-9413-e1ee5fdca972 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:30:51.679056 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 601/1207] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:30:53.832330 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9814e-0cad-495c-8015-42bf6696d34e None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:53.832846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9814e-0cad-495c-8015-42bf6696d34e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:53.832955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9814e-0cad-495c-8015-42bf6696d34e None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:53.834311 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 607/1208] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 12:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:30:53.840106 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16609da6-a78b-41c7-98ba-b49f8515e0e9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:53.840502 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16609da6-a78b-41c7-98ba-b49f8515e0e9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:53.840690 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16609da6-a78b-41c7-98ba-b49f8515e0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:53.860720 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-16609da6-a78b-41c7-98ba-b49f8515e0e9 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:30:53.861942 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-16609da6-a78b-41c7-98ba-b49f8515e0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:30:53.869683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 602/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 12:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:30:54.156570 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9814e-0cad-495c-8015-42bf6696d34e None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:30:54.168162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9814e-0cad-495c-8015-42bf6696d34e None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:30:54.171839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4dee97-a467-4c93-b97d-c1c5d4ae0663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:30:54.172434 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dee97-a467-4c93-b97d-c1c5d4ae0663 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:54.172712 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dee97-a467-4c93-b97d-c1c5d4ae0663 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:54.172986 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dee97-a467-4c93-b97d-c1c5d4ae0663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:54.182045 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4dee97-a467-4c93-b97d-c1c5d4ae0663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:30:54.183462 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4dee97-a467-4c93-b97d-c1c5d4ae0663 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:30:54.192743 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 608/1210] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:30:57.781419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4106b-a6db-4a71-90ae-ff0458eb31cd None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:57.781991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4106b-a6db-4a71-90ae-ff0458eb31cd None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:57.781991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4106b-a6db-4a71-90ae-ff0458eb31cd None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:57.783273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 603/1211] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 12:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:30:57.788782 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d83b94-1e4a-4a3b-9492-b993af3ff5a3 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:57.789213 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d83b94-1e4a-4a3b-9492-b993af3ff5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:57.789365 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d83b94-1e4a-4a3b-9492-b993af3ff5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:57.808853 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-67d83b94-1e4a-4a3b-9492-b993af3ff5a3 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:30:57.810066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-67d83b94-1e4a-4a3b-9492-b993af3ff5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:30:57.817789 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 609/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 12:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:30:58.115130 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4106b-a6db-4a71-90ae-ff0458eb31cd None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:30:58.116817 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a9f4106b-a6db-4a71-90ae-ff0458eb31cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:30:58.194656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4106b-a6db-4a71-90ae-ff0458eb31cd None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:30:58.198236 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2ba45-39ff-41a6-adb1-463df3aba858 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:30:58.198832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2ba45-39ff-41a6-adb1-463df3aba858 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:30:58.199116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2ba45-39ff-41a6-adb1-463df3aba858 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:30:58.199398 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2ba45-39ff-41a6-adb1-463df3aba858 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:30:58.208135 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2ba45-39ff-41a6-adb1-463df3aba858 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:30:58.209587 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2ba45-39ff-41a6-adb1-463df3aba858 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:30:58.218850 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 604/1213] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:30:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:31:00.356371 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0b440-f532-4aab-beb4-5add1cfbb884 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:31:00.356932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0b440-f532-4aab-beb4-5add1cfbb884 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:31:00.356932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0b440-f532-4aab-beb4-5add1cfbb884 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:31:00.358299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 610/1214] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 12:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:31:00.363565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cfa88-3db9-43f2-a50b-c6a37d7f299f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:31:00.363955 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cfa88-3db9-43f2-a50b-c6a37d7f299f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:31:00.364148 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cfa88-3db9-43f2-a50b-c6a37d7f299f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:31:00.383793 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-236cfa88-3db9-43f2-a50b-c6a37d7f299f None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:31:00.385009 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-236cfa88-3db9-43f2-a50b-c6a37d7f299f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:31:00.392724 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 605/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 12:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:31:00.688671 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0b440-f532-4aab-beb4-5add1cfbb884 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:31:00.690383 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5ee0b440-f532-4aab-beb4-5add1cfbb884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:31:00.703143 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0b440-f532-4aab-beb4-5add1cfbb884 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:31:00.706623 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed7979-abb6-4d4a-988f-b5d0629b0ad3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:31:00.707208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed7979-abb6-4d4a-988f-b5d0629b0ad3 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:31:00.707486 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed7979-abb6-4d4a-988f-b5d0629b0ad3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:31:00.707775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed7979-abb6-4d4a-988f-b5d0629b0ad3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:31:00.716958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed7979-abb6-4d4a-988f-b5d0629b0ad3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:31:00.718389 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed7979-abb6-4d4a-988f-b5d0629b0ad3 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:31:00.727579 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 611/1216] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:31:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:31:10.378958 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=63 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:31:10.723528 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=37 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:26.660484 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002b7fc-1a92-48a3-9ac5-bf79844c8ff0 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:26.662345 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002b7fc-1a92-48a3-9ac5-bf79844c8ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:26.662345 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002b7fc-1a92-48a3-9ac5-bf79844c8ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:26.662542 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d18b8-639a-411d-a70f-8ed82fddd9c0 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:26.662542 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d18b8-639a-411d-a70f-8ed82fddd9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:26.663331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d18b8-639a-411d-a70f-8ed82fddd9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:26.690352 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-9a9d18b8-639a-411d-a70f-8ed82fddd9c0 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:26.691584 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9a9d18b8-639a-411d-a70f-8ed82fddd9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:26.691851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f002b7fc-1a92-48a3-9ac5-bf79844c8ff0 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:26.693288 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f002b7fc-1a92-48a3-9ac5-bf79844c8ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:26.708402 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 606/1217] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:26.708779 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 612/1218] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:32:26.710240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988dbaa-5c96-411e-b042-e4c257c7f96f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:26.710753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988dbaa-5c96-411e-b042-e4c257c7f96f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:26.711548 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988dbaa-5c96-411e-b042-e4c257c7f96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:26.720174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f7b23-f4ef-43cc-942f-949485b35274 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:26.720464 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f7b23-f4ef-43cc-942f-949485b35274 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:26.720734 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f7b23-f4ef-43cc-942f-949485b35274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:26.746810 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8988dbaa-5c96-411e-b042-e4c257c7f96f None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:26.748420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8988dbaa-5c96-411e-b042-e4c257c7f96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:26.761822 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-124f7b23-f4ef-43cc-942f-949485b35274 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:26.763038 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-124f7b23-f4ef-43cc-942f-949485b35274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:26.766473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 607/1219] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:26.767944 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c86034-2c6b-46ed-8694-eadfed93613e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:26.768453 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c86034-2c6b-46ed-8694-eadfed93613e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:26.768948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c86034-2c6b-46ed-8694-eadfed93613e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:26.785514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 613/1220] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:32:26.786842 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa1e3f-2b33-42cd-8e9b-334613cefe9c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:26.787132 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa1e3f-2b33-42cd-8e9b-334613cefe9c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:26.787405 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa1e3f-2b33-42cd-8e9b-334613cefe9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:26.801825 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-52c86034-2c6b-46ed-8694-eadfed93613e None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:26.804872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-52c86034-2c6b-46ed-8694-eadfed93613e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:26.816115 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 608/1221] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:26.818128 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c36b1-f49a-4918-a198-e594337f3854 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:26.818677 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c36b1-f49a-4918-a198-e594337f3854 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:26.818871 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-86aa1e3f-2b33-42cd-8e9b-334613cefe9c None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:26.819616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c36b1-f49a-4918-a198-e594337f3854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:26.819994 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-86aa1e3f-2b33-42cd-8e9b-334613cefe9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:26.829980 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 614/1222] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:26.831989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3a74d-7e09-4d35-8428-db9843f182c6 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:26.831989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3a74d-7e09-4d35-8428-db9843f182c6 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:26.831989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3a74d-7e09-4d35-8428-db9843f182c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:26.844094 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e12c36b1-f49a-4918-a198-e594337f3854 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:26.845749 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e12c36b1-f49a-4918-a198-e594337f3854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:26.853526 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-22d3a74d-7e09-4d35-8428-db9843f182c6 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:26.855056 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-22d3a74d-7e09-4d35-8428-db9843f182c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:26.856507 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 609/1223] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:26.857700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c36b1-f49a-4918-a198-e594337f3854 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:26.871433 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 615/1224] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:26.873085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f989be-7c42-4fd8-ac67-675e2979a0b5 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:26.873633 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f989be-7c42-4fd8-ac67-675e2979a0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:26.874206 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f989be-7c42-4fd8-ac67-675e2979a0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:26.875168 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c36b1-f49a-4918-a198-e594337f3854 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:26.880479 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a33371-bca2-49cf-99c0-6466144458c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:26.881096 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a33371-bca2-49cf-99c0-6466144458c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:26.881475 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a33371-bca2-49cf-99c0-6466144458c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:26.881817 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a33371-bca2-49cf-99c0-6466144458c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:26.882901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a33371-bca2-49cf-99c0-6466144458c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:32:26.883213 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a33371-bca2-49cf-99c0-6466144458c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:26.884924 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a33371-bca2-49cf-99c0-6466144458c3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:26.898564 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 610/1225] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:32:26.901850 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-50f989be-7c42-4fd8-ac67-675e2979a0b5 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:26.902197 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a33371-bca2-49cf-99c0-6466144458c3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:26.903496 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-50f989be-7c42-4fd8-ac67-675e2979a0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:26.916062 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a33371-bca2-49cf-99c0-6466144458c3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:26.917933 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 616/1226] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:26.918996 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f989be-7c42-4fd8-ac67-675e2979a0b5 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:26.923923 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32eb6e-aeeb-4cd3-867a-7b23ab45639d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:26.924537 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32eb6e-aeeb-4cd3-867a-7b23ab45639d admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:26.924825 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32eb6e-aeeb-4cd3-867a-7b23ab45639d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:26.925097 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32eb6e-aeeb-4cd3-867a-7b23ab45639d admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:26.925775 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32eb6e-aeeb-4cd3-867a-7b23ab45639d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:32:26.926083 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32eb6e-aeeb-4cd3-867a-7b23ab45639d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:26.927953 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32eb6e-aeeb-4cd3-867a-7b23ab45639d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:26.929226 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f989be-7c42-4fd8-ac67-675e2979a0b5 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:26.935039 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44481435-b829-4c48-a665-60f288abb2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:26.936062 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44481435-b829-4c48-a665-60f288abb2ff admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:26.936062 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44481435-b829-4c48-a665-60f288abb2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:26.936265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44481435-b829-4c48-a665-60f288abb2ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:26.936831 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44481435-b829-4c48-a665-60f288abb2ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:32:26.937160 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44481435-b829-4c48-a665-60f288abb2ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:26.938156 dv-cinder-796170-6-smb devstack@keystone.service[81457]: WARNING py.warnings [None req-44481435-b829-4c48-a665-60f288abb2ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 12:32:26.938156 dv-cinder-796170-6-smb devstack@keystone.service[81457]: warnings.warn(msg) Oct 31 12:32:26.938156 dv-cinder-796170-6-smb devstack@keystone.service[81457]: Oct 31 12:32:26.939039 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44481435-b829-4c48-a665-60f288abb2ff admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:26.942299 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 611/1227] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:32:26.942299 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701184d-e95c-4559-82ea-20bea065fe22 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:26.942299 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701184d-e95c-4559-82ea-20bea065fe22 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:26.942602 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701184d-e95c-4559-82ea-20bea065fe22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:26.952541 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 617/1228] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:32:26.953884 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a89763-95f9-436a-8876-14e47ecd2b21 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:26.954175 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a89763-95f9-436a-8876-14e47ecd2b21 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:26.954450 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a89763-95f9-436a-8876-14e47ecd2b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:26.962623 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c701184d-e95c-4559-82ea-20bea065fe22 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:26.963954 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c701184d-e95c-4559-82ea-20bea065fe22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:26.971930 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 612/1229] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:26.973078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baee0c-b903-4dba-abdb-174d6e5a2d34 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:26.973394 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baee0c-b903-4dba-abdb-174d6e5a2d34 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:26.973659 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baee0c-b903-4dba-abdb-174d6e5a2d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:26.973772 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-c6a89763-95f9-436a-8876-14e47ecd2b21 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:26.974865 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c6a89763-95f9-436a-8876-14e47ecd2b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:26.983160 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 618/1230] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:26.984033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a89763-95f9-436a-8876-14e47ecd2b21 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:26.993332 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a89763-95f9-436a-8876-14e47ecd2b21 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:26.993502 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b6baee0c-b903-4dba-abdb-174d6e5a2d34 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:26.995128 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b6baee0c-b903-4dba-abdb-174d6e5a2d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:26.998469 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd3ebd-85d6-4248-bf1f-c4c70ad6428c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:26.999060 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd3ebd-85d6-4248-bf1f-c4c70ad6428c admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:26.999341 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd3ebd-85d6-4248-bf1f-c4c70ad6428c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:26.999612 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd3ebd-85d6-4248-bf1f-c4c70ad6428c admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.000236 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd3ebd-85d6-4248-bf1f-c4c70ad6428c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.002158 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd3ebd-85d6-4248-bf1f-c4c70ad6428c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.002967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 613/1231] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:27.004134 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28937c5b-6a55-41c0-ae86-444381565da7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.004419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28937c5b-6a55-41c0-ae86-444381565da7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.004692 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28937c5b-6a55-41c0-ae86-444381565da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.024768 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-28937c5b-6a55-41c0-ae86-444381565da7 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:27.026043 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-28937c5b-6a55-41c0-ae86-444381565da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:27.034742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 614/1232] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:27.037254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f9566-1e72-4b8b-8e47-df3c5fb35fad None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.037254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f9566-1e72-4b8b-8e47-df3c5fb35fad None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.037254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f9566-1e72-4b8b-8e47-df3c5fb35fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.041754 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 619/1233] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:32:26 2022] POST /identity/v3/projects => generated 389 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:27.042557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd3ebd-85d6-4248-bf1f-c4c70ad6428c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.060315 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-129f9566-1e72-4b8b-8e47-df3c5fb35fad None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:27.061582 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-129f9566-1e72-4b8b-8e47-df3c5fb35fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:27.111040 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd3ebd-85d6-4248-bf1f-c4c70ad6428c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.115854 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5e37c-05fd-49f2-a4d5-a73928bfba87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.116462 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5e37c-05fd-49f2-a4d5-a73928bfba87 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.116744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5e37c-05fd-49f2-a4d5-a73928bfba87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.117017 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5e37c-05fd-49f2-a4d5-a73928bfba87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.117681 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5e37c-05fd-49f2-a4d5-a73928bfba87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.120088 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5e37c-05fd-49f2-a4d5-a73928bfba87 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.120682 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 615/1234] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:27.121589 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f9566-1e72-4b8b-8e47-df3c5fb35fad None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.130889 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f9566-1e72-4b8b-8e47-df3c5fb35fad None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.136191 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aee143-bc78-42ae-a86c-394c345e85f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.136782 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aee143-bc78-42ae-a86c-394c345e85f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.137063 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aee143-bc78-42ae-a86c-394c345e85f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.137365 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aee143-bc78-42ae-a86c-394c345e85f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.137991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aee143-bc78-42ae-a86c-394c345e85f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.138997 dv-cinder-796170-6-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-58aee143-bc78-42ae-a86c-394c345e85f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 12:32:27.138997 dv-cinder-796170-6-smb devstack@keystone.service[81458]: warnings.warn(msg) Oct 31 12:32:27.138997 dv-cinder-796170-6-smb devstack@keystone.service[81458]: Oct 31 12:32:27.140164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aee143-bc78-42ae-a86c-394c345e85f9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.155076 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 620/1235] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:32:27 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:27.155076 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e4601-86f4-44f2-91bf-e89351dc96d9 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.155076 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e4601-86f4-44f2-91bf-e89351dc96d9 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.155076 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e4601-86f4-44f2-91bf-e89351dc96d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.168146 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 616/1236] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:32:27 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:27.168927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aee143-bc78-42ae-a86c-394c345e85f9 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.174935 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-728e4601-86f4-44f2-91bf-e89351dc96d9 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:27.176133 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-728e4601-86f4-44f2-91bf-e89351dc96d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:27.232125 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aee143-bc78-42ae-a86c-394c345e85f9 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.235955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 621/1237] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:27.236784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e4601-86f4-44f2-91bf-e89351dc96d9 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.236907 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770377f-1db0-4606-b395-9ab2a0c625d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.237498 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770377f-1db0-4606-b395-9ab2a0c625d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.237783 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770377f-1db0-4606-b395-9ab2a0c625d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.238059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770377f-1db0-4606-b395-9ab2a0c625d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.238707 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770377f-1db0-4606-b395-9ab2a0c625d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:32:27.239012 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770377f-1db0-4606-b395-9ab2a0c625d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.240765 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770377f-1db0-4606-b395-9ab2a0c625d0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.243693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:27.250176 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:27.250717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e4601-86f4-44f2-91bf-e89351dc96d9 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.253985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 617/1238] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:32:27.255282 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0eb5a-7c30-4bad-8f4c-b2accfef370d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.255787 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0eb5a-7c30-4bad-8f4c-b2accfef370d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.256340 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0eb5a-7c30-4bad-8f4c-b2accfef370d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.263298 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0638f-27cc-40b7-b4a9-0daeca6267ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.263912 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0638f-27cc-40b7-b4a9-0daeca6267ca admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.264189 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0638f-27cc-40b7-b4a9-0daeca6267ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.264488 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0638f-27cc-40b7-b4a9-0daeca6267ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.265174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0638f-27cc-40b7-b4a9-0daeca6267ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:32:27.265500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0638f-27cc-40b7-b4a9-0daeca6267ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.267137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0638f-27cc-40b7-b4a9-0daeca6267ca admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.277883 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d4c0eb5a-7c30-4bad-8f4c-b2accfef370d None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:27.278900 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 622/1239] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:32:27.279096 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d4c0eb5a-7c30-4bad-8f4c-b2accfef370d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:27.279678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0638f-27cc-40b7-b4a9-0daeca6267ca admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.287474 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 618/1240] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:27.288520 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0eb5a-7c30-4bad-8f4c-b2accfef370d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.289752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0638f-27cc-40b7-b4a9-0daeca6267ca admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.295034 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f186170-d98e-42c5-81b5-4719d5a6292f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.295618 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f186170-d98e-42c5-81b5-4719d5a6292f admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.295893 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f186170-d98e-42c5-81b5-4719d5a6292f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.296159 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f186170-d98e-42c5-81b5-4719d5a6292f admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.296774 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f186170-d98e-42c5-81b5-4719d5a6292f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.297811 dv-cinder-796170-6-smb devstack@keystone.service[81457]: WARNING py.warnings [None req-3f186170-d98e-42c5-81b5-4719d5a6292f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 12:32:27.297811 dv-cinder-796170-6-smb devstack@keystone.service[81457]: warnings.warn(msg) Oct 31 12:32:27.297811 dv-cinder-796170-6-smb devstack@keystone.service[81457]: Oct 31 12:32:27.298380 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0eb5a-7c30-4bad-8f4c-b2accfef370d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.298993 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f186170-d98e-42c5-81b5-4719d5a6292f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.302891 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a4304-20fa-4f0c-96fd-2704a6ad8b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.303478 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a4304-20fa-4f0c-96fd-2704a6ad8b3a admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.303762 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a4304-20fa-4f0c-96fd-2704a6ad8b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.304037 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a4304-20fa-4f0c-96fd-2704a6ad8b3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.304685 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a4304-20fa-4f0c-96fd-2704a6ad8b3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:32:27.304996 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a4304-20fa-4f0c-96fd-2704a6ad8b3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.306614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a4304-20fa-4f0c-96fd-2704a6ad8b3a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.319859 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 619/1241] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:32:27.320722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a4304-20fa-4f0c-96fd-2704a6ad8b3a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.326454 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 623/1242] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:32:27 2022] POST /identity/v3/users => generated 295 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:27.326454 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f186170-d98e-42c5-81b5-4719d5a6292f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.331439 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a4304-20fa-4f0c-96fd-2704a6ad8b3a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.335879 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f186170-d98e-42c5-81b5-4719d5a6292f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.336103 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5940f-d62d-4ce7-9f15-4d9b3ab70d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.336699 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5940f-d62d-4ce7-9f15-4d9b3ab70d24 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.336981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5940f-d62d-4ce7-9f15-4d9b3ab70d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.337385 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5940f-d62d-4ce7-9f15-4d9b3ab70d24 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.338238 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5940f-d62d-4ce7-9f15-4d9b3ab70d24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.339906 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5940f-d62d-4ce7-9f15-4d9b3ab70d24 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.340604 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c76838-a7a6-4a38-8348-72b88cc3c864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.341206 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c76838-a7a6-4a38-8348-72b88cc3c864 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.341486 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c76838-a7a6-4a38-8348-72b88cc3c864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.341758 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c76838-a7a6-4a38-8348-72b88cc3c864 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.342379 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c76838-a7a6-4a38-8348-72b88cc3c864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.344305 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c76838-a7a6-4a38-8348-72b88cc3c864 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.364136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 620/1243] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:32:27 2022] POST /identity/v3/users => generated 286 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:27.365074 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5940f-d62d-4ce7-9f15-4d9b3ab70d24 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.367793 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 624/1244] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:32:27 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:27.368663 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c76838-a7a6-4a38-8348-72b88cc3c864 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.375560 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5940f-d62d-4ce7-9f15-4d9b3ab70d24 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.380164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d074179-e134-4526-aa1a-a1602826f634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.380417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c76838-a7a6-4a38-8348-72b88cc3c864 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.380756 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d074179-e134-4526-aa1a-a1602826f634 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.381040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d074179-e134-4526-aa1a-a1602826f634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.381396 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d074179-e134-4526-aa1a-a1602826f634 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.381978 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d074179-e134-4526-aa1a-a1602826f634 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:32:27.382278 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d074179-e134-4526-aa1a-a1602826f634 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.383853 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d074179-e134-4526-aa1a-a1602826f634 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.384858 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531e71f-ffa1-44e6-bfd3-3ccb36c1dc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.385532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531e71f-ffa1-44e6-bfd3-3ccb36c1dc9a admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.385808 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531e71f-ffa1-44e6-bfd3-3ccb36c1dc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.386462 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531e71f-ffa1-44e6-bfd3-3ccb36c1dc9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.386686 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531e71f-ffa1-44e6-bfd3-3ccb36c1dc9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.388570 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531e71f-ffa1-44e6-bfd3-3ccb36c1dc9a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.402249 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 621/1245] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:32:27.402249 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d074179-e134-4526-aa1a-a1602826f634 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.406030 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d074179-e134-4526-aa1a-a1602826f634 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.411718 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32567901-23ea-42ee-9885-d3aa82ba59ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.412426 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32567901-23ea-42ee-9885-d3aa82ba59ba admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.412732 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32567901-23ea-42ee-9885-d3aa82ba59ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.413618 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32567901-23ea-42ee-9885-d3aa82ba59ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.414285 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32567901-23ea-42ee-9885-d3aa82ba59ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.416937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32567901-23ea-42ee-9885-d3aa82ba59ba admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.422218 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 625/1246] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:32:27 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:27.422883 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531e71f-ffa1-44e6-bfd3-3ccb36c1dc9a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.445394 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 622/1247] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:32:27 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:27.446541 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32567901-23ea-42ee-9885-d3aa82ba59ba admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.489560 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531e71f-ffa1-44e6-bfd3-3ccb36c1dc9a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.508143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32567901-23ea-42ee-9885-d3aa82ba59ba admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.513256 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c62921-ebb4-47bf-9ee9-51d5688d9c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.514084 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c62921-ebb4-47bf-9ee9-51d5688d9c68 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.514766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c62921-ebb4-47bf-9ee9-51d5688d9c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.515026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c62921-ebb4-47bf-9ee9-51d5688d9c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.515750 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c62921-ebb4-47bf-9ee9-51d5688d9c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.517606 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c62921-ebb4-47bf-9ee9-51d5688d9c68 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.530650 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 623/1248] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:27.531500 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c62921-ebb4-47bf-9ee9-51d5688d9c68 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.543403 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c62921-ebb4-47bf-9ee9-51d5688d9c68 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.549315 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb02ad-825f-4f78-a0f7-72b1f47b9dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.549932 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb02ad-825f-4f78-a0f7-72b1f47b9dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.550219 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb02ad-825f-4f78-a0f7-72b1f47b9dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.550527 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb02ad-825f-4f78-a0f7-72b1f47b9dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.551343 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb02ad-825f-4f78-a0f7-72b1f47b9dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.553471 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb02ad-825f-4f78-a0f7-72b1f47b9dd0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.555642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7a1f1-1d98-45c3-a9d2-66a56161725d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.556305 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7a1f1-1d98-45c3-a9d2-66a56161725d admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.556585 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7a1f1-1d98-45c3-a9d2-66a56161725d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.556861 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7a1f1-1d98-45c3-a9d2-66a56161725d admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.557569 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7a1f1-1d98-45c3-a9d2-66a56161725d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:32:27.557876 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7a1f1-1d98-45c3-a9d2-66a56161725d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.559496 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7a1f1-1d98-45c3-a9d2-66a56161725d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.571015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 626/1249] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:32:27.571824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7a1f1-1d98-45c3-a9d2-66a56161725d admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.581647 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7a1f1-1d98-45c3-a9d2-66a56161725d admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.586172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed978e-4c44-4583-a6f8-e63e61e4df7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.586760 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed978e-4c44-4583-a6f8-e63e61e4df7a admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.587040 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed978e-4c44-4583-a6f8-e63e61e4df7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.587312 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed978e-4c44-4583-a6f8-e63e61e4df7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.587946 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed978e-4c44-4583-a6f8-e63e61e4df7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.589304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 624/1250] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:32:27 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:27.590169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed978e-4c44-4583-a6f8-e63e61e4df7a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.590328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb02ad-825f-4f78-a0f7-72b1f47b9dd0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.600782 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 627/1251] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:27.601579 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed978e-4c44-4583-a6f8-e63e61e4df7a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.611585 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed978e-4c44-4583-a6f8-e63e61e4df7a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.629901 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:27.655946 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb02ad-825f-4f78-a0f7-72b1f47b9dd0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.660823 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7314052-a43b-4f88-a5c8-c9fe589a751c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.661508 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7314052-a43b-4f88-a5c8-c9fe589a751c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.661733 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7314052-a43b-4f88-a5c8-c9fe589a751c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.662009 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7314052-a43b-4f88-a5c8-c9fe589a751c admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.662698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7314052-a43b-4f88-a5c8-c9fe589a751c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.664519 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7314052-a43b-4f88-a5c8-c9fe589a751c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.667376 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:27.672599 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1ff17-690a-4a1a-8c90-6cec4175f9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.673928 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1ff17-690a-4a1a-8c90-6cec4175f9a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.674217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1ff17-690a-4a1a-8c90-6cec4175f9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.674492 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1ff17-690a-4a1a-8c90-6cec4175f9a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.675130 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1ff17-690a-4a1a-8c90-6cec4175f9a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.679233 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1ff17-690a-4a1a-8c90-6cec4175f9a4 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.679804 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 625/1252] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:27.680973 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7314052-a43b-4f88-a5c8-c9fe589a751c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.690765 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7314052-a43b-4f88-a5c8-c9fe589a751c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.695433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c3aab-2237-4378-ae4f-0610cce03291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.696056 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c3aab-2237-4378-ae4f-0610cce03291 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.696339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c3aab-2237-4378-ae4f-0610cce03291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.696608 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c3aab-2237-4378-ae4f-0610cce03291 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.697258 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c3aab-2237-4378-ae4f-0610cce03291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.699298 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c3aab-2237-4378-ae4f-0610cce03291 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.704295 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 628/1253] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:32:27 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:27.705085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1ff17-690a-4a1a-8c90-6cec4175f9a4 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.724234 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 626/1254] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:32:27 2022] POST /identity/v3/users => generated 296 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:27.724234 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c3aab-2237-4378-ae4f-0610cce03291 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.733973 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c3aab-2237-4378-ae4f-0610cce03291 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.768185 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1ff17-690a-4a1a-8c90-6cec4175f9a4 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.773327 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096617b-8cad-4a0b-8688-0336ba2a4fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.774305 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096617b-8cad-4a0b-8688-0336ba2a4fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.774594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096617b-8cad-4a0b-8688-0336ba2a4fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.775224 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096617b-8cad-4a0b-8688-0336ba2a4fb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.776348 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096617b-8cad-4a0b-8688-0336ba2a4fb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.778293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096617b-8cad-4a0b-8688-0336ba2a4fb4 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.790032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccea83-2c37-4208-b2e2-27e0acb94cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.790717 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccea83-2c37-4208-b2e2-27e0acb94cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.791001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccea83-2c37-4208-b2e2-27e0acb94cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.791358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccea83-2c37-4208-b2e2-27e0acb94cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.792534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccea83-2c37-4208-b2e2-27e0acb94cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.794150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccea83-2c37-4208-b2e2-27e0acb94cf1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.801942 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 629/1255] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:32:27 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:27.802702 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096617b-8cad-4a0b-8688-0336ba2a4fb4 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.807140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 627/1256] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:27.807140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccea83-2c37-4208-b2e2-27e0acb94cf1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.812843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096617b-8cad-4a0b-8688-0336ba2a4fb4 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.816189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccea83-2c37-4208-b2e2-27e0acb94cf1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.818412 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1c021-f27a-429b-a565-c2eca56f10f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.819087 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1c021-f27a-429b-a565-c2eca56f10f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.819297 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1c021-f27a-429b-a565-c2eca56f10f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.819604 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1c021-f27a-429b-a565-c2eca56f10f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.820239 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1c021-f27a-429b-a565-c2eca56f10f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.821278 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe652dd-84a8-452e-b55d-8317b0c69b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.821872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe652dd-84a8-452e-b55d-8317b0c69b72 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.822148 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe652dd-84a8-452e-b55d-8317b0c69b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.822419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe652dd-84a8-452e-b55d-8317b0c69b72 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.822639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1c021-f27a-429b-a565-c2eca56f10f8 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.823070 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe652dd-84a8-452e-b55d-8317b0c69b72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.824943 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe652dd-84a8-452e-b55d-8317b0c69b72 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.847193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 628/1257] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:32:27 2022] POST /identity/v3/users => generated 286 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:27.848072 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe652dd-84a8-452e-b55d-8317b0c69b72 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.856604 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 630/1258] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:32:27 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:27.856604 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1c021-f27a-429b-a565-c2eca56f10f8 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.858313 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe652dd-84a8-452e-b55d-8317b0c69b72 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.914895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9d335-1800-4c08-bd5b-563a5c1399ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.915507 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9d335-1800-4c08-bd5b-563a5c1399ed admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.915794 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9d335-1800-4c08-bd5b-563a5c1399ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.916070 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9d335-1800-4c08-bd5b-563a5c1399ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.916746 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9d335-1800-4c08-bd5b-563a5c1399ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.917245 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1c021-f27a-429b-a565-c2eca56f10f8 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.918425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9d335-1800-4c08-bd5b-563a5c1399ed admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.921994 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4370a-e09e-45fc-8501-aa5cd246abca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.922587 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4370a-e09e-45fc-8501-aa5cd246abca admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.922917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4370a-e09e-45fc-8501-aa5cd246abca admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.923140 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4370a-e09e-45fc-8501-aa5cd246abca admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.923796 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4370a-e09e-45fc-8501-aa5cd246abca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.925413 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4370a-e09e-45fc-8501-aa5cd246abca admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.928694 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 629/1259] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:27.932655 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9d335-1800-4c08-bd5b-563a5c1399ed admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.935486 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 631/1260] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:27.936288 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4370a-e09e-45fc-8501-aa5cd246abca admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.945069 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9d335-1800-4c08-bd5b-563a5c1399ed admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.945978 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4370a-e09e-45fc-8501-aa5cd246abca admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.950310 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2daf2-947e-4c7b-b975-2bf2add19123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.950932 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2daf2-947e-4c7b-b975-2bf2add19123 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.951091 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e38e4-9343-46aa-86cf-5a16ada10ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.951214 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2daf2-947e-4c7b-b975-2bf2add19123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.951476 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2daf2-947e-4c7b-b975-2bf2add19123 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.951658 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e38e4-9343-46aa-86cf-5a16ada10ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.951943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e38e4-9343-46aa-86cf-5a16ada10ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.952105 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2daf2-947e-4c7b-b975-2bf2add19123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.952208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e38e4-9343-46aa-86cf-5a16ada10ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.952829 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e38e4-9343-46aa-86cf-5a16ada10ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.954049 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2daf2-947e-4c7b-b975-2bf2add19123 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.954404 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e38e4-9343-46aa-86cf-5a16ada10ac9 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:27.960126 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:27.968881 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 632/1261] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:27.969631 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e38e4-9343-46aa-86cf-5a16ada10ac9 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.976566 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 630/1262] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:32:27 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:27.977402 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2daf2-947e-4c7b-b975-2bf2add19123 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:27.980073 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e38e4-9343-46aa-86cf-5a16ada10ac9 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.985700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f820f-4c84-4f14-98d6-f043610c18dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.986359 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f820f-4c84-4f14-98d6-f043610c18dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.986642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f820f-4c84-4f14-98d6-f043610c18dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.986917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f820f-4c84-4f14-98d6-f043610c18dc admin admin] PATH_INFO: `/v3/projects/303f4ada97514dbd9175db972f5fa5e8/users/5a9e86876ed8467cb1fad623af5c8d5b/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.989006 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2daf2-947e-4c7b-b975-2bf2add19123 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:27.993729 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4ea56-1327-43cd-82cf-5ed0b7d9704e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:27.994323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4ea56-1327-43cd-82cf-5ed0b7d9704e admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:27.994638 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4ea56-1327-43cd-82cf-5ed0b7d9704e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:27.994913 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4ea56-1327-43cd-82cf-5ed0b7d9704e admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:27.995555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4ea56-1327-43cd-82cf-5ed0b7d9704e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:27.997162 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4ea56-1327-43cd-82cf-5ed0b7d9704e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:28.001684 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f820f-4c84-4f14-98d6-f043610c18dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=303f4ada97514dbd9175db972f5fa5e8, user_id=5a9e86876ed8467cb1fad623af5c8d5b, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:28.004328 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f820f-4c84-4f14-98d6-f043610c18dc admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:28.007703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 631/1263] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:28.008488 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4ea56-1327-43cd-82cf-5ed0b7d9704e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:28.018531 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4ea56-1327-43cd-82cf-5ed0b7d9704e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:28.020385 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 633/1264] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:32:27 2022] PUT /identity/v3/projects/303f4ada97514dbd9175db972f5fa5e8/users/5a9e86876ed8467cb1fad623af5c8d5b/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:28.024005 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f820f-4c84-4f14-98d6-f043610c18dc admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:28.042533 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:28.080727 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a2a13-2b52-4886-adf0-96277ef262d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:28.081390 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a2a13-2b52-4886-adf0-96277ef262d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.081782 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a2a13-2b52-4886-adf0-96277ef262d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.082060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a2a13-2b52-4886-adf0-96277ef262d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.082709 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a2a13-2b52-4886-adf0-96277ef262d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:28.084296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a2a13-2b52-4886-adf0-96277ef262d9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:28.086914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f820f-4c84-4f14-98d6-f043610c18dc admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:28.092757 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee410fa3-ca66-4463-b04f-73322a8b5b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:28.093398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee410fa3-ca66-4463-b04f-73322a8b5b5b admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.093681 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee410fa3-ca66-4463-b04f-73322a8b5b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.093956 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee410fa3-ca66-4463-b04f-73322a8b5b5b admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.094588 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee410fa3-ca66-4463-b04f-73322a8b5b5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:28.097610 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 632/1265] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:28.097610 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a2a13-2b52-4886-adf0-96277ef262d9 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:28.097826 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee410fa3-ca66-4463-b04f-73322a8b5b5b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:28.105363 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a2a13-2b52-4886-adf0-96277ef262d9 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:28.109997 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e0ba2-5bc8-40fd-958a-2dfd04a706ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:28.110664 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e0ba2-5bc8-40fd-958a-2dfd04a706ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.110974 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e0ba2-5bc8-40fd-958a-2dfd04a706ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.111279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e0ba2-5bc8-40fd-958a-2dfd04a706ea admin admin] PATH_INFO: `/v3/projects/ce90c4e10eec473280445253ba522726/users/95ecd3b749be4913a9bdec3bfde156ee/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.121377 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 634/1266] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:32:28 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:28.122330 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee410fa3-ca66-4463-b04f-73322a8b5b5b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:28.129650 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e0ba2-5bc8-40fd-958a-2dfd04a706ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce90c4e10eec473280445253ba522726, user_id=95ecd3b749be4913a9bdec3bfde156ee, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:28.132054 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee410fa3-ca66-4463-b04f-73322a8b5b5b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:28.132374 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e0ba2-5bc8-40fd-958a-2dfd04a706ea admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:28.137628 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012b513-a0e4-4d9c-bd22-aa0bb7abfe37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:28.138315 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012b513-a0e4-4d9c-bd22-aa0bb7abfe37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.138657 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012b513-a0e4-4d9c-bd22-aa0bb7abfe37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.138959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012b513-a0e4-4d9c-bd22-aa0bb7abfe37 admin admin] PATH_INFO: `/v3/projects/0211992b4f9646c2acb9db584e79ae3b/users/459bb7dfc62346c8b2081de02ccb12df/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.146949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 633/1267] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:32:28 2022] PUT /identity/v3/projects/ce90c4e10eec473280445253ba522726/users/95ecd3b749be4913a9bdec3bfde156ee/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:28.147826 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e0ba2-5bc8-40fd-958a-2dfd04a706ea admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:28.155796 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012b513-a0e4-4d9c-bd22-aa0bb7abfe37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0211992b4f9646c2acb9db584e79ae3b, user_id=459bb7dfc62346c8b2081de02ccb12df, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:28.158465 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012b513-a0e4-4d9c-bd22-aa0bb7abfe37 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:28.172666 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 635/1268] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:32:28 2022] PUT /identity/v3/projects/0211992b4f9646c2acb9db584e79ae3b/users/459bb7dfc62346c8b2081de02ccb12df/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:28.173553 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012b513-a0e4-4d9c-bd22-aa0bb7abfe37 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:28.214689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e0ba2-5bc8-40fd-958a-2dfd04a706ea admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:28.235026 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012b513-a0e4-4d9c-bd22-aa0bb7abfe37 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:28.239605 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36452639-81a7-4241-a478-8da9ebff1644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:28.240205 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36452639-81a7-4241-a478-8da9ebff1644 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.240478 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36452639-81a7-4241-a478-8da9ebff1644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.240747 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36452639-81a7-4241-a478-8da9ebff1644 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.241416 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36452639-81a7-4241-a478-8da9ebff1644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:28.242979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36452639-81a7-4241-a478-8da9ebff1644 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:28.253016 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 636/1269] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:28.253828 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36452639-81a7-4241-a478-8da9ebff1644 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:28.263721 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36452639-81a7-4241-a478-8da9ebff1644 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:28.268214 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c3730-7159-469b-82ad-5f244349c0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:28.268778 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c3730-7159-469b-82ad-5f244349c0dd admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.269056 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c3730-7159-469b-82ad-5f244349c0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.269356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c3730-7159-469b-82ad-5f244349c0dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.269972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c3730-7159-469b-82ad-5f244349c0dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:28.271490 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c3730-7159-469b-82ad-5f244349c0dd admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:28.272735 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f435b-2350-4201-9b8c-2a78e2c696aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:28.273375 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f435b-2350-4201-9b8c-2a78e2c696aa admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.273662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f435b-2350-4201-9b8c-2a78e2c696aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.273937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f435b-2350-4201-9b8c-2a78e2c696aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.274577 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f435b-2350-4201-9b8c-2a78e2c696aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:28.276182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f435b-2350-4201-9b8c-2a78e2c696aa admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:28.281061 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 637/1270] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:28.281061 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a507902-7cdc-434a-b86f-7fe373fa17f6 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.281061 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a507902-7cdc-434a-b86f-7fe373fa17f6 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.281061 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a507902-7cdc-434a-b86f-7fe373fa17f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.292759 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 634/1271] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:28.292759 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f435b-2350-4201-9b8c-2a78e2c696aa admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:28.299790 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f435b-2350-4201-9b8c-2a78e2c696aa admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:28.304049 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-8a507902-7cdc-434a-b86f-7fe373fa17f6 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:28.304374 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c48101-959f-45e0-af9f-f0758c216384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:28.304949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c48101-959f-45e0-af9f-f0758c216384 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.305272 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c48101-959f-45e0-af9f-f0758c216384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.305406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8a507902-7cdc-434a-b86f-7fe373fa17f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:28.305551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c48101-959f-45e0-af9f-f0758c216384 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.306182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c48101-959f-45e0-af9f-f0758c216384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:28.308227 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c48101-959f-45e0-af9f-f0758c216384 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:28.314027 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 638/1272] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:28.320974 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 635/1273] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:28.321134 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a507902-7cdc-434a-b86f-7fe373fa17f6 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:28.321248 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc53ced-fbbd-44b2-bac8-93ecf8f00e7b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.321248 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc53ced-fbbd-44b2-bac8-93ecf8f00e7b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.321248 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc53ced-fbbd-44b2-bac8-93ecf8f00e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.330672 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a507902-7cdc-434a-b86f-7fe373fa17f6 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:28.335897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f874b-0563-4b62-8aab-69d70b7e5b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:28.336502 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f874b-0563-4b62-8aab-69d70b7e5b67 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.336781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f874b-0563-4b62-8aab-69d70b7e5b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.337055 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f874b-0563-4b62-8aab-69d70b7e5b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.337733 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f874b-0563-4b62-8aab-69d70b7e5b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:28.339361 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f874b-0563-4b62-8aab-69d70b7e5b67 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:28.348841 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1fc53ced-fbbd-44b2-bac8-93ecf8f00e7b None None] MFA Rules not processed for user `95ecd3b749be4913a9bdec3bfde156ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:28.349377 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 639/1274] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:28.350550 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90328db-1720-4f2b-b347-776fb0939639 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.350839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90328db-1720-4f2b-b347-776fb0939639 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.351116 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90328db-1720-4f2b-b347-776fb0939639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.352979 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1fc53ced-fbbd-44b2-bac8-93ecf8f00e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:28.369168 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d90328db-1720-4f2b-b347-776fb0939639 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:28.370886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d90328db-1720-4f2b-b347-776fb0939639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:28.372991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:28.379295 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 640/1275] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:28.380262 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90328db-1720-4f2b-b347-776fb0939639 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:28.384839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:28.391197 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90328db-1720-4f2b-b347-776fb0939639 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:28.399173 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa6ddc-7df1-4fd2-bcbb-d1f5e753de8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:28.399800 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa6ddc-7df1-4fd2-bcbb-d1f5e753de8b admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.400661 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa6ddc-7df1-4fd2-bcbb-d1f5e753de8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.400961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa6ddc-7df1-4fd2-bcbb-d1f5e753de8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.401676 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa6ddc-7df1-4fd2-bcbb-d1f5e753de8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:28.403373 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa6ddc-7df1-4fd2-bcbb-d1f5e753de8b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:28.415687 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 641/1276] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:28.416597 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa6ddc-7df1-4fd2-bcbb-d1f5e753de8b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:28.426499 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa6ddc-7df1-4fd2-bcbb-d1f5e753de8b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:28.429685 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 636/1277] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:28.429685 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc53ced-fbbd-44b2-bac8-93ecf8f00e7b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:28.434999 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4efc01-f022-4cae-9418-db75dd99667f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:28.435643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4efc01-f022-4cae-9418-db75dd99667f admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.435925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4efc01-f022-4cae-9418-db75dd99667f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.436200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4efc01-f022-4cae-9418-db75dd99667f admin admin] PATH_INFO: `/v3/projects/8dfc001b8d5742c3be3d3f24644ed4de/users/159a28e7564145d6a6ef01572c19b3e9/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.442610 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc53ced-fbbd-44b2-bac8-93ecf8f00e7b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:28.448510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccaaf9-57a1-4b93-805d-7dc3b19c0e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:28.449289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccaaf9-57a1-4b93-805d-7dc3b19c0e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.449571 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccaaf9-57a1-4b93-805d-7dc3b19c0e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.449846 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccaaf9-57a1-4b93-805d-7dc3b19c0e4e admin admin] PATH_INFO: `/v3/projects/7049291835854338a73d006b1120ed6f/users/d1c036fa4872485e903820d848089e02/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.451519 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4efc01-f022-4cae-9418-db75dd99667f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dfc001b8d5742c3be3d3f24644ed4de, user_id=159a28e7564145d6a6ef01572c19b3e9, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:28.454208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4efc01-f022-4cae-9418-db75dd99667f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:28.465255 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccaaf9-57a1-4b93-805d-7dc3b19c0e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7049291835854338a73d006b1120ed6f, user_id=d1c036fa4872485e903820d848089e02, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:28.467670 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 642/1278] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:32:28 2022] PUT /identity/v3/projects/8dfc001b8d5742c3be3d3f24644ed4de/users/159a28e7564145d6a6ef01572c19b3e9/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:28.467942 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccaaf9-57a1-4b93-805d-7dc3b19c0e4e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:28.468653 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4efc01-f022-4cae-9418-db75dd99667f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:28.481273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 637/1279] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:32:28 2022] PUT /identity/v3/projects/7049291835854338a73d006b1120ed6f/users/d1c036fa4872485e903820d848089e02/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:28.482079 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccaaf9-57a1-4b93-805d-7dc3b19c0e4e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:28.535829 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccaaf9-57a1-4b93-805d-7dc3b19c0e4e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:28.539777 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920136b-ca51-409c-9be2-5cecf20d5ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:28.540382 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920136b-ca51-409c-9be2-5cecf20d5ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.540665 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920136b-ca51-409c-9be2-5cecf20d5ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.540939 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920136b-ca51-409c-9be2-5cecf20d5ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.541670 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4efc01-f022-4cae-9418-db75dd99667f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:28.598167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e65bdb-5ff5-407b-9f67-f9fd61476b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:28.598819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e65bdb-5ff5-407b-9f67-f9fd61476b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.599100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e65bdb-5ff5-407b-9f67-f9fd61476b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.599367 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e65bdb-5ff5-407b-9f67-f9fd61476b4b admin admin] PATH_INFO: `/v3/projects/92e3f989388144d6bd87418f0bcd09ef/users/35a2cb3d31e4479da9b7525a56b273b4/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.600855 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920136b-ca51-409c-9be2-5cecf20d5ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:28.602318 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920136b-ca51-409c-9be2-5cecf20d5ea4 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:28.611753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 638/1280] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:32:28.612544 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920136b-ca51-409c-9be2-5cecf20d5ea4 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:28.614768 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e65bdb-5ff5-407b-9f67-f9fd61476b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e3f989388144d6bd87418f0bcd09ef, user_id=35a2cb3d31e4479da9b7525a56b273b4, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:28.617691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e65bdb-5ff5-407b-9f67-f9fd61476b4b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:28.622391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920136b-ca51-409c-9be2-5cecf20d5ea4 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:28.627868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c96b09-cfac-4efb-aacb-cf1e98809f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:28.628551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c96b09-cfac-4efb-aacb-cf1e98809f57 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.629482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c96b09-cfac-4efb-aacb-cf1e98809f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.629821 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c96b09-cfac-4efb-aacb-cf1e98809f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.630524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c96b09-cfac-4efb-aacb-cf1e98809f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:28.632220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c96b09-cfac-4efb-aacb-cf1e98809f57 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:28.637568 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 643/1281] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:32:28 2022] PUT /identity/v3/projects/92e3f989388144d6bd87418f0bcd09ef/users/35a2cb3d31e4479da9b7525a56b273b4/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:28.638464 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e65bdb-5ff5-407b-9f67-f9fd61476b4b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:28.644896 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 639/1282] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:28.645492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c96b09-cfac-4efb-aacb-cf1e98809f57 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:28.655934 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c96b09-cfac-4efb-aacb-cf1e98809f57 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:28.696182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:28.711223 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e65bdb-5ff5-407b-9f67-f9fd61476b4b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:28.716391 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a692c5c-9847-4b0e-b682-cd68f85175b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:28.717216 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a692c5c-9847-4b0e-b682-cd68f85175b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.717526 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a692c5c-9847-4b0e-b682-cd68f85175b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.717819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a692c5c-9847-4b0e-b682-cd68f85175b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.729707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:28.730700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6c1f7-9915-43f0-bc40-f41ec57cdd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:28.731563 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6c1f7-9915-43f0-bc40-f41ec57cdd09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.731917 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6c1f7-9915-43f0-bc40-f41ec57cdd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.732227 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6c1f7-9915-43f0-bc40-f41ec57cdd09 admin admin] PATH_INFO: `/v3/projects/df7a234ee92f4cc2b367cfbe296b5216/users/495f60d6b5c74627b42e98bc867723c1/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.752256 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6c1f7-9915-43f0-bc40-f41ec57cdd09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7a234ee92f4cc2b367cfbe296b5216, user_id=495f60d6b5c74627b42e98bc867723c1, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:28.755497 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6c1f7-9915-43f0-bc40-f41ec57cdd09 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:28.773538 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 640/1283] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:32:28 2022] PUT /identity/v3/projects/df7a234ee92f4cc2b367cfbe296b5216/users/495f60d6b5c74627b42e98bc867723c1/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:28.773538 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6c1f7-9915-43f0-bc40-f41ec57cdd09 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:28.798374 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a692c5c-9847-4b0e-b682-cd68f85175b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:28.799810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a692c5c-9847-4b0e-b682-cd68f85175b7 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:28.810862 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 644/1284] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:32:28.812469 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab40f7-9b1b-476b-bc95-28a027c0d8b0 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.812469 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab40f7-9b1b-476b-bc95-28a027c0d8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.812700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab40f7-9b1b-476b-bc95-28a027c0d8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.842956 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-5dab40f7-9b1b-476b-bc95-28a027c0d8b0 None None] MFA Rules not processed for user `159a28e7564145d6a6ef01572c19b3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:28.844183 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5dab40f7-9b1b-476b-bc95-28a027c0d8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:28.845203 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6c1f7-9915-43f0-bc40-f41ec57cdd09 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:28.850785 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b4b3c-a368-42fb-80e1-57950fead05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:28.851499 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b4b3c-a368-42fb-80e1-57950fead05e admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.851714 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b4b3c-a368-42fb-80e1-57950fead05e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.851994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b4b3c-a368-42fb-80e1-57950fead05e admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.852678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899b4b3c-a368-42fb-80e1-57950fead05e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:28.856237 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899b4b3c-a368-42fb-80e1-57950fead05e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:28.898941 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 641/1285] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:32:28 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:28.901022 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04989b70-745f-4c69-a053-c70061413dca None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.901409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04989b70-745f-4c69-a053-c70061413dca None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.901950 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04989b70-745f-4c69-a053-c70061413dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.921756 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 645/1286] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:28.922861 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae35f6-1a18-49b6-9fcb-ec3c15ba341d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:28.923156 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae35f6-1a18-49b6-9fcb-ec3c15ba341d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:28.923419 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae35f6-1a18-49b6-9fcb-ec3c15ba341d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:28.924186 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-04989b70-745f-4c69-a053-c70061413dca None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:28.925693 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-04989b70-745f-4c69-a053-c70061413dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:28.953399 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-56ae35f6-1a18-49b6-9fcb-ec3c15ba341d None None] MFA Rules not processed for user `35a2cb3d31e4479da9b7525a56b273b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:28.954704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-56ae35f6-1a18-49b6-9fcb-ec3c15ba341d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:29.000391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 642/1287] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:29.001550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04989b70-745f-4c69-a053-c70061413dca None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:29.023189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04989b70-745f-4c69-a053-c70061413dca None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:29.029545 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461dda5-92af-4103-aab9-ea28310ed7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:29.030256 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461dda5-92af-4103-aab9-ea28310ed7d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:29.030622 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461dda5-92af-4103-aab9-ea28310ed7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:29.030905 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461dda5-92af-4103-aab9-ea28310ed7d3 admin admin] PATH_INFO: `/v3/projects/52511ca380a24702ba4e2a3e94634171/users/d12c5a41f344496caf0034669fbd0893/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:29.043145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 646/1288] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:29.047561 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0099e-72b4-4766-96c1-f73b1cf61bed None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:29.047561 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0099e-72b4-4766-96c1-f73b1cf61bed None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:29.047561 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0099e-72b4-4766-96c1-f73b1cf61bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:29.053779 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461dda5-92af-4103-aab9-ea28310ed7d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52511ca380a24702ba4e2a3e94634171, user_id=d12c5a41f344496caf0034669fbd0893, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:29.056547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461dda5-92af-4103-aab9-ea28310ed7d3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:29.087839 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 643/1289] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:32:29 2022] PUT /identity/v3/projects/52511ca380a24702ba4e2a3e94634171/users/d12c5a41f344496caf0034669fbd0893/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:29.092319 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461dda5-92af-4103-aab9-ea28310ed7d3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:29.093742 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-cbd0099e-72b4-4766-96c1-f73b1cf61bed None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:29.095563 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-cbd0099e-72b4-4766-96c1-f73b1cf61bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:29.124276 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:29.129605 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:29.182851 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 647/1290] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:29.183803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0099e-72b4-4766-96c1-f73b1cf61bed None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:29.194598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461dda5-92af-4103-aab9-ea28310ed7d3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:29.196175 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0099e-72b4-4766-96c1-f73b1cf61bed None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:29.200358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe145149-a741-4e2b-918b-66b224948a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:29.201083 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc3b9a-13a8-4f25-8a5d-d818634a16a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:29.201374 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe145149-a741-4e2b-918b-66b224948a7d admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:29.201924 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc3b9a-13a8-4f25-8a5d-d818634a16a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:29.202113 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe145149-a741-4e2b-918b-66b224948a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:29.202326 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc3b9a-13a8-4f25-8a5d-d818634a16a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:29.202538 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe145149-a741-4e2b-918b-66b224948a7d admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:29.202725 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc3b9a-13a8-4f25-8a5d-d818634a16a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:29.203488 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe145149-a741-4e2b-918b-66b224948a7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:29.203605 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc3b9a-13a8-4f25-8a5d-d818634a16a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:29.205591 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc3b9a-13a8-4f25-8a5d-d818634a16a8 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:29.205721 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe145149-a741-4e2b-918b-66b224948a7d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:29.251170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 644/1291] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:32:29 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:29.255604 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 648/1292] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:32:29 2022] POST /identity/v3/projects => generated 363 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:29.256530 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe145149-a741-4e2b-918b-66b224948a7d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:29.258687 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c7358-71e1-4663-9994-ccf3b81a4b88 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:29.259447 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fe145149-a741-4e2b-918b-66b224948a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:29.259790 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c7358-71e1-4663-9994-ccf3b81a4b88 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:29.260346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c7358-71e1-4663-9994-ccf3b81a4b88 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:29.263049 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 649/1293] 10.222.0.18 () {54 vars in 961 bytes} [Mon Oct 31 12:32:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:32:29.271143 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb551932-d672-43b8-9be3-44593109dd8b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:29.272557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb551932-d672-43b8-9be3-44593109dd8b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:29.273131 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb551932-d672-43b8-9be3-44593109dd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:29.331079 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-eb551932-d672-43b8-9be3-44593109dd8b None None] MFA Rules not processed for user `d12c5a41f344496caf0034669fbd0893`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:29.336283 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-eb551932-d672-43b8-9be3-44593109dd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:29.359793 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe145149-a741-4e2b-918b-66b224948a7d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:29.426110 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6ad9a-4416-4bf0-8e16-78e57138ae0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:29.427285 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6ad9a-4416-4bf0-8e16-78e57138ae0c service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:29.427448 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6ad9a-4416-4bf0-8e16-78e57138ae0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:29.427744 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6ad9a-4416-4bf0-8e16-78e57138ae0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:29.432594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 650/1294] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:29.433766 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb551932-d672-43b8-9be3-44593109dd8b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:29.450871 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb551932-d672-43b8-9be3-44593109dd8b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:29.455021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650a252-e4a6-46ec-8266-3d6c41809642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:29.455791 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650a252-e4a6-46ec-8266-3d6c41809642 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:29.456266 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650a252-e4a6-46ec-8266-3d6c41809642 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:29.456388 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650a252-e4a6-46ec-8266-3d6c41809642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:29.507448 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6ad9a-4416-4bf0-8e16-78e57138ae0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:29.509406 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6ad9a-4416-4bf0-8e16-78e57138ae0c service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:29.522788 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 645/1295] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:32:29.523519 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6ad9a-4416-4bf0-8e16-78e57138ae0c service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:29.535989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6ad9a-4416-4bf0-8e16-78e57138ae0c service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:29.542986 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54bc30d-2ba0-422c-ad9c-ed4fb5da5853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:29.544062 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bc30d-2ba0-422c-ad9c-ed4fb5da5853 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:29.544212 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bc30d-2ba0-422c-ad9c-ed4fb5da5853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:29.544571 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bc30d-2ba0-422c-ad9c-ed4fb5da5853 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:29.545406 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54bc30d-2ba0-422c-ad9c-ed4fb5da5853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:29.547337 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54bc30d-2ba0-422c-ad9c-ed4fb5da5853 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:29.561071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 646/1296] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:29.562419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54bc30d-2ba0-422c-ad9c-ed4fb5da5853 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:29.571683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:29.577144 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54bc30d-2ba0-422c-ad9c-ed4fb5da5853 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:29.584859 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b9b8c-f058-419e-938a-c4658e36786c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:29.586103 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b9b8c-f058-419e-938a-c4658e36786c admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:29.587058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b9b8c-f058-419e-938a-c4658e36786c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:29.587676 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b9b8c-f058-419e-938a-c4658e36786c admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:29.589715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b9b8c-f058-419e-938a-c4658e36786c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:29.593674 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b9b8c-f058-419e-938a-c4658e36786c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:29.613055 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650a252-e4a6-46ec-8266-3d6c41809642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:29.619446 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650a252-e4a6-46ec-8266-3d6c41809642 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:29.632640 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 647/1297] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:32:29 2022] POST /identity/v3/users => generated 288 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:29.634787 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75ed25-a49f-443c-855c-b0df1b80a834 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:29.636232 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75ed25-a49f-443c-855c-b0df1b80a834 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:29.637497 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75ed25-a49f-443c-855c-b0df1b80a834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:29.643328 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 651/1298] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:32:29.644999 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650a252-e4a6-46ec-8266-3d6c41809642 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:29.669548 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650a252-e4a6-46ec-8266-3d6c41809642 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:29.679113 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffbb98-6f52-47eb-928a-47189dd152da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:29.679790 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffbb98-6f52-47eb-928a-47189dd152da admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:29.680073 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffbb98-6f52-47eb-928a-47189dd152da admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:29.680343 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffbb98-6f52-47eb-928a-47189dd152da admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:29.681611 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffbb98-6f52-47eb-928a-47189dd152da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:29.683935 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffbb98-6f52-47eb-928a-47189dd152da admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:29.717789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7c75ed25-a49f-443c-855c-b0df1b80a834 None None] MFA Rules not processed for user `d93ce5759e0648a1934ff4d9c9d8fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:29.720005 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7c75ed25-a49f-443c-855c-b0df1b80a834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:29.762149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 652/1299] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:32:29 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:29.764768 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffbb98-6f52-47eb-928a-47189dd152da admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:29.791491 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:29.890119 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 648/1300] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Oct 31 12:32:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:29.891663 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75ed25-a49f-443c-855c-b0df1b80a834 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:29.900228 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffbb98-6f52-47eb-928a-47189dd152da admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:29.905894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adaff11-a72a-4544-827d-042c0604f828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:29.906714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adaff11-a72a-4544-827d-042c0604f828 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:29.907148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adaff11-a72a-4544-827d-042c0604f828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:29.907435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adaff11-a72a-4544-827d-042c0604f828 admin admin] PATH_INFO: `/v3/projects/94da5d9b6b1f4bbe8258e983dd3e2956/users/6f69f19b59cb48a9a1d6708e825cf725/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:29.919613 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75ed25-a49f-443c-855c-b0df1b80a834 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:29.935875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adaff11-a72a-4544-827d-042c0604f828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94da5d9b6b1f4bbe8258e983dd3e2956, user_id=6f69f19b59cb48a9a1d6708e825cf725, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:29.940764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adaff11-a72a-4544-827d-042c0604f828 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:29.941611 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef27062-56f5-43b6-b151-53ca10588d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:29.944736 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef27062-56f5-43b6-b151-53ca10588d0d admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:29.945227 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef27062-56f5-43b6-b151-53ca10588d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:29.945856 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef27062-56f5-43b6-b151-53ca10588d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:29.946559 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef27062-56f5-43b6-b151-53ca10588d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:29.952838 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef27062-56f5-43b6-b151-53ca10588d0d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:29.962809 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 653/1301] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:32:29 2022] PUT /identity/v3/projects/94da5d9b6b1f4bbe8258e983dd3e2956/users/6f69f19b59cb48a9a1d6708e825cf725/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:29.964459 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adaff11-a72a-4544-827d-042c0604f828 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:29.976197 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 649/1302] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:29.976197 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef27062-56f5-43b6-b151-53ca10588d0d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:30.127703 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adaff11-a72a-4544-827d-042c0604f828 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:30.132335 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef27062-56f5-43b6-b151-53ca10588d0d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:30.140329 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6393d-7518-4f60-b5c2-38e8c7da513c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:30.140967 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6393d-7518-4f60-b5c2-38e8c7da513c admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:30.141287 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6393d-7518-4f60-b5c2-38e8c7da513c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:30.141567 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6393d-7518-4f60-b5c2-38e8c7da513c admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:30.142304 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6393d-7518-4f60-b5c2-38e8c7da513c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:30.145551 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6393d-7518-4f60-b5c2-38e8c7da513c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:30.185862 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 654/1303] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:32:29 2022] POST /identity/v3/users => generated 291 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:30.186887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6393d-7518-4f60-b5c2-38e8c7da513c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:30.204775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6393d-7518-4f60-b5c2-38e8c7da513c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:30.213717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11394eb-69f7-4cc1-95eb-ed5930de3d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:30.214014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11394eb-69f7-4cc1-95eb-ed5930de3d26 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:30.214297 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11394eb-69f7-4cc1-95eb-ed5930de3d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:30.214794 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11394eb-69f7-4cc1-95eb-ed5930de3d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:30.215385 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11394eb-69f7-4cc1-95eb-ed5930de3d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:30.217256 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11394eb-69f7-4cc1-95eb-ed5930de3d26 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:30.231595 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:30.234993 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 655/1304] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:30.236878 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11394eb-69f7-4cc1-95eb-ed5930de3d26 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:30.255366 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11394eb-69f7-4cc1-95eb-ed5930de3d26 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:30.257089 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c80c31-bc0e-4018-801f-7bd2e4d232f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:30.258185 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c80c31-bc0e-4018-801f-7bd2e4d232f9 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:30.258628 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c80c31-bc0e-4018-801f-7bd2e4d232f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:30.258975 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c80c31-bc0e-4018-801f-7bd2e4d232f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:30.260990 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd304e8a-f72e-4604-ab96-1054b328976a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:30.261876 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd304e8a-f72e-4604-ab96-1054b328976a admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:30.262171 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd304e8a-f72e-4604-ab96-1054b328976a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:30.262444 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd304e8a-f72e-4604-ab96-1054b328976a admin admin] PATH_INFO: `/v3/projects/d2f7427bab4740be998ba73fc3a79d43/users/c8aeb6974c504d4abafa1836b1094e84/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:30.283926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd304e8a-f72e-4604-ab96-1054b328976a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f7427bab4740be998ba73fc3a79d43, user_id=c8aeb6974c504d4abafa1836b1094e84, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:30.286823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd304e8a-f72e-4604-ab96-1054b328976a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:30.311474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 656/1305] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:32:30 2022] PUT /identity/v3/projects/d2f7427bab4740be998ba73fc3a79d43/users/c8aeb6974c504d4abafa1836b1094e84/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:30.312387 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd304e8a-f72e-4604-ab96-1054b328976a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:30.346037 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c80c31-bc0e-4018-801f-7bd2e4d232f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:30.347992 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c80c31-bc0e-4018-801f-7bd2e4d232f9 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:30.363393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 650/1306] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:32:30.364556 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c80c31-bc0e-4018-801f-7bd2e4d232f9 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:30.379121 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c80c31-bc0e-4018-801f-7bd2e4d232f9 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:30.382783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:30.420339 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd304e8a-f72e-4604-ab96-1054b328976a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:30.429778 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e7308-0437-422a-a287-4b674f53dd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:30.430893 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e7308-0437-422a-a287-4b674f53dd00 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:30.431174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e7308-0437-422a-a287-4b674f53dd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:30.431671 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e7308-0437-422a-a287-4b674f53dd00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:30.433460 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e7308-0437-422a-a287-4b674f53dd00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:30.436966 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e7308-0437-422a-a287-4b674f53dd00 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:30.458218 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 657/1307] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:30.461601 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f76bc-0403-4447-aec0-eb0cecd28e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:30.462427 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f76bc-0403-4447-aec0-eb0cecd28e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:30.462718 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f76bc-0403-4447-aec0-eb0cecd28e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:30.462999 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f76bc-0403-4447-aec0-eb0cecd28e74 admin admin] PATH_INFO: `/v3/projects/94da5d9b6b1f4bbe8258e983dd3e2956/users/6f69f19b59cb48a9a1d6708e825cf725/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:30.465055 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f76bc-0403-4447-aec0-eb0cecd28e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94da5d9b6b1f4bbe8258e983dd3e2956, user_id=6f69f19b59cb48a9a1d6708e825cf725, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:30.468013 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f76bc-0403-4447-aec0-eb0cecd28e74 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:30.468764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e7308-0437-422a-a287-4b674f53dd00 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:30.482865 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 651/1308] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:32:30 2022] PUT /identity/v3/projects/94da5d9b6b1f4bbe8258e983dd3e2956/users/6f69f19b59cb48a9a1d6708e825cf725/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:30.484586 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f76bc-0403-4447-aec0-eb0cecd28e74 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:30.490937 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e7308-0437-422a-a287-4b674f53dd00 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:30.581907 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f76bc-0403-4447-aec0-eb0cecd28e74 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:30.593034 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafffed6-f3d1-462c-8bec-c590c5571f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:30.594258 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafffed6-f3d1-462c-8bec-c590c5571f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:30.594868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafffed6-f3d1-462c-8bec-c590c5571f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:30.595355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafffed6-f3d1-462c-8bec-c590c5571f75 admin admin] PATH_INFO: `/v3/projects/bf822f9c2e5541788dc1baa1b260154c/users/13b6ae806fd74a8cb9391c8bd6c097ec/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:30.618955 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafffed6-f3d1-462c-8bec-c590c5571f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf822f9c2e5541788dc1baa1b260154c, user_id=13b6ae806fd74a8cb9391c8bd6c097ec, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:30.624885 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafffed6-f3d1-462c-8bec-c590c5571f75 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:30.625501 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94045c7-6195-4283-b742-1e7138dc98af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:30.627381 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94045c7-6195-4283-b742-1e7138dc98af admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:30.627676 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94045c7-6195-4283-b742-1e7138dc98af admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:30.628125 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94045c7-6195-4283-b742-1e7138dc98af admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:30.630024 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94045c7-6195-4283-b742-1e7138dc98af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:30.635252 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94045c7-6195-4283-b742-1e7138dc98af admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:30.648495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 652/1309] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:32:30 2022] PUT /identity/v3/projects/bf822f9c2e5541788dc1baa1b260154c/users/13b6ae806fd74a8cb9391c8bd6c097ec/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:30.650450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0a7c4-69c3-41e6-a1f2-8afce9a66620 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:30.651628 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0a7c4-69c3-41e6-a1f2-8afce9a66620 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:30.652285 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0a7c4-69c3-41e6-a1f2-8afce9a66620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:30.666024 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 658/1310] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:30.668678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94045c7-6195-4283-b742-1e7138dc98af admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:30.677774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:30.694859 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94045c7-6195-4283-b742-1e7138dc98af admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:30.710369 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e3c0a7c4-69c3-41e6-a1f2-8afce9a66620 None None] MFA Rules not processed for user `6f69f19b59cb48a9a1d6708e825cf725`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:30.711604 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e3c0a7c4-69c3-41e6-a1f2-8afce9a66620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:30.795237 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50372e-1c76-4e72-857f-2d25ea1da515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:30.796604 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50372e-1c76-4e72-857f-2d25ea1da515 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:30.796895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50372e-1c76-4e72-857f-2d25ea1da515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:30.797190 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50372e-1c76-4e72-857f-2d25ea1da515 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:30.798812 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50372e-1c76-4e72-857f-2d25ea1da515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:30.800643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50372e-1c76-4e72-857f-2d25ea1da515 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:30.820055 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 659/1311] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:30.820055 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50372e-1c76-4e72-857f-2d25ea1da515 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:30.832548 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50372e-1c76-4e72-857f-2d25ea1da515 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:30.840386 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2d7a5-0182-4f33-8c92-04efa42e80af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:30.841170 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2d7a5-0182-4f33-8c92-04efa42e80af admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:30.841463 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2d7a5-0182-4f33-8c92-04efa42e80af admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:30.841743 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2d7a5-0182-4f33-8c92-04efa42e80af admin admin] PATH_INFO: `/v3/projects/d2f7427bab4740be998ba73fc3a79d43/users/c8aeb6974c504d4abafa1836b1094e84/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:30.844738 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2d7a5-0182-4f33-8c92-04efa42e80af admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f7427bab4740be998ba73fc3a79d43, user_id=c8aeb6974c504d4abafa1836b1094e84, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:30.849707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2d7a5-0182-4f33-8c92-04efa42e80af admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:30.866574 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 653/1312] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:30.868989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 660/1313] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:32:30 2022] PUT /identity/v3/projects/d2f7427bab4740be998ba73fc3a79d43/users/c8aeb6974c504d4abafa1836b1094e84/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:30.878207 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0a7c4-69c3-41e6-a1f2-8afce9a66620 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:30.880278 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f31b-9485-43d5-8c63-f99fc6490b8e None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:30.880592 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f31b-9485-43d5-8c63-f99fc6490b8e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:30.880859 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f31b-9485-43d5-8c63-f99fc6490b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:30.898875 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0a7c4-69c3-41e6-a1f2-8afce9a66620 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:30.933933 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-7609f31b-9485-43d5-8c63-f99fc6490b8e None None] MFA Rules not processed for user `c8aeb6974c504d4abafa1836b1094e84`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:30.936614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7609f31b-9485-43d5-8c63-f99fc6490b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:31.015682 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e939824-1c18-40d9-9b11-69a9c4b47d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:31.017429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e939824-1c18-40d9-9b11-69a9c4b47d92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:31.024145 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e939824-1c18-40d9-9b11-69a9c4b47d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:31.024145 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e939824-1c18-40d9-9b11-69a9c4b47d92 admin admin] PATH_INFO: `/v3/projects/bf822f9c2e5541788dc1baa1b260154c/users/13b6ae806fd74a8cb9391c8bd6c097ec/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:31.031292 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e939824-1c18-40d9-9b11-69a9c4b47d92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf822f9c2e5541788dc1baa1b260154c, user_id=13b6ae806fd74a8cb9391c8bd6c097ec, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:31.040032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e939824-1c18-40d9-9b11-69a9c4b47d92 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:31.048023 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:31.072562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 654/1314] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:32:30 2022] PUT /identity/v3/projects/bf822f9c2e5541788dc1baa1b260154c/users/13b6ae806fd74a8cb9391c8bd6c097ec/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:31.074915 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e939824-1c18-40d9-9b11-69a9c4b47d92 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:31.123760 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 661/1315] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:31.126716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d76495-eb11-4ed4-b019-62bbd0fc40c9 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:31.130082 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d76495-eb11-4ed4-b019-62bbd0fc40c9 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:31.131072 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d76495-eb11-4ed4-b019-62bbd0fc40c9 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:31.133001 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 662/1316] 10.222.0.18 () {54 vars in 912 bytes} [Mon Oct 31 12:32:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:32:31.135823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94814f1b-dd7d-46ef-b3de-8ebd1e0d87aa None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:31.136828 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94814f1b-dd7d-46ef-b3de-8ebd1e0d87aa None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:31.138657 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94814f1b-dd7d-46ef-b3de-8ebd1e0d87aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:31.202411 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-94814f1b-dd7d-46ef-b3de-8ebd1e0d87aa None None] MFA Rules not processed for user `13b6ae806fd74a8cb9391c8bd6c097ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:31.206576 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-94814f1b-dd7d-46ef-b3de-8ebd1e0d87aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:31.226863 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e939824-1c18-40d9-9b11-69a9c4b47d92 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:31.235432 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58332576-c2c6-4280-8045-20ab3d453644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:31.236884 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58332576-c2c6-4280-8045-20ab3d453644 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:31.237207 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58332576-c2c6-4280-8045-20ab3d453644 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:31.237934 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58332576-c2c6-4280-8045-20ab3d453644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:31.332400 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:31.379253 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 663/1317] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:31.380160 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94814f1b-dd7d-46ef-b3de-8ebd1e0d87aa None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:31.387583 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58332576-c2c6-4280-8045-20ab3d453644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:31.392503 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58332576-c2c6-4280-8045-20ab3d453644 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:31.404785 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94814f1b-dd7d-46ef-b3de-8ebd1e0d87aa None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:31.412728 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 655/1318] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:32:31.415674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50837bec-0d62-43af-aa80-2351643dd19c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:31.416930 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50837bec-0d62-43af-aa80-2351643dd19c service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:31.417260 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50837bec-0d62-43af-aa80-2351643dd19c service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:31.417581 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50837bec-0d62-43af-aa80-2351643dd19c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:31.418570 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950080d1-ba1b-4b6e-8c89-8cdf0ff87775 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:31.419503 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950080d1-ba1b-4b6e-8c89-8cdf0ff87775 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:31.419854 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950080d1-ba1b-4b6e-8c89-8cdf0ff87775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:31.454710 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-950080d1-ba1b-4b6e-8c89-8cdf0ff87775 None None] MFA Rules not processed for user `d93ce5759e0648a1934ff4d9c9d8fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:31.456299 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-950080d1-ba1b-4b6e-8c89-8cdf0ff87775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:31.536391 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50837bec-0d62-43af-aa80-2351643dd19c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:31.538621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50837bec-0d62-43af-aa80-2351643dd19c service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:31.545037 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 656/1319] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 31 12:32:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:31.546456 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950080d1-ba1b-4b6e-8c89-8cdf0ff87775 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:31.566176 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 664/1320] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:32:31.577730 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950080d1-ba1b-4b6e-8c89-8cdf0ff87775 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:31.582265 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7e42a-019e-483b-aaba-3a22f40ea596 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:31.583384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7e42a-019e-483b-aaba-3a22f40ea596 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:31.583814 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7e42a-019e-483b-aaba-3a22f40ea596 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:31.584228 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7e42a-019e-483b-aaba-3a22f40ea596 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:31.599307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7e42a-019e-483b-aaba-3a22f40ea596 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:31.605281 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7e42a-019e-483b-aaba-3a22f40ea596 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:31.635858 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 657/1321] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:32:31.723367 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50837bec-0d62-43af-aa80-2351643dd19c service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:31.733190 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50837bec-0d62-43af-aa80-2351643dd19c service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:31.744636 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361a140-3aa7-4875-acab-6e13f9611a76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:31.745343 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361a140-3aa7-4875-acab-6e13f9611a76 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:31.745623 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361a140-3aa7-4875-acab-6e13f9611a76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:31.745894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361a140-3aa7-4875-acab-6e13f9611a76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:31.771378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361a140-3aa7-4875-acab-6e13f9611a76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:31.772928 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361a140-3aa7-4875-acab-6e13f9611a76 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:31.801513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7e42a-019e-483b-aaba-3a22f40ea596 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:31.808834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 665/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:32:31.812162 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7e42a-019e-483b-aaba-3a22f40ea596 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:31.816975 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d88bd5-8217-4260-9691-bcda591f04c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:31.817777 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d88bd5-8217-4260-9691-bcda591f04c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:31.818412 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d88bd5-8217-4260-9691-bcda591f04c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:31.819034 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d88bd5-8217-4260-9691-bcda591f04c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:31.907538 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d88bd5-8217-4260-9691-bcda591f04c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:31.908971 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d88bd5-8217-4260-9691-bcda591f04c8 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:31.933624 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 658/1323] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:32:33.401862 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361a140-3aa7-4875-acab-6e13f9611a76 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:33.597968 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:33.647696 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d88bd5-8217-4260-9691-bcda591f04c8 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:33.667984 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d88bd5-8217-4260-9691-bcda591f04c8 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:33.672487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361a140-3aa7-4875-acab-6e13f9611a76 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:33.677577 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eabeba7-5c96-4abb-8b34-d25304c19b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:33.681335 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabeba7-5c96-4abb-8b34-d25304c19b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:33.682378 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabeba7-5c96-4abb-8b34-d25304c19b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:33.682956 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabeba7-5c96-4abb-8b34-d25304c19b6d admin admin] PATH_INFO: `/v3/users/159a28e7564145d6a6ef01572c19b3e9` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:33.685949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eabeba7-5c96-4abb-8b34-d25304c19b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=159a28e7564145d6a6ef01572c19b3e9)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:33.686958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b50058-d218-4199-8acb-d6cdeb439168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:33.687202 dv-cinder-796170-6-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-2eabeba7-5c96-4abb-8b34-d25304c19b6d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 12:32:33.687202 dv-cinder-796170-6-smb devstack@keystone.service[81458]: warnings.warn(msg) Oct 31 12:32:33.687202 dv-cinder-796170-6-smb devstack@keystone.service[81458]: Oct 31 12:32:33.688251 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b50058-d218-4199-8acb-d6cdeb439168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:33.688489 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eabeba7-5c96-4abb-8b34-d25304c19b6d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:33.688844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b50058-d218-4199-8acb-d6cdeb439168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:33.689338 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b50058-d218-4199-8acb-d6cdeb439168 admin admin] PATH_INFO: `/v3/users/d12c5a41f344496caf0034669fbd0893` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:33.691580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b50058-d218-4199-8acb-d6cdeb439168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d12c5a41f344496caf0034669fbd0893)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:33.694501 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b50058-d218-4199-8acb-d6cdeb439168 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:33.814492 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c1b50058-d218-4199-8acb-d6cdeb439168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd12c5a41f344496caf0034669fbd0893'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:33.816486 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c1b50058-d218-4199-8acb-d6cdeb439168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd12c5a41f344496caf0034669fbd0893'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:33.818589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c1b50058-d218-4199-8acb-d6cdeb439168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd12c5a41f344496caf0034669fbd0893'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:33.849746 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c1b50058-d218-4199-8acb-d6cdeb439168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd12c5a41f344496caf0034669fbd0893'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:33.877550 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c1b50058-d218-4199-8acb-d6cdeb439168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd12c5a41f344496caf0034669fbd0893'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:33.877716 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2eabeba7-5c96-4abb-8b34-d25304c19b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '159a28e7564145d6a6ef01572c19b3e9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:33.880177 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:33.902391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2eabeba7-5c96-4abb-8b34-d25304c19b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '159a28e7564145d6a6ef01572c19b3e9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:33.903221 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2eabeba7-5c96-4abb-8b34-d25304c19b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '159a28e7564145d6a6ef01572c19b3e9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:33.931474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 666/1324] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:32:33 2022] DELETE /identity/v3/users/d12c5a41f344496caf0034669fbd0893 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:33.942645 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9795271-2b24-46f0-929b-0b441e535255 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:33.943341 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9795271-2b24-46f0-929b-0b441e535255 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:33.943466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9795271-2b24-46f0-929b-0b441e535255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:33.950335 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2eabeba7-5c96-4abb-8b34-d25304c19b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '159a28e7564145d6a6ef01572c19b3e9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:33.985390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-b9795271-2b24-46f0-929b-0b441e535255 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:33.985710 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2eabeba7-5c96-4abb-8b34-d25304c19b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '159a28e7564145d6a6ef01572c19b3e9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:33.987160 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b9795271-2b24-46f0-929b-0b441e535255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:34.005644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 659/1325] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:32:33 2022] DELETE /identity/v3/users/159a28e7564145d6a6ef01572c19b3e9 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:34.008178 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea3cb9-0aab-46ff-b451-0dfa31742285 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:34.008472 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea3cb9-0aab-46ff-b451-0dfa31742285 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:34.008774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea3cb9-0aab-46ff-b451-0dfa31742285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:34.077909 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2fea3cb9-0aab-46ff-b451-0dfa31742285 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:34.079221 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2fea3cb9-0aab-46ff-b451-0dfa31742285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:34.173292 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 667/1326] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:34.179202 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46962c3-5ac2-4c9b-8dc9-24a641f86722 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:34.179506 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46962c3-5ac2-4c9b-8dc9-24a641f86722 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:34.179917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46962c3-5ac2-4c9b-8dc9-24a641f86722 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:34.184600 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 668/1327] 10.222.0.18 () {54 vars in 961 bytes} [Mon Oct 31 12:32:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:32:34.194222 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc0a48-60cf-4c73-8d2f-c36e43d26a01 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:34.194502 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc0a48-60cf-4c73-8d2f-c36e43d26a01 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:34.194781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc0a48-60cf-4c73-8d2f-c36e43d26a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:34.230262 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 660/1328] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:34.237536 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea3cb9-0aab-46ff-b451-0dfa31742285 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:34.239417 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2fea3cb9-0aab-46ff-b451-0dfa31742285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:34.240267 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-86fc0a48-60cf-4c73-8d2f-c36e43d26a01 None None] MFA Rules not processed for user `d93ce5759e0648a1934ff4d9c9d8fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:34.241486 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-86fc0a48-60cf-4c73-8d2f-c36e43d26a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:34.395873 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 669/1329] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Oct 31 12:32:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:32:34.407245 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e2dc8-95b3-4e2b-b3d9-245aa66b95f0 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:34.407882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e2dc8-95b3-4e2b-b3d9-245aa66b95f0 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:34.407882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e2dc8-95b3-4e2b-b3d9-245aa66b95f0 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:34.416957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 670/1330] 10.222.0.18 () {54 vars in 912 bytes} [Mon Oct 31 12:32:34 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:32:34.419362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea3cb9-0aab-46ff-b451-0dfa31742285 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:34.426653 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6e815-bbc7-4ea0-8d0f-4754afb95a13 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:34.426950 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6e815-bbc7-4ea0-8d0f-4754afb95a13 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:34.427206 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6e815-bbc7-4ea0-8d0f-4754afb95a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:34.427861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc87f3-6ad9-4820-a74e-051090e4dfc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:34.428662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc87f3-6ad9-4820-a74e-051090e4dfc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:34.430173 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc87f3-6ad9-4820-a74e-051090e4dfc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:34.430622 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc87f3-6ad9-4820-a74e-051090e4dfc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:34.457708 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:34.464015 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc87f3-6ad9-4820-a74e-051090e4dfc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:34.465455 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc87f3-6ad9-4820-a74e-051090e4dfc4 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:34.512793 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f1b6e815-bbc7-4ea0-8d0f-4754afb95a13 None None] MFA Rules not processed for user `d93ce5759e0648a1934ff4d9c9d8fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:34.514081 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f1b6e815-bbc7-4ea0-8d0f-4754afb95a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:34.517716 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 661/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:32:34.547394 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc87f3-6ad9-4820-a74e-051090e4dfc4 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:34.553635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 671/1332] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 31 12:32:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:34.562436 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6e815-bbc7-4ea0-8d0f-4754afb95a13 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:34.562933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc87f3-6ad9-4820-a74e-051090e4dfc4 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:34.564500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f1b6e815-bbc7-4ea0-8d0f-4754afb95a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:34.571283 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791eccd6-98d2-4f43-979c-2f447fcc35d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:34.571944 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eccd6-98d2-4f43-979c-2f447fcc35d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:34.572229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eccd6-98d2-4f43-979c-2f447fcc35d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:34.572555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eccd6-98d2-4f43-979c-2f447fcc35d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:34.610166 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791eccd6-98d2-4f43-979c-2f447fcc35d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:34.613997 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791eccd6-98d2-4f43-979c-2f447fcc35d6 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:34.665091 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 662/1333] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:32:34.752082 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6e815-bbc7-4ea0-8d0f-4754afb95a13 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:34.763965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450186f4-ad34-47e2-b5ce-909bdffab866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:34.765305 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450186f4-ad34-47e2-b5ce-909bdffab866 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:34.767513 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450186f4-ad34-47e2-b5ce-909bdffab866 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:34.769349 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450186f4-ad34-47e2-b5ce-909bdffab866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:34.796256 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450186f4-ad34-47e2-b5ce-909bdffab866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:34.799338 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450186f4-ad34-47e2-b5ce-909bdffab866 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:34.836415 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 672/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:32:35.847702 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791eccd6-98d2-4f43-979c-2f447fcc35d6 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:35.849841 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-791eccd6-98d2-4f43-979c-2f447fcc35d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:35.870626 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791eccd6-98d2-4f43-979c-2f447fcc35d6 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:35.889323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b936ff-9437-4f78-a73e-554a0560a6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:35.890276 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b936ff-9437-4f78-a73e-554a0560a6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:35.890963 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b936ff-9437-4f78-a73e-554a0560a6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:35.891401 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b936ff-9437-4f78-a73e-554a0560a6a8 admin admin] PATH_INFO: `/v3/projects/52511ca380a24702ba4e2a3e94634171` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:35.893406 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b936ff-9437-4f78-a73e-554a0560a6a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52511ca380a24702ba4e2a3e94634171)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:35.895503 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b936ff-9437-4f78-a73e-554a0560a6a8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:35.982152 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-17b936ff-9437-4f78-a73e-554a0560a6a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52511ca380a24702ba4e2a3e94634171', 'request_id': 'req-17b936ff-9437-4f78-a73e-554a0560a6a8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:35.984531 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:INSERT=1,keystone:DELETE=7,keystone:SELECT=92 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:35.992471 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-17b936ff-9437-4f78-a73e-554a0560a6a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52511ca380a24702ba4e2a3e94634171', 'request_id': 'req-17b936ff-9437-4f78-a73e-554a0560a6a8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:36.002067 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-17b936ff-9437-4f78-a73e-554a0560a6a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52511ca380a24702ba4e2a3e94634171', 'request_id': 'req-17b936ff-9437-4f78-a73e-554a0560a6a8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:36.045850 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-17b936ff-9437-4f78-a73e-554a0560a6a8 admin admin] The token cache is being invalidate because project 52511ca380a24702ba4e2a3e94634171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:32:36.046372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-17b936ff-9437-4f78-a73e-554a0560a6a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:36.048598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-17b936ff-9437-4f78-a73e-554a0560a6a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:36.052014 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 663/1335] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:32:35 2022] DELETE /identity/v3/projects/52511ca380a24702ba4e2a3e94634171 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:36.055761 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450186f4-ad34-47e2-b5ce-909bdffab866 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:36.070639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450186f4-ad34-47e2-b5ce-909bdffab866 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:36.210000 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b3af9-24d7-4f8f-8bca-2a004bb12f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:36.210774 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b3af9-24d7-4f8f-8bca-2a004bb12f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:36.211168 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b3af9-24d7-4f8f-8bca-2a004bb12f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:36.211649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b3af9-24d7-4f8f-8bca-2a004bb12f47 admin admin] PATH_INFO: `/v3/users/13b6ae806fd74a8cb9391c8bd6c097ec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:36.215856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b3af9-24d7-4f8f-8bca-2a004bb12f47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13b6ae806fd74a8cb9391c8bd6c097ec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:36.218240 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b3af9-24d7-4f8f-8bca-2a004bb12f47 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:36.329860 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-2a2b3af9-24d7-4f8f-8bca-2a004bb12f47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13b6ae806fd74a8cb9391c8bd6c097ec'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:36.330837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-2a2b3af9-24d7-4f8f-8bca-2a004bb12f47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13b6ae806fd74a8cb9391c8bd6c097ec'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:36.346542 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-2a2b3af9-24d7-4f8f-8bca-2a004bb12f47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13b6ae806fd74a8cb9391c8bd6c097ec'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:36.358073 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-2a2b3af9-24d7-4f8f-8bca-2a004bb12f47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13b6ae806fd74a8cb9391c8bd6c097ec'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:36.387556 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-2a2b3af9-24d7-4f8f-8bca-2a004bb12f47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13b6ae806fd74a8cb9391c8bd6c097ec'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:36.428957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 673/1336] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:32:36 2022] DELETE /identity/v3/users/13b6ae806fd74a8cb9391c8bd6c097ec => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:36.540924 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b936ff-9437-4f78-a73e-554a0560a6a8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:36.543343 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-17b936ff-9437-4f78-a73e-554a0560a6a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:36.588916 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b936ff-9437-4f78-a73e-554a0560a6a8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:36.590539 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b3af9-24d7-4f8f-8bca-2a004bb12f47 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:36.592144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2a2b3af9-24d7-4f8f-8bca-2a004bb12f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:36.651315 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:36.806923 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee7247-1c20-4de3-88a0-5b5bba4adeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:36.809854 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee7247-1c20-4de3-88a0-5b5bba4adeab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:36.809854 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee7247-1c20-4de3-88a0-5b5bba4adeab admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:36.811146 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee7247-1c20-4de3-88a0-5b5bba4adeab admin admin] PATH_INFO: `/v3/users/35a2cb3d31e4479da9b7525a56b273b4` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:36.814156 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b3af9-24d7-4f8f-8bca-2a004bb12f47 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:36.814332 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee7247-1c20-4de3-88a0-5b5bba4adeab admin admin] RBAC: Authorizing `identity:delete_user(user_id=35a2cb3d31e4479da9b7525a56b273b4)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:36.820861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee7247-1c20-4de3-88a0-5b5bba4adeab admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:36.830433 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754aaa3-1b16-4378-b3c7-cab21f47187e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:36.832092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754aaa3-1b16-4378-b3c7-cab21f47187e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:36.841058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754aaa3-1b16-4378-b3c7-cab21f47187e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:36.842286 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754aaa3-1b16-4378-b3c7-cab21f47187e admin admin] PATH_INFO: `/v3/projects/8dfc001b8d5742c3be3d3f24644ed4de` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:36.849608 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754aaa3-1b16-4378-b3c7-cab21f47187e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dfc001b8d5742c3be3d3f24644ed4de)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:36.852470 dv-cinder-796170-6-smb devstack@keystone.service[81457]: WARNING py.warnings [None req-7754aaa3-1b16-4378-b3c7-cab21f47187e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 12:32:36.852470 dv-cinder-796170-6-smb devstack@keystone.service[81457]: warnings.warn(msg) Oct 31 12:32:36.852470 dv-cinder-796170-6-smb devstack@keystone.service[81457]: Oct 31 12:32:36.862105 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754aaa3-1b16-4378-b3c7-cab21f47187e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:36.965649 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-77ee7247-1c20-4de3-88a0-5b5bba4adeab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35a2cb3d31e4479da9b7525a56b273b4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:36.996734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-77ee7247-1c20-4de3-88a0-5b5bba4adeab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35a2cb3d31e4479da9b7525a56b273b4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:36.998199 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-77ee7247-1c20-4de3-88a0-5b5bba4adeab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35a2cb3d31e4479da9b7525a56b273b4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:37.032964 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-77ee7247-1c20-4de3-88a0-5b5bba4adeab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35a2cb3d31e4479da9b7525a56b273b4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:37.039548 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7754aaa3-1b16-4378-b3c7-cab21f47187e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dfc001b8d5742c3be3d3f24644ed4de', 'request_id': 'req-7754aaa3-1b16-4378-b3c7-cab21f47187e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:37.055565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-77ee7247-1c20-4de3-88a0-5b5bba4adeab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35a2cb3d31e4479da9b7525a56b273b4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:37.059638 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7754aaa3-1b16-4378-b3c7-cab21f47187e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dfc001b8d5742c3be3d3f24644ed4de', 'request_id': 'req-7754aaa3-1b16-4378-b3c7-cab21f47187e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:37.075043 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 664/1337] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:32:36 2022] DELETE /identity/v3/users/35a2cb3d31e4479da9b7525a56b273b4 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:37.079260 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91b86c-2862-43d1-ac41-57e19db2e980 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:37.082597 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91b86c-2862-43d1-ac41-57e19db2e980 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:37.089820 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91b86c-2862-43d1-ac41-57e19db2e980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:37.112503 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7754aaa3-1b16-4378-b3c7-cab21f47187e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dfc001b8d5742c3be3d3f24644ed4de', 'request_id': 'req-7754aaa3-1b16-4378-b3c7-cab21f47187e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:37.138175 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7754aaa3-1b16-4378-b3c7-cab21f47187e admin admin] The token cache is being invalidate because project 8dfc001b8d5742c3be3d3f24644ed4de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:32:37.140486 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7754aaa3-1b16-4378-b3c7-cab21f47187e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:37.142208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7754aaa3-1b16-4378-b3c7-cab21f47187e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:37.146719 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 674/1338] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:32:36 2022] DELETE /identity/v3/projects/8dfc001b8d5742c3be3d3f24644ed4de => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:37.150331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754aaa3-1b16-4378-b3c7-cab21f47187e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:37.152745 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7754aaa3-1b16-4378-b3c7-cab21f47187e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:37.152878 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8f91b86c-2862-43d1-ac41-57e19db2e980 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:37.154159 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8f91b86c-2862-43d1-ac41-57e19db2e980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:37.256184 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:37.283810 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 665/1339] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:37.299064 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754aaa3-1b16-4378-b3c7-cab21f47187e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:37.316065 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e84110-555f-49b0-8c0e-2bb2ce993305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:37.317096 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e84110-555f-49b0-8c0e-2bb2ce993305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:37.317603 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e84110-555f-49b0-8c0e-2bb2ce993305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:37.318121 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e84110-555f-49b0-8c0e-2bb2ce993305 admin admin] PATH_INFO: `/v3/users/c8aeb6974c504d4abafa1836b1094e84` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:37.320601 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e84110-555f-49b0-8c0e-2bb2ce993305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8aeb6974c504d4abafa1836b1094e84)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:37.325405 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e84110-555f-49b0-8c0e-2bb2ce993305 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:37.351674 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91b86c-2862-43d1-ac41-57e19db2e980 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:37.353672 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8f91b86c-2862-43d1-ac41-57e19db2e980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:37.413292 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-f8e84110-555f-49b0-8c0e-2bb2ce993305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8aeb6974c504d4abafa1836b1094e84'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:37.414689 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-f8e84110-555f-49b0-8c0e-2bb2ce993305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8aeb6974c504d4abafa1836b1094e84'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:37.415576 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-f8e84110-555f-49b0-8c0e-2bb2ce993305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8aeb6974c504d4abafa1836b1094e84'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:37.421564 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:37.434370 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-f8e84110-555f-49b0-8c0e-2bb2ce993305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8aeb6974c504d4abafa1836b1094e84'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:37.445444 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-f8e84110-555f-49b0-8c0e-2bb2ce993305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8aeb6974c504d4abafa1836b1094e84'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:37.469248 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91b86c-2862-43d1-ac41-57e19db2e980 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:37.471505 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 675/1340] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:32:37 2022] DELETE /identity/v3/users/c8aeb6974c504d4abafa1836b1094e84 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:37.575945 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d72808-a12e-466b-b70c-c438231326d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:37.576582 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d72808-a12e-466b-b70c-c438231326d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:37.576865 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d72808-a12e-466b-b70c-c438231326d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:37.577189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d72808-a12e-466b-b70c-c438231326d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:37.579087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f6d72808-a12e-466b-b70c-c438231326d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:37.692985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d72808-a12e-466b-b70c-c438231326d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:37.696135 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d72808-a12e-466b-b70c-c438231326d7 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:37.712300 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 666/1341] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:32:39.025262 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e84110-555f-49b0-8c0e-2bb2ce993305 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:39.033775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f8e84110-555f-49b0-8c0e-2bb2ce993305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:39.076919 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e84110-555f-49b0-8c0e-2bb2ce993305 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:39.084948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcceaf5d-dbd6-4665-965a-1d1299b27eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:39.086095 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcceaf5d-dbd6-4665-965a-1d1299b27eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:39.086419 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcceaf5d-dbd6-4665-965a-1d1299b27eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:39.086694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcceaf5d-dbd6-4665-965a-1d1299b27eae admin admin] PATH_INFO: `/v3/projects/bf822f9c2e5541788dc1baa1b260154c` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:39.088718 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcceaf5d-dbd6-4665-965a-1d1299b27eae admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf822f9c2e5541788dc1baa1b260154c)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:39.091917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcceaf5d-dbd6-4665-965a-1d1299b27eae admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:39.206544 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-fcceaf5d-dbd6-4665-965a-1d1299b27eae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf822f9c2e5541788dc1baa1b260154c', 'request_id': 'req-fcceaf5d-dbd6-4665-965a-1d1299b27eae'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:39.240885 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-fcceaf5d-dbd6-4665-965a-1d1299b27eae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf822f9c2e5541788dc1baa1b260154c', 'request_id': 'req-fcceaf5d-dbd6-4665-965a-1d1299b27eae'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:39.272174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-fcceaf5d-dbd6-4665-965a-1d1299b27eae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf822f9c2e5541788dc1baa1b260154c', 'request_id': 'req-fcceaf5d-dbd6-4665-965a-1d1299b27eae'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:39.299678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-fcceaf5d-dbd6-4665-965a-1d1299b27eae admin admin] The token cache is being invalidate because project bf822f9c2e5541788dc1baa1b260154c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:32:39.300036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-fcceaf5d-dbd6-4665-965a-1d1299b27eae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:39.300681 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-fcceaf5d-dbd6-4665-965a-1d1299b27eae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:39.306922 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 676/1342] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:32:39 2022] DELETE /identity/v3/projects/bf822f9c2e5541788dc1baa1b260154c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:39.307747 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7086ef-7203-486c-945c-f065798f3fb7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:39.308260 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7086ef-7203-486c-945c-f065798f3fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:39.308534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7086ef-7203-486c-945c-f065798f3fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:39.374591 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6a7086ef-7203-486c-945c-f065798f3fb7 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:39.379687 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6a7086ef-7203-486c-945c-f065798f3fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:39.596269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 667/1343] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:39.598065 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa12b4-305c-4f1b-b663-c96ce336b2b8 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:39.598317 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa12b4-305c-4f1b-b663-c96ce336b2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:39.598615 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa12b4-305c-4f1b-b663-c96ce336b2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:39.645336 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-dbfa12b4-305c-4f1b-b663-c96ce336b2b8 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:39.650185 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-dbfa12b4-305c-4f1b-b663-c96ce336b2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:39.692515 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 677/1344] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:39.694078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7086ef-7203-486c-945c-f065798f3fb7 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:39.707869 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:39.714335 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7086ef-7203-486c-945c-f065798f3fb7 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:39.732608 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5e82e-7b52-4490-be79-6908b7bef22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:39.733282 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5e82e-7b52-4490-be79-6908b7bef22c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:39.733569 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5e82e-7b52-4490-be79-6908b7bef22c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:39.733848 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5e82e-7b52-4490-be79-6908b7bef22c admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:39.734521 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5e82e-7b52-4490-be79-6908b7bef22c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:32:39.735742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5e82e-7b52-4490-be79-6908b7bef22c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:39.737949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5e82e-7b52-4490-be79-6908b7bef22c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:39.751364 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa12b4-305c-4f1b-b663-c96ce336b2b8 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:39.753194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-dbfa12b4-305c-4f1b-b663-c96ce336b2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:39.776324 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa12b4-305c-4f1b-b663-c96ce336b2b8 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:39.789917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910b10e-dc4d-41e2-ac96-c49a90d50175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:39.790809 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910b10e-dc4d-41e2-ac96-c49a90d50175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:39.791654 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910b10e-dc4d-41e2-ac96-c49a90d50175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:39.792388 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910b10e-dc4d-41e2-ac96-c49a90d50175 admin admin] PATH_INFO: `/v3/projects/d2f7427bab4740be998ba73fc3a79d43` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:39.797960 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910b10e-dc4d-41e2-ac96-c49a90d50175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f7427bab4740be998ba73fc3a79d43)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:39.802656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 668/1345] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:32:39.802816 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910b10e-dc4d-41e2-ac96-c49a90d50175 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:39.804737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5e82e-7b52-4490-be79-6908b7bef22c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:39.840857 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5e82e-7b52-4490-be79-6908b7bef22c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:39.852819 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3eb1d-4fd4-41c8-85ce-412a0ccbff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:39.857100 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3eb1d-4fd4-41c8-85ce-412a0ccbff5d admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:39.857619 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3eb1d-4fd4-41c8-85ce-412a0ccbff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:39.858067 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3eb1d-4fd4-41c8-85ce-412a0ccbff5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:39.859438 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3eb1d-4fd4-41c8-85ce-412a0ccbff5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:39.864762 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3eb1d-4fd4-41c8-85ce-412a0ccbff5d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:39.910069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3910b10e-dc4d-41e2-ac96-c49a90d50175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f7427bab4740be998ba73fc3a79d43', 'request_id': 'req-3910b10e-dc4d-41e2-ac96-c49a90d50175'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:39.928213 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3910b10e-dc4d-41e2-ac96-c49a90d50175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f7427bab4740be998ba73fc3a79d43', 'request_id': 'req-3910b10e-dc4d-41e2-ac96-c49a90d50175'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:39.937374 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3910b10e-dc4d-41e2-ac96-c49a90d50175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f7427bab4740be998ba73fc3a79d43', 'request_id': 'req-3910b10e-dc4d-41e2-ac96-c49a90d50175'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:39.970474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3910b10e-dc4d-41e2-ac96-c49a90d50175 admin admin] The token cache is being invalidate because project d2f7427bab4740be998ba73fc3a79d43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:32:39.970850 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3910b10e-dc4d-41e2-ac96-c49a90d50175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:39.971787 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3910b10e-dc4d-41e2-ac96-c49a90d50175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:39.972048 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 669/1346] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:32:39 2022] POST /identity/v3/projects => generated 363 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:39.974080 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3eb1d-4fd4-41c8-85ce-412a0ccbff5d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:39.981228 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 678/1347] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:32:39 2022] DELETE /identity/v3/projects/d2f7427bab4740be998ba73fc3a79d43 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:32:39.982540 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbfb58-5ad6-4ddb-b02d-d7aefd4b039a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:39.982540 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbfb58-5ad6-4ddb-b02d-d7aefd4b039a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:39.982778 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbfb58-5ad6-4ddb-b02d-d7aefd4b039a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:39.988057 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-44e3eb1d-4fd4-41c8-85ce-412a0ccbff5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:40.007521 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-10cbfb58-5ad6-4ddb-b02d-d7aefd4b039a None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:40.008788 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-10cbfb58-5ad6-4ddb-b02d-d7aefd4b039a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:40.035647 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:40.140208 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3eb1d-4fd4-41c8-85ce-412a0ccbff5d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:40.147043 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d64cde-4540-4f9e-847c-0688ef848e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:40.147885 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d64cde-4540-4f9e-847c-0688ef848e45 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:40.148760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d64cde-4540-4f9e-847c-0688ef848e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:40.149138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d64cde-4540-4f9e-847c-0688ef848e45 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:40.149993 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d64cde-4540-4f9e-847c-0688ef848e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:40.151143 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 679/1348] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:32:40.161696 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d64cde-4540-4f9e-847c-0688ef848e45 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:40.165921 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd54a42-6e75-4c54-a5aa-44272416f1bb None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:40.166555 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd54a42-6e75-4c54-a5aa-44272416f1bb None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:40.167825 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd54a42-6e75-4c54-a5aa-44272416f1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:40.198902 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 670/1349] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:32:39 2022] POST /identity/v3/users => generated 282 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:40.200176 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-4cd54a42-6e75-4c54-a5aa-44272416f1bb None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:40.200786 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d64cde-4540-4f9e-847c-0688ef848e45 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:40.201450 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4cd54a42-6e75-4c54-a5aa-44272416f1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:40.202959 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-01d64cde-4540-4f9e-847c-0688ef848e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:40.219670 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 680/1350] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:40.221042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd54a42-6e75-4c54-a5aa-44272416f1bb None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:40.235732 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd54a42-6e75-4c54-a5aa-44272416f1bb None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:40.241395 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548afca7-3bf8-41a8-9ecf-ff6ed7de0617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:40.242026 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548afca7-3bf8-41a8-9ecf-ff6ed7de0617 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:40.242157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d64cde-4540-4f9e-847c-0688ef848e45 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:40.242354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548afca7-3bf8-41a8-9ecf-ff6ed7de0617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:40.246067 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548afca7-3bf8-41a8-9ecf-ff6ed7de0617 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:40.246839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548afca7-3bf8-41a8-9ecf-ff6ed7de0617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:40.249637 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548afca7-3bf8-41a8-9ecf-ff6ed7de0617 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:40.254210 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c5ca1-32c5-44e6-9c72-4f48bcd36385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:40.254929 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c5ca1-32c5-44e6-9c72-4f48bcd36385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:40.257613 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c5ca1-32c5-44e6-9c72-4f48bcd36385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:40.257926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c5ca1-32c5-44e6-9c72-4f48bcd36385 admin admin] PATH_INFO: `/v3/projects/92e3f989388144d6bd87418f0bcd09ef` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:40.262732 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c5ca1-32c5-44e6-9c72-4f48bcd36385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92e3f989388144d6bd87418f0bcd09ef)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:40.265491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c5ca1-32c5-44e6-9c72-4f48bcd36385 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:40.266342 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 681/1351] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:40.267357 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548afca7-3bf8-41a8-9ecf-ff6ed7de0617 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:40.279267 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548afca7-3bf8-41a8-9ecf-ff6ed7de0617 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:40.291785 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7399a-44f3-464f-9e4f-4dec79136417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:40.292378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7399a-44f3-464f-9e4f-4dec79136417 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:40.292667 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7399a-44f3-464f-9e4f-4dec79136417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:40.292942 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7399a-44f3-464f-9e4f-4dec79136417 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:40.293643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7399a-44f3-464f-9e4f-4dec79136417 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:32:40.293948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7399a-44f3-464f-9e4f-4dec79136417 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:40.295929 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7399a-44f3-464f-9e4f-4dec79136417 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:40.331147 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 682/1352] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:32:40.334727 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7399a-44f3-464f-9e4f-4dec79136417 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:40.366598 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7399a-44f3-464f-9e4f-4dec79136417 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:40.387473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-020c5ca1-32c5-44e6-9c72-4f48bcd36385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92e3f989388144d6bd87418f0bcd09ef', 'request_id': 'req-020c5ca1-32c5-44e6-9c72-4f48bcd36385'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:40.410086 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-020c5ca1-32c5-44e6-9c72-4f48bcd36385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92e3f989388144d6bd87418f0bcd09ef', 'request_id': 'req-020c5ca1-32c5-44e6-9c72-4f48bcd36385'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:40.425625 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-020c5ca1-32c5-44e6-9c72-4f48bcd36385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92e3f989388144d6bd87418f0bcd09ef', 'request_id': 'req-020c5ca1-32c5-44e6-9c72-4f48bcd36385'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:40.457424 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-020c5ca1-32c5-44e6-9c72-4f48bcd36385 admin admin] The token cache is being invalidate because project 92e3f989388144d6bd87418f0bcd09ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:32:40.457728 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-020c5ca1-32c5-44e6-9c72-4f48bcd36385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:40.460593 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-020c5ca1-32c5-44e6-9c72-4f48bcd36385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:40.468217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 671/1353] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:32:40 2022] DELETE /identity/v3/projects/92e3f989388144d6bd87418f0bcd09ef => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:40.468562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c5ca1-32c5-44e6-9c72-4f48bcd36385 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:40.472536 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-020c5ca1-32c5-44e6-9c72-4f48bcd36385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:40.533605 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1fc46-f1c9-4572-b517-274ba2897636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:40.534239 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1fc46-f1c9-4572-b517-274ba2897636 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:40.534521 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1fc46-f1c9-4572-b517-274ba2897636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:40.534795 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1fc46-f1c9-4572-b517-274ba2897636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:40.535508 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1fc46-f1c9-4572-b517-274ba2897636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:40.539143 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1fc46-f1c9-4572-b517-274ba2897636 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:40.591968 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 683/1354] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:40.597190 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6c016-3bea-4385-91aa-19565a6bbbf9 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:40.599264 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6c016-3bea-4385-91aa-19565a6bbbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:40.600809 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6c016-3bea-4385-91aa-19565a6bbbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:40.602466 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:40.634146 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c5ca1-32c5-44e6-9c72-4f48bcd36385 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:40.643771 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aeb4e7-2fc9-4f83-a0bc-3e413cfc00e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:40.645121 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeb4e7-2fc9-4f83-a0bc-3e413cfc00e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:40.645433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeb4e7-2fc9-4f83-a0bc-3e413cfc00e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:40.645779 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeb4e7-2fc9-4f83-a0bc-3e413cfc00e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:40.647171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aeb4e7-2fc9-4f83-a0bc-3e413cfc00e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:40.650757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aeb4e7-2fc9-4f83-a0bc-3e413cfc00e6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:40.656248 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-78e6c016-3bea-4385-91aa-19565a6bbbf9 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:40.658177 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-78e6c016-3bea-4385-91aa-19565a6bbbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:40.690526 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 684/1355] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:40.693860 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6c016-3bea-4385-91aa-19565a6bbbf9 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:40.699830 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-78e6c016-3bea-4385-91aa-19565a6bbbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:40.706776 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 672/1356] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:32:40 2022] POST /identity/v3/projects => generated 379 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:40.712138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84598594-c58a-4e75-b1b6-9753c0f090c4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:40.712443 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84598594-c58a-4e75-b1b6-9753c0f090c4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:40.712776 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84598594-c58a-4e75-b1b6-9753c0f090c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:40.736498 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6c016-3bea-4385-91aa-19565a6bbbf9 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:40.772600 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-84598594-c58a-4e75-b1b6-9753c0f090c4 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:40.777756 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-84598594-c58a-4e75-b1b6-9753c0f090c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:40.935067 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6da461-21dd-4c93-8452-340f0ef73259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:40.935869 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6da461-21dd-4c93-8452-340f0ef73259 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:40.936024 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6da461-21dd-4c93-8452-340f0ef73259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:40.936303 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6da461-21dd-4c93-8452-340f0ef73259 admin admin] PATH_INFO: `/v3/projects/013c2a6c242c48f2b601d39284114f71/users/dd72b803abfb4cdca437bb602025aa27/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:40.976644 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6da461-21dd-4c93-8452-340f0ef73259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=013c2a6c242c48f2b601d39284114f71, user_id=dd72b803abfb4cdca437bb602025aa27, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:40.979899 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6da461-21dd-4c93-8452-340f0ef73259 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:40.986171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 673/1357] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:40.987486 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84598594-c58a-4e75-b1b6-9753c0f090c4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:41.022895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84598594-c58a-4e75-b1b6-9753c0f090c4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:41.039829 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 685/1358] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:32:40 2022] PUT /identity/v3/projects/013c2a6c242c48f2b601d39284114f71/users/dd72b803abfb4cdca437bb602025aa27/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:41.039829 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6da461-21dd-4c93-8452-340f0ef73259 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:41.050576 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07821a3-72f7-44bb-9714-ea42de2e55b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:41.054688 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07821a3-72f7-44bb-9714-ea42de2e55b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:41.055380 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07821a3-72f7-44bb-9714-ea42de2e55b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:41.073716 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07821a3-72f7-44bb-9714-ea42de2e55b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:41.075094 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07821a3-72f7-44bb-9714-ea42de2e55b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:41.086497 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07821a3-72f7-44bb-9714-ea42de2e55b7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:41.092843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:41.164194 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 674/1359] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:32:40 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:41.175490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5a533-60ea-4b6c-bdf7-769a238402da None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:41.175920 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5a533-60ea-4b6c-bdf7-769a238402da None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:41.176299 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5a533-60ea-4b6c-bdf7-769a238402da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:41.246213 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6da461-21dd-4c93-8452-340f0ef73259 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:41.254977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22391a15-2913-4a56-a05c-87e44786eef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:41.255677 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22391a15-2913-4a56-a05c-87e44786eef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:41.256028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22391a15-2913-4a56-a05c-87e44786eef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:41.256371 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22391a15-2913-4a56-a05c-87e44786eef9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:41.257372 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22391a15-2913-4a56-a05c-87e44786eef9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:32:41.257537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22391a15-2913-4a56-a05c-87e44786eef9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:41.259679 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22391a15-2913-4a56-a05c-87e44786eef9 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:41.266129 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-46e5a533-60ea-4b6c-bdf7-769a238402da None None] MFA Rules not processed for user `dd72b803abfb4cdca437bb602025aa27`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:41.267456 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-46e5a533-60ea-4b6c-bdf7-769a238402da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:41.279489 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 686/1360] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:32:41.280759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22391a15-2913-4a56-a05c-87e44786eef9 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:41.293143 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22391a15-2913-4a56-a05c-87e44786eef9 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:41.300114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0e796-bb20-4391-939a-65d0571d8770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:41.300977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0e796-bb20-4391-939a-65d0571d8770 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:41.301376 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0e796-bb20-4391-939a-65d0571d8770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:41.301974 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0e796-bb20-4391-939a-65d0571d8770 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:41.302741 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0e796-bb20-4391-939a-65d0571d8770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:41.304418 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0e796-bb20-4391-939a-65d0571d8770 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:41.318024 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 687/1361] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:41.319122 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0e796-bb20-4391-939a-65d0571d8770 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:41.340444 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0e796-bb20-4391-939a-65d0571d8770 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:41.350672 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168de89-d72f-433a-a8dc-1e91d9e434d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:41.350878 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168de89-d72f-433a-a8dc-1e91d9e434d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:41.351238 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168de89-d72f-433a-a8dc-1e91d9e434d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:41.351728 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168de89-d72f-433a-a8dc-1e91d9e434d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:41.352947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168de89-d72f-433a-a8dc-1e91d9e434d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:41.355126 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168de89-d72f-433a-a8dc-1e91d9e434d0 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:41.433421 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 688/1362] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:32:41 2022] POST /identity/v3/projects => generated 357 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:41.435993 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168de89-d72f-433a-a8dc-1e91d9e434d0 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:41.476523 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 675/1363] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:41.477242 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5a533-60ea-4b6c-bdf7-769a238402da None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:41.507055 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5a533-60ea-4b6c-bdf7-769a238402da None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:41.592334 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:41.596504 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168de89-d72f-433a-a8dc-1e91d9e434d0 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:41.609785 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d804818-2dab-4552-9643-24190a827eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:41.610998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d804818-2dab-4552-9643-24190a827eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:41.612933 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d804818-2dab-4552-9643-24190a827eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:41.613392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d804818-2dab-4552-9643-24190a827eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:41.614662 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d804818-2dab-4552-9643-24190a827eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:41.616368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d804818-2dab-4552-9643-24190a827eeb admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:41.653046 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 689/1364] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:41.653046 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d804818-2dab-4552-9643-24190a827eeb admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:41.660879 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048deee-8ad8-4a98-b952-f25da4b1ba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:41.661721 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048deee-8ad8-4a98-b952-f25da4b1ba7c admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:41.662177 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048deee-8ad8-4a98-b952-f25da4b1ba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:41.662620 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048deee-8ad8-4a98-b952-f25da4b1ba7c admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:41.666122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048deee-8ad8-4a98-b952-f25da4b1ba7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:41.668263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048deee-8ad8-4a98-b952-f25da4b1ba7c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:41.673466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d804818-2dab-4552-9643-24190a827eeb admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:41.687314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930586e0-d6dc-4519-82be-18e5abe2007a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:41.688215 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930586e0-d6dc-4519-82be-18e5abe2007a admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:41.688700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930586e0-d6dc-4519-82be-18e5abe2007a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:41.689053 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930586e0-d6dc-4519-82be-18e5abe2007a admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:41.689914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930586e0-d6dc-4519-82be-18e5abe2007a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:41.692158 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930586e0-d6dc-4519-82be-18e5abe2007a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:41.723833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 676/1365] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:32:41 2022] POST /identity/v3/users => generated 279 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:41.724941 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048deee-8ad8-4a98-b952-f25da4b1ba7c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:41.755152 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048deee-8ad8-4a98-b952-f25da4b1ba7c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:41.762770 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 690/1366] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:32:41 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:41.765736 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0af56-490f-4140-a039-24380c63feab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:41.766730 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0af56-490f-4140-a039-24380c63feab admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:41.767020 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0af56-490f-4140-a039-24380c63feab admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:41.767158 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930586e0-d6dc-4519-82be-18e5abe2007a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:41.767305 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0af56-490f-4140-a039-24380c63feab admin admin] PATH_INFO: `/v3/projects/cef0e9c7c4324330b0a019a0f3855d87/users/d3bc846ee10a4924bdac4659f6ef1e9d/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:41.812489 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0af56-490f-4140-a039-24380c63feab admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef0e9c7c4324330b0a019a0f3855d87, user_id=d3bc846ee10a4924bdac4659f6ef1e9d, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:41.820788 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0af56-490f-4140-a039-24380c63feab admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:41.876008 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:41.876539 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 677/1367] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:32:41 2022] PUT /identity/v3/projects/cef0e9c7c4324330b0a019a0f3855d87/users/d3bc846ee10a4924bdac4659f6ef1e9d/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:41.886602 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0af56-490f-4140-a039-24380c63feab admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:41.924426 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930586e0-d6dc-4519-82be-18e5abe2007a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:42.083054 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0af56-490f-4140-a039-24380c63feab admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:42.091338 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56864690-14d1-4f63-a1ac-767a0a916e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:42.092057 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56864690-14d1-4f63-a1ac-767a0a916e70 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:42.092423 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56864690-14d1-4f63-a1ac-767a0a916e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:42.092715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56864690-14d1-4f63-a1ac-767a0a916e70 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:42.093524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56864690-14d1-4f63-a1ac-767a0a916e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:42.097457 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56864690-14d1-4f63-a1ac-767a0a916e70 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:42.101985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb644ca-7c4c-413b-9639-99efbbe89355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:42.103244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb644ca-7c4c-413b-9639-99efbbe89355 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:42.103922 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb644ca-7c4c-413b-9639-99efbbe89355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:42.104485 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb644ca-7c4c-413b-9639-99efbbe89355 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:42.105515 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb644ca-7c4c-413b-9639-99efbbe89355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:42.108310 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb644ca-7c4c-413b-9639-99efbbe89355 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:42.128393 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 691/1368] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:42.130761 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc1688-832f-4465-9480-cf741705a5bd None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:42.132006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc1688-832f-4465-9480-cf741705a5bd None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:42.132464 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc1688-832f-4465-9480-cf741705a5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:42.175621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-1efc1688-832f-4465-9480-cf741705a5bd None None] MFA Rules not processed for user `d3bc846ee10a4924bdac4659f6ef1e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:42.183514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1efc1688-832f-4465-9480-cf741705a5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:42.184760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 678/1369] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:32:41 2022] POST /identity/v3/users => generated 289 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:42.185669 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56864690-14d1-4f63-a1ac-767a0a916e70 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:42.214966 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56864690-14d1-4f63-a1ac-767a0a916e70 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:42.219893 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae08d3-bede-4b7a-8b55-5300f7bcbab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:42.220511 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae08d3-bede-4b7a-8b55-5300f7bcbab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:42.220795 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae08d3-bede-4b7a-8b55-5300f7bcbab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:42.221074 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae08d3-bede-4b7a-8b55-5300f7bcbab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:42.222125 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae08d3-bede-4b7a-8b55-5300f7bcbab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:42.223356 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae08d3-bede-4b7a-8b55-5300f7bcbab7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:42.260809 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 679/1370] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:42.262015 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae08d3-bede-4b7a-8b55-5300f7bcbab7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:42.306283 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae08d3-bede-4b7a-8b55-5300f7bcbab7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:42.333530 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c19c70-8ae9-4d29-91af-0d6bbab44455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:42.334159 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c19c70-8ae9-4d29-91af-0d6bbab44455 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:42.334626 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c19c70-8ae9-4d29-91af-0d6bbab44455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:42.335073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c19c70-8ae9-4d29-91af-0d6bbab44455 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:42.335894 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c19c70-8ae9-4d29-91af-0d6bbab44455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:42.337746 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c19c70-8ae9-4d29-91af-0d6bbab44455 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:42.360038 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 692/1371] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:42.360858 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc1688-832f-4465-9480-cf741705a5bd None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:42.383966 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 680/1372] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:42.384853 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c19c70-8ae9-4d29-91af-0d6bbab44455 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:42.396847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc1688-832f-4465-9480-cf741705a5bd None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:42.408854 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc994c5f-8d06-436a-b251-ae5cf5651b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:42.411032 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc994c5f-8d06-436a-b251-ae5cf5651b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:42.412392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc994c5f-8d06-436a-b251-ae5cf5651b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:42.413781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc994c5f-8d06-436a-b251-ae5cf5651b92 admin admin] PATH_INFO: `/v3/projects/08053c3c1ffc4c69936f356f784493fe/users/3ba64e65285945c7a04ff367364429ed/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:42.423743 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c19c70-8ae9-4d29-91af-0d6bbab44455 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:42.440563 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3627b00-fd02-4051-a437-f9e2d511d6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:42.441364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3627b00-fd02-4051-a437-f9e2d511d6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:42.441650 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3627b00-fd02-4051-a437-f9e2d511d6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:42.441925 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3627b00-fd02-4051-a437-f9e2d511d6e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:42.442571 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3627b00-fd02-4051-a437-f9e2d511d6e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:42.444487 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3627b00-fd02-4051-a437-f9e2d511d6e1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:42.454202 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc994c5f-8d06-436a-b251-ae5cf5651b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08053c3c1ffc4c69936f356f784493fe, user_id=3ba64e65285945c7a04ff367364429ed, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:42.463797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc994c5f-8d06-436a-b251-ae5cf5651b92 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:42.502154 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 693/1373] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:32:42 2022] PUT /identity/v3/projects/08053c3c1ffc4c69936f356f784493fe/users/3ba64e65285945c7a04ff367364429ed/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:42.502154 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc994c5f-8d06-436a-b251-ae5cf5651b92 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:42.514559 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 681/1374] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:32:42 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:42.516776 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67304e-1a0e-482b-b538-0d412f18c4cc None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:42.517896 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67304e-1a0e-482b-b538-0d412f18c4cc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:42.518334 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67304e-1a0e-482b-b538-0d412f18c4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:42.626843 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8f67304e-1a0e-482b-b538-0d412f18c4cc None None] MFA Rules not processed for user `5a9e86876ed8467cb1fad623af5c8d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:42.628638 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8f67304e-1a0e-482b-b538-0d412f18c4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:42.722630 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:42.725444 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:42.758371 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc994c5f-8d06-436a-b251-ae5cf5651b92 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:42.780573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 682/1375] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:42.782120 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c54a8-5e22-4f0a-8485-91aa03d5bfbe None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:42.782501 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c54a8-5e22-4f0a-8485-91aa03d5bfbe None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:42.783248 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c54a8-5e22-4f0a-8485-91aa03d5bfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:42.857297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-bb0c54a8-5e22-4f0a-8485-91aa03d5bfbe None None] MFA Rules not processed for user `3ba64e65285945c7a04ff367364429ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:42.861564 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bb0c54a8-5e22-4f0a-8485-91aa03d5bfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:42.929898 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20623a65-f486-4586-a23c-e88799acd8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:42.930602 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20623a65-f486-4586-a23c-e88799acd8d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:42.930890 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20623a65-f486-4586-a23c-e88799acd8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:42.931176 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20623a65-f486-4586-a23c-e88799acd8d9 admin admin] PATH_INFO: `/v3/projects/26e3a5259e4c490f8941af0727bebaea/users/fab5e2cf834b4f61bf4b0a84f5c1b859/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:42.975504 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20623a65-f486-4586-a23c-e88799acd8d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e3a5259e4c490f8941af0727bebaea, user_id=fab5e2cf834b4f61bf4b0a84f5c1b859, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:42.977647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 683/1376] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:42.978906 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c54a8-5e22-4f0a-8485-91aa03d5bfbe None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:42.982130 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20623a65-f486-4586-a23c-e88799acd8d9 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:43.001143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c54a8-5e22-4f0a-8485-91aa03d5bfbe None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:43.016173 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed181b-d998-4715-ada0-4b1b83e6a6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:43.016960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed181b-d998-4715-ada0-4b1b83e6a6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:43.017848 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 694/1377] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:32:42 2022] PUT /identity/v3/projects/26e3a5259e4c490f8941af0727bebaea/users/fab5e2cf834b4f61bf4b0a84f5c1b859/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:43.018799 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20623a65-f486-4586-a23c-e88799acd8d9 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:43.022383 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed181b-d998-4715-ada0-4b1b83e6a6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:43.022552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed181b-d998-4715-ada0-4b1b83e6a6f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:43.024505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed181b-d998-4715-ada0-4b1b83e6a6f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:43.028467 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-20623a65-f486-4586-a23c-e88799acd8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:43.030123 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed181b-d998-4715-ada0-4b1b83e6a6f5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:43.122576 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 684/1378] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:32:42 2022] POST /identity/v3/users => generated 296 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:43.126327 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed181b-d998-4715-ada0-4b1b83e6a6f5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:43.151158 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed181b-d998-4715-ada0-4b1b83e6a6f5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:43.234120 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20623a65-f486-4586-a23c-e88799acd8d9 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:43.256407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad86da-a8a8-4841-8ac4-0eb6267a8b5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:43.257123 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad86da-a8a8-4841-8ac4-0eb6267a8b5a service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:43.257415 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad86da-a8a8-4841-8ac4-0eb6267a8b5a service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:43.257691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad86da-a8a8-4841-8ac4-0eb6267a8b5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:43.295724 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339299f5-faf1-44ac-9c7f-2205a465815a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:43.298009 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339299f5-faf1-44ac-9c7f-2205a465815a admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:43.301290 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339299f5-faf1-44ac-9c7f-2205a465815a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:43.301723 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339299f5-faf1-44ac-9c7f-2205a465815a admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:43.302690 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339299f5-faf1-44ac-9c7f-2205a465815a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:43.304745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339299f5-faf1-44ac-9c7f-2205a465815a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:43.386606 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad86da-a8a8-4841-8ac4-0eb6267a8b5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:43.388722 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad86da-a8a8-4841-8ac4-0eb6267a8b5a service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:43.397707 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 685/1379] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:32:43 2022] POST /identity/v3/projects => generated 355 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:43.398101 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339299f5-faf1-44ac-9c7f-2205a465815a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:43.421323 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 695/1380] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:43 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:32:43.428300 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f78e1-77c9-4e67-847e-746d8e51b689 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:43.428995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f78e1-77c9-4e67-847e-746d8e51b689 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:43.429448 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f78e1-77c9-4e67-847e-746d8e51b689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:43.526213 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e49f78e1-77c9-4e67-847e-746d8e51b689 None None] MFA Rules not processed for user `459bb7dfc62346c8b2081de02ccb12df`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:43.527464 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e49f78e1-77c9-4e67-847e-746d8e51b689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:43.547174 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:43.569825 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:43.597029 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339299f5-faf1-44ac-9c7f-2205a465815a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:43.638866 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedddf4d-1a36-4320-8462-ee151d09ad82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:43.639818 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedddf4d-1a36-4320-8462-ee151d09ad82 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:43.640306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedddf4d-1a36-4320-8462-ee151d09ad82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:43.643109 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedddf4d-1a36-4320-8462-ee151d09ad82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:43.644027 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedddf4d-1a36-4320-8462-ee151d09ad82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:43.646783 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedddf4d-1a36-4320-8462-ee151d09ad82 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:43.672717 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 686/1381] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:43.677342 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedddf4d-1a36-4320-8462-ee151d09ad82 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:43.706756 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedddf4d-1a36-4320-8462-ee151d09ad82 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:43.714980 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d48189-69bd-4c45-ad63-fa422a82664f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:43.715806 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d48189-69bd-4c45-ad63-fa422a82664f admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:43.716197 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d48189-69bd-4c45-ad63-fa422a82664f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:43.716577 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d48189-69bd-4c45-ad63-fa422a82664f admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:43.717958 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d48189-69bd-4c45-ad63-fa422a82664f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:43.719587 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d48189-69bd-4c45-ad63-fa422a82664f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:43.747948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 687/1382] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:43.747948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d48189-69bd-4c45-ad63-fa422a82664f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:43.772816 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d48189-69bd-4c45-ad63-fa422a82664f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:43.788808 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033b814-c94f-4c3a-9303-70d050a4ca26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:43.790179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033b814-c94f-4c3a-9303-70d050a4ca26 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:43.792354 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033b814-c94f-4c3a-9303-70d050a4ca26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:43.792763 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033b814-c94f-4c3a-9303-70d050a4ca26 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:43.793573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033b814-c94f-4c3a-9303-70d050a4ca26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:43.799177 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033b814-c94f-4c3a-9303-70d050a4ca26 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:43.838850 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 696/1383] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:43.839617 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f78e1-77c9-4e67-847e-746d8e51b689 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:43.860631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 688/1384] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:32:43 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:32:43.863405 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033b814-c94f-4c3a-9303-70d050a4ca26 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:43.877261 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f78e1-77c9-4e67-847e-746d8e51b689 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:43.891529 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e6c36-5259-4a32-8a27-db7fa3dd6e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:43.892227 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e6c36-5259-4a32-8a27-db7fa3dd6e1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:43.892511 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e6c36-5259-4a32-8a27-db7fa3dd6e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:43.892785 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e6c36-5259-4a32-8a27-db7fa3dd6e1f admin admin] PATH_INFO: `/v3/projects/26e3a5259e4c490f8941af0727bebaea/users/fab5e2cf834b4f61bf4b0a84f5c1b859/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:43.893826 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033b814-c94f-4c3a-9303-70d050a4ca26 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:43.896075 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e6c36-5259-4a32-8a27-db7fa3dd6e1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e3a5259e4c490f8941af0727bebaea, user_id=fab5e2cf834b4f61bf4b0a84f5c1b859, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:43.899804 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e6c36-5259-4a32-8a27-db7fa3dd6e1f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:43.906166 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083476f2-8c20-40a5-93a1-d5e5760d6ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:43.906909 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083476f2-8c20-40a5-93a1-d5e5760d6ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:43.907200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083476f2-8c20-40a5-93a1-d5e5760d6ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:43.907479 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083476f2-8c20-40a5-93a1-d5e5760d6ff8 admin admin] PATH_INFO: `/v3/projects/bc248c6a86d948e0b2301f56b3b705f8/users/7a86883850594f589341324872d886a3/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:43.932417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 697/1385] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:32:43 2022] PUT /identity/v3/projects/26e3a5259e4c490f8941af0727bebaea/users/fab5e2cf834b4f61bf4b0a84f5c1b859/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:43.933059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e6c36-5259-4a32-8a27-db7fa3dd6e1f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:43.948532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-750e6c36-5259-4a32-8a27-db7fa3dd6e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:43.953682 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083476f2-8c20-40a5-93a1-d5e5760d6ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc248c6a86d948e0b2301f56b3b705f8, user_id=7a86883850594f589341324872d886a3, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:43.956546 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083476f2-8c20-40a5-93a1-d5e5760d6ff8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:44.000802 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 689/1386] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:32:43 2022] PUT /identity/v3/projects/bc248c6a86d948e0b2301f56b3b705f8/users/7a86883850594f589341324872d886a3/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:44.003176 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083476f2-8c20-40a5-93a1-d5e5760d6ff8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:44.159500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e6c36-5259-4a32-8a27-db7fa3dd6e1f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:44.192418 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083476f2-8c20-40a5-93a1-d5e5760d6ff8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:44.209665 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697aed7-5ca5-4eb6-accf-9a192d24bc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:44.210321 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697aed7-5ca5-4eb6-accf-9a192d24bc19 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:44.210638 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697aed7-5ca5-4eb6-accf-9a192d24bc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:44.210915 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697aed7-5ca5-4eb6-accf-9a192d24bc19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:44.211585 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697aed7-5ca5-4eb6-accf-9a192d24bc19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:44.214021 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697aed7-5ca5-4eb6-accf-9a192d24bc19 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:44.249138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 690/1387] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:44.258972 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a5791-f187-461d-9733-9766700d0131 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:44.259281 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a5791-f187-461d-9733-9766700d0131 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:44.260022 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a5791-f187-461d-9733-9766700d0131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:44.357224 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-236a5791-f187-461d-9733-9766700d0131 None None] MFA Rules not processed for user `fab5e2cf834b4f61bf4b0a84f5c1b859`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:44.358502 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-236a5791-f187-461d-9733-9766700d0131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:44.408057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bf45b-00b6-499c-9fb6-dca1f4f21fb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:44.409973 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bf45b-00b6-499c-9fb6-dca1f4f21fb6 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:44.414605 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bf45b-00b6-499c-9fb6-dca1f4f21fb6 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:44.415144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bf45b-00b6-499c-9fb6-dca1f4f21fb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:44.494031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:44.561473 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bf45b-00b6-499c-9fb6-dca1f4f21fb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:44.567330 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bf45b-00b6-499c-9fb6-dca1f4f21fb6 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:44.598559 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 698/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:32:44.599749 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bf45b-00b6-499c-9fb6-dca1f4f21fb6 service nova] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:44.617350 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bf45b-00b6-499c-9fb6-dca1f4f21fb6 service nova] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:44.624066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f729ec6-9aa6-4fd3-93a4-9d80e7741229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:44.624738 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f729ec6-9aa6-4fd3-93a4-9d80e7741229 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:44.625027 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f729ec6-9aa6-4fd3-93a4-9d80e7741229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:44.625375 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f729ec6-9aa6-4fd3-93a4-9d80e7741229 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:44.626241 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f729ec6-9aa6-4fd3-93a4-9d80e7741229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:44.627939 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f729ec6-9aa6-4fd3-93a4-9d80e7741229 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:44.649745 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 699/1389] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:44.653053 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c239a8b-a862-43e6-a4a4-91a4612926b3 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:44.653053 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c239a8b-a862-43e6-a4a4-91a4612926b3 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:44.653750 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c239a8b-a862-43e6-a4a4-91a4612926b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:44.708798 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 691/1390] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:44.726590 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a5791-f187-461d-9733-9766700d0131 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:44.742186 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3c239a8b-a862-43e6-a4a4-91a4612926b3 None None] MFA Rules not processed for user `d1c036fa4872485e903820d848089e02`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:44.743724 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3c239a8b-a862-43e6-a4a4-91a4612926b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:44.753421 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:44.767785 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a5791-f187-461d-9733-9766700d0131 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:44.818474 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0ccc8-d386-4864-913d-8e3b9f97b1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:44.822864 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0ccc8-d386-4864-913d-8e3b9f97b1c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:44.823156 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0ccc8-d386-4864-913d-8e3b9f97b1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:44.824776 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0ccc8-d386-4864-913d-8e3b9f97b1c7 admin admin] PATH_INFO: `/v3/projects/8c14af27cb5447c89e65afc8a4b413a5/users/32571937b876411a97e1f2cd9acdfe98/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:44.886901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0ccc8-d386-4864-913d-8e3b9f97b1c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c14af27cb5447c89e65afc8a4b413a5, user_id=32571937b876411a97e1f2cd9acdfe98, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:44.895530 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0ccc8-d386-4864-913d-8e3b9f97b1c7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:44.929629 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 692/1391] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:32:44 2022] PUT /identity/v3/projects/8c14af27cb5447c89e65afc8a4b413a5/users/32571937b876411a97e1f2cd9acdfe98/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:44.930616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0ccc8-d386-4864-913d-8e3b9f97b1c7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:44.977794 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 700/1392] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:44.982493 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c239a8b-a862-43e6-a4a4-91a4612926b3 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:44.987025 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3c239a8b-a862-43e6-a4a4-91a4612926b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:45.056015 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0ccc8-d386-4864-913d-8e3b9f97b1c7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:45.066482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a8823-5d1e-4e56-883a-7a690115fc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:45.069037 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a8823-5d1e-4e56-883a-7a690115fc86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:45.069578 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a8823-5d1e-4e56-883a-7a690115fc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:45.070059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a8823-5d1e-4e56-883a-7a690115fc86 admin admin] PATH_INFO: `/v3/projects/bc248c6a86d948e0b2301f56b3b705f8/users/7a86883850594f589341324872d886a3/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:45.082080 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a8823-5d1e-4e56-883a-7a690115fc86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc248c6a86d948e0b2301f56b3b705f8, user_id=7a86883850594f589341324872d886a3, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:45.096309 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a8823-5d1e-4e56-883a-7a690115fc86 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:45.120947 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 693/1393] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:32:44 2022] PUT /identity/v3/projects/bc248c6a86d948e0b2301f56b3b705f8/users/7a86883850594f589341324872d886a3/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:45.134054 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a8823-5d1e-4e56-883a-7a690115fc86 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:45.163025 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c239a8b-a862-43e6-a4a4-91a4612926b3 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:45.309533 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a193ac-ae1a-4e1c-b4e1-c15f43fd21fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:45.310266 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a193ac-ae1a-4e1c-b4e1-c15f43fd21fb service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:45.310544 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a193ac-ae1a-4e1c-b4e1-c15f43fd21fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:45.310889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a193ac-ae1a-4e1c-b4e1-c15f43fd21fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:45.355718 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a8823-5d1e-4e56-883a-7a690115fc86 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:45.372495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502522c7-e0d8-498f-8095-e7f8339a50bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:45.374178 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502522c7-e0d8-498f-8095-e7f8339a50bc admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:45.375036 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502522c7-e0d8-498f-8095-e7f8339a50bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:45.375036 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502522c7-e0d8-498f-8095-e7f8339a50bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:45.378314 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502522c7-e0d8-498f-8095-e7f8339a50bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:45.382492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502522c7-e0d8-498f-8095-e7f8339a50bc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:45.386884 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:45.410742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 694/1394] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:32:45.412660 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340640fc-cba4-4da3-9e72-4173815db097 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:45.412949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340640fc-cba4-4da3-9e72-4173815db097 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:45.413505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340640fc-cba4-4da3-9e72-4173815db097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:45.465328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-340640fc-cba4-4da3-9e72-4173815db097 None None] MFA Rules not processed for user `d1c036fa4872485e903820d848089e02`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:45.466935 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-340640fc-cba4-4da3-9e72-4173815db097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:45.495341 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a193ac-ae1a-4e1c-b4e1-c15f43fd21fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:45.497857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a193ac-ae1a-4e1c-b4e1-c15f43fd21fb service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:45.540282 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 701/1395] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:44 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:32:45.545593 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c2ed0-610a-4a19-bbad-651030d44914 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:45.546207 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c2ed0-610a-4a19-bbad-651030d44914 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:45.550032 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c2ed0-610a-4a19-bbad-651030d44914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:45.654234 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-201c2ed0-610a-4a19-bbad-651030d44914 None None] MFA Rules not processed for user `7a86883850594f589341324872d886a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:45.672892 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-201c2ed0-610a-4a19-bbad-651030d44914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:45.787772 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 695/1396] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:45.794450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340640fc-cba4-4da3-9e72-4173815db097 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:45.879378 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340640fc-cba4-4da3-9e72-4173815db097 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:45.895505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038fc59-21b7-4151-8007-695d7747b91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:45.899227 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038fc59-21b7-4151-8007-695d7747b91b admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:45.899491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038fc59-21b7-4151-8007-695d7747b91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:45.903635 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038fc59-21b7-4151-8007-695d7747b91b admin admin] PATH_INFO: `/v3/projects/8c14af27cb5447c89e65afc8a4b413a5/users/32571937b876411a97e1f2cd9acdfe98/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:45.907871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038fc59-21b7-4151-8007-695d7747b91b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c14af27cb5447c89e65afc8a4b413a5, user_id=32571937b876411a97e1f2cd9acdfe98, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:45.924215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038fc59-21b7-4151-8007-695d7747b91b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:45.949284 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:45.960082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 696/1397] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:32:45 2022] PUT /identity/v3/projects/8c14af27cb5447c89e65afc8a4b413a5/users/32571937b876411a97e1f2cd9acdfe98/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:45.972038 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038fc59-21b7-4151-8007-695d7747b91b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:46.030696 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 702/1398] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:46.031665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c2ed0-610a-4a19-bbad-651030d44914 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:46.135354 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038fc59-21b7-4151-8007-695d7747b91b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:46.156864 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83f360-01a9-4b6d-89c3-9f63e0c9e175 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:46.157546 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83f360-01a9-4b6d-89c3-9f63e0c9e175 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:46.157833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83f360-01a9-4b6d-89c3-9f63e0c9e175 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:46.158111 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83f360-01a9-4b6d-89c3-9f63e0c9e175 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:46.234530 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c2ed0-610a-4a19-bbad-651030d44914 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:46.319431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:46.363565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83f360-01a9-4b6d-89c3-9f63e0c9e175 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:46.366715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83f360-01a9-4b6d-89c3-9f63e0c9e175 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:46.402843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b3e33-42a2-4aac-9a99-1ce26b981d5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:46.404543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 697/1399] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:32:46.405406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b3e33-42a2-4aac-9a99-1ce26b981d5a service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:46.405721 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b3e33-42a2-4aac-9a99-1ce26b981d5a service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:46.406990 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b3e33-42a2-4aac-9a99-1ce26b981d5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:46.409467 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977a1ea-3749-4817-8d1a-91963954632c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:46.409989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977a1ea-3749-4817-8d1a-91963954632c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:46.412144 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977a1ea-3749-4817-8d1a-91963954632c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:46.515785 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0977a1ea-3749-4817-8d1a-91963954632c None None] MFA Rules not processed for user `32571937b876411a97e1f2cd9acdfe98`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:46.519287 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0977a1ea-3749-4817-8d1a-91963954632c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:46.557775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b3e33-42a2-4aac-9a99-1ce26b981d5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:46.564594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b3e33-42a2-4aac-9a99-1ce26b981d5a service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:46.602344 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 703/1400] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:32:46.699582 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b3e33-42a2-4aac-9a99-1ce26b981d5a service nova] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:46.711581 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b3e33-42a2-4aac-9a99-1ce26b981d5a service nova] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:46.719549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 698/1401] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:46 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:46.735277 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69811714-28b1-47bb-a3df-5a5fcf339cb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:46.739264 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69811714-28b1-47bb-a3df-5a5fcf339cb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:46.739264 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69811714-28b1-47bb-a3df-5a5fcf339cb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:46.739264 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69811714-28b1-47bb-a3df-5a5fcf339cb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:46.814991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977a1ea-3749-4817-8d1a-91963954632c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:46.816517 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0977a1ea-3749-4817-8d1a-91963954632c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:46.852193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977a1ea-3749-4817-8d1a-91963954632c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:46.908052 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd828a70-7c2a-4b32-873c-5761f34e0a9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:46.908052 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd828a70-7c2a-4b32-873c-5761f34e0a9b service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:46.908052 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd828a70-7c2a-4b32-873c-5761f34e0a9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:46.908052 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd828a70-7c2a-4b32-873c-5761f34e0a9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:46.909718 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd828a70-7c2a-4b32-873c-5761f34e0a9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:46.909718 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd828a70-7c2a-4b32-873c-5761f34e0a9b service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:46.973643 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 699/1402] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:46 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:32:46.975905 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69811714-28b1-47bb-a3df-5a5fcf339cb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:46.980241 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69811714-28b1-47bb-a3df-5a5fcf339cb4 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:47.027877 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 704/1403] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:32:47.377383 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd828a70-7c2a-4b32-873c-5761f34e0a9b service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:47.401364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd828a70-7c2a-4b32-873c-5761f34e0a9b service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:47.408006 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44f238-ddc4-4a52-beb1-4ec23ac4f8cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:47.409558 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44f238-ddc4-4a52-beb1-4ec23ac4f8cd service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:47.410060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44f238-ddc4-4a52-beb1-4ec23ac4f8cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:47.410469 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44f238-ddc4-4a52-beb1-4ec23ac4f8cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:47.483259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:47.569576 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44f238-ddc4-4a52-beb1-4ec23ac4f8cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:47.574763 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44f238-ddc4-4a52-beb1-4ec23ac4f8cd service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:47.601610 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 700/1404] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:47 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:32:48.300665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325bb9e-4a3a-4c10-9367-39eab6900100 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:48.301240 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325bb9e-4a3a-4c10-9367-39eab6900100 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:48.301309 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325bb9e-4a3a-4c10-9367-39eab6900100 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:48.303120 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 705/1405] 10.222.0.18 () {54 vars in 912 bytes} [Mon Oct 31 12:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 12:32:48.312938 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94111a92-c0a1-411c-a93c-db6e415b3ae6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:48.313487 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94111a92-c0a1-411c-a93c-db6e415b3ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:48.313758 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94111a92-c0a1-411c-a93c-db6e415b3ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:48.439268 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-94111a92-c0a1-411c-a93c-db6e415b3ae6 None None] MFA Rules not processed for user `7179d21011064d5b91d0e35a51b8adae`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:48.440550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-94111a92-c0a1-411c-a93c-db6e415b3ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:48.473864 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa3eb4-4778-4f8a-852e-fc6fc4b275f4 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:48.474574 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa3eb4-4778-4f8a-852e-fc6fc4b275f4 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:48.476270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa3eb4-4778-4f8a-852e-fc6fc4b275f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:48.561964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-60aa3eb4-4778-4f8a-852e-fc6fc4b275f4 None None] MFA Rules not processed for user `495f60d6b5c74627b42e98bc867723c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:48.566031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-60aa3eb4-4778-4f8a-852e-fc6fc4b275f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:48.635087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 701/1406] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 31 12:32:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:48.719320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94111a92-c0a1-411c-a93c-db6e415b3ae6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:48.721005 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-94111a92-c0a1-411c-a93c-db6e415b3ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:48.736709 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94111a92-c0a1-411c-a93c-db6e415b3ae6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:48.754964 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5844b-fb6b-4244-9e43-de0434fdf339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:48.757893 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5844b-fb6b-4244-9e43-de0434fdf339 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:48.758394 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5844b-fb6b-4244-9e43-de0434fdf339 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:48.758844 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5844b-fb6b-4244-9e43-de0434fdf339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:48.763567 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 706/1407] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:48.767024 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11764e47-d76f-4933-aa79-6ac3d413724d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:48.767311 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11764e47-d76f-4933-aa79-6ac3d413724d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:48.767583 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11764e47-d76f-4933-aa79-6ac3d413724d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:48.789236 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5844b-fb6b-4244-9e43-de0434fdf339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:48.790708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5844b-fb6b-4244-9e43-de0434fdf339 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:48.812012 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 702/1408] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:32:48.830157 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:48.839407 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74117bfe-d06c-42ca-8cbd-c50cb0718295 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:48.840102 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74117bfe-d06c-42ca-8cbd-c50cb0718295 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:48.840507 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74117bfe-d06c-42ca-8cbd-c50cb0718295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:48.874167 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-74117bfe-d06c-42ca-8cbd-c50cb0718295 None None] MFA Rules not processed for user `459bb7dfc62346c8b2081de02ccb12df`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:48.877636 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-74117bfe-d06c-42ca-8cbd-c50cb0718295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:48.880352 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-11764e47-d76f-4933-aa79-6ac3d413724d None None] MFA Rules not processed for user `495f60d6b5c74627b42e98bc867723c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:48.888946 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-11764e47-d76f-4933-aa79-6ac3d413724d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:48.927744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 707/1409] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:48.928866 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11764e47-d76f-4933-aa79-6ac3d413724d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:48.972843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11764e47-d76f-4933-aa79-6ac3d413724d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:48.994801 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f4b8b-a5ab-4a12-8f56-5ad77955bb45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:48.995831 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f4b8b-a5ab-4a12-8f56-5ad77955bb45 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:48.996128 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f4b8b-a5ab-4a12-8f56-5ad77955bb45 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:48.996393 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f4b8b-a5ab-4a12-8f56-5ad77955bb45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:49.014356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f4b8b-a5ab-4a12-8f56-5ad77955bb45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:49.018769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f4b8b-a5ab-4a12-8f56-5ad77955bb45 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:49.032014 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 703/1410] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:49.059711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 708/1411] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:32:49.148141 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74117bfe-d06c-42ca-8cbd-c50cb0718295 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:49.163085 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74117bfe-d06c-42ca-8cbd-c50cb0718295 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:49.174467 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69737eb2-045c-4481-80ef-20ce67b96554 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:49.175260 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69737eb2-045c-4481-80ef-20ce67b96554 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:49.175681 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69737eb2-045c-4481-80ef-20ce67b96554 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:49.176094 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69737eb2-045c-4481-80ef-20ce67b96554 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:49.270860 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:49.299776 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69737eb2-045c-4481-80ef-20ce67b96554 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:49.301444 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69737eb2-045c-4481-80ef-20ce67b96554 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:49.326617 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 704/1412] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:32:49.836913 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee52e6-3ded-421f-9c61-dfb1b2fa9041 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:49.837493 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee52e6-3ded-421f-9c61-dfb1b2fa9041 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:49.837729 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee52e6-3ded-421f-9c61-dfb1b2fa9041 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:49.839788 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 709/1413] 10.222.0.18 () {54 vars in 912 bytes} [Mon Oct 31 12:32:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:32:49.849192 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc9c06-05cc-472b-8293-d2fdaf128a67 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:49.849743 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc9c06-05cc-472b-8293-d2fdaf128a67 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:49.850152 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc9c06-05cc-472b-8293-d2fdaf128a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:49.894271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3bbc9c06-05cc-472b-8293-d2fdaf128a67 None None] MFA Rules not processed for user `7179d21011064d5b91d0e35a51b8adae`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:49.895498 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3bbc9c06-05cc-472b-8293-d2fdaf128a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:49.915391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 705/1414] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 31 12:32:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:49.935163 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee52e6-3ded-421f-9c61-dfb1b2fa9041 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:49.936903 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a5ee52e6-3ded-421f-9c61-dfb1b2fa9041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:49.968147 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee52e6-3ded-421f-9c61-dfb1b2fa9041 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:49.980958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839f939-b107-4091-a0ed-1e128cb99c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:49.981619 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839f939-b107-4091-a0ed-1e128cb99c0f service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:49.981903 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839f939-b107-4091-a0ed-1e128cb99c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:49.982179 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839f939-b107-4091-a0ed-1e128cb99c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:50.005282 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839f939-b107-4091-a0ed-1e128cb99c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:50.006738 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839f939-b107-4091-a0ed-1e128cb99c0f service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:50.033997 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 710/1415] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:32:50.480793 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc9c06-05cc-472b-8293-d2fdaf128a67 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:50.484257 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3bbc9c06-05cc-472b-8293-d2fdaf128a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:50.718084 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc9c06-05cc-472b-8293-d2fdaf128a67 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:50.737323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a356d-d98a-4aee-bea2-d6493160032b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18c015b8317b4517911f69bef21a0573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:50.740505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a356d-d98a-4aee-bea2-d6493160032b service placement] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:50.740926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a356d-d98a-4aee-bea2-d6493160032b service placement] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:50.741391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a356d-d98a-4aee-bea2-d6493160032b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:50.764443 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-373a356d-d98a-4aee-bea2-d6493160032b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:50.817532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a356d-d98a-4aee-bea2-d6493160032b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:50.819262 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a356d-d98a-4aee-bea2-d6493160032b service placement] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:50.860916 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 706/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:32:51.405604 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07dd51-b31f-4e51-99a0-d5bbe04cb133 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:51.406868 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07dd51-b31f-4e51-99a0-d5bbe04cb133 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:51.407457 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07dd51-b31f-4e51-99a0-d5bbe04cb133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:51.491824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-1c07dd51-b31f-4e51-99a0-d5bbe04cb133 None None] MFA Rules not processed for user `d1c036fa4872485e903820d848089e02`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:51.502494 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1c07dd51-b31f-4e51-99a0-d5bbe04cb133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:51.544491 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 711/1417] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:52.493179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5262ad7-8576-4e37-91b7-9eecedc22858 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:52.493660 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5262ad7-8576-4e37-91b7-9eecedc22858 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:52.493861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5262ad7-8576-4e37-91b7-9eecedc22858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:52.575711 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f5262ad7-8576-4e37-91b7-9eecedc22858 None None] MFA Rules not processed for user `5a9e86876ed8467cb1fad623af5c8d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:52.580766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f5262ad7-8576-4e37-91b7-9eecedc22858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:52.741020 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 707/1418] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:55.397673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07dd51-b31f-4e51-99a0-d5bbe04cb133 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:55.480444 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07dd51-b31f-4e51-99a0-d5bbe04cb133 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:55.485988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac97402-8419-455d-9dfb-a5d8736b4b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:55.486961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac97402-8419-455d-9dfb-a5d8736b4b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:55.487438 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac97402-8419-455d-9dfb-a5d8736b4b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:55.487908 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac97402-8419-455d-9dfb-a5d8736b4b98 admin admin] PATH_INFO: `/v3/users/d3bc846ee10a4924bdac4659f6ef1e9d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:55.489395 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac97402-8419-455d-9dfb-a5d8736b4b98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3bc846ee10a4924bdac4659f6ef1e9d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:55.491563 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac97402-8419-455d-9dfb-a5d8736b4b98 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:55.570691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8ac97402-8419-455d-9dfb-a5d8736b4b98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3bc846ee10a4924bdac4659f6ef1e9d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:55.571634 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8ac97402-8419-455d-9dfb-a5d8736b4b98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3bc846ee10a4924bdac4659f6ef1e9d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:55.572989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8ac97402-8419-455d-9dfb-a5d8736b4b98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3bc846ee10a4924bdac4659f6ef1e9d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:55.583640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8ac97402-8419-455d-9dfb-a5d8736b4b98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3bc846ee10a4924bdac4659f6ef1e9d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:55.597706 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8ac97402-8419-455d-9dfb-a5d8736b4b98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3bc846ee10a4924bdac4659f6ef1e9d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:55.626998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 712/1419] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:32:55 2022] DELETE /identity/v3/users/d3bc846ee10a4924bdac4659f6ef1e9d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:55.631505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9becc-9a4a-4463-8f59-95dc6da929d8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:55.632001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9becc-9a4a-4463-8f59-95dc6da929d8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:55.632071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9becc-9a4a-4463-8f59-95dc6da929d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:55.720178 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-75d9becc-9a4a-4463-8f59-95dc6da929d8 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:55.722490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-75d9becc-9a4a-4463-8f59-95dc6da929d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:55.804380 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 708/1420] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:55.814847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac97402-8419-455d-9dfb-a5d8736b4b98 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:55.816229 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8ac97402-8419-455d-9dfb-a5d8736b4b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:55.878112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:55.891694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac97402-8419-455d-9dfb-a5d8736b4b98 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:55.914468 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f667cef-da41-445f-89c8-64f5fe5366f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:55.916435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f667cef-da41-445f-89c8-64f5fe5366f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:55.916823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f667cef-da41-445f-89c8-64f5fe5366f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:55.918194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f667cef-da41-445f-89c8-64f5fe5366f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:55.935162 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54eff0-5dce-45fb-9a21-7637e7c03c5f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:55.936824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54eff0-5dce-45fb-9a21-7637e7c03c5f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:55.937618 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54eff0-5dce-45fb-9a21-7637e7c03c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:55.962231 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f667cef-da41-445f-89c8-64f5fe5366f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:55.963974 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f667cef-da41-445f-89c8-64f5fe5366f1 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:56.047343 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:56.051528 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 713/1421] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:32:56.159043 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7d54eff0-5dce-45fb-9a21-7637e7c03c5f None None] MFA Rules not processed for user `912693f459f147a5a479ad01e2e8387a`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:56.162114 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7d54eff0-5dce-45fb-9a21-7637e7c03c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:56.387762 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 709/1422] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 31 12:32:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:56.595880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f667cef-da41-445f-89c8-64f5fe5366f1 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:56.597968 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9f667cef-da41-445f-89c8-64f5fe5366f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:56.630759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f667cef-da41-445f-89c8-64f5fe5366f1 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:56.655277 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739a627-37ec-4f08-bf5a-18e50e38118a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:56.657701 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739a627-37ec-4f08-bf5a-18e50e38118a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:56.658836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739a627-37ec-4f08-bf5a-18e50e38118a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:56.659275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739a627-37ec-4f08-bf5a-18e50e38118a admin admin] PATH_INFO: `/v3/users/dd72b803abfb4cdca437bb602025aa27` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:56.664660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739a627-37ec-4f08-bf5a-18e50e38118a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd72b803abfb4cdca437bb602025aa27)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:56.669608 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739a627-37ec-4f08-bf5a-18e50e38118a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:56.734718 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54eff0-5dce-45fb-9a21-7637e7c03c5f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:56.737321 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7d54eff0-5dce-45fb-9a21-7637e7c03c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:56.905763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9739a627-37ec-4f08-bf5a-18e50e38118a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd72b803abfb4cdca437bb602025aa27'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:56.909223 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9739a627-37ec-4f08-bf5a-18e50e38118a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd72b803abfb4cdca437bb602025aa27'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:56.910526 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9739a627-37ec-4f08-bf5a-18e50e38118a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd72b803abfb4cdca437bb602025aa27'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:56.949760 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9739a627-37ec-4f08-bf5a-18e50e38118a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd72b803abfb4cdca437bb602025aa27'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:56.983007 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9739a627-37ec-4f08-bf5a-18e50e38118a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd72b803abfb4cdca437bb602025aa27'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:32:57.038980 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 714/1423] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:32:56 2022] DELETE /identity/v3/users/dd72b803abfb4cdca437bb602025aa27 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:32:57.047887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea6f1f-f7ef-4a07-b9be-585d81aa9a7e None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:57.047887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea6f1f-f7ef-4a07-b9be-585d81aa9a7e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:57.047887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea6f1f-f7ef-4a07-b9be-585d81aa9a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:57.109751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-5fea6f1f-f7ef-4a07-b9be-585d81aa9a7e None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:57.110998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5fea6f1f-f7ef-4a07-b9be-585d81aa9a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:57.117074 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54eff0-5dce-45fb-9a21-7637e7c03c5f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:57.363907 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 715/1424] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:57.426532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ee6f7-6a2f-4b30-842f-d4184c6a0919 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188c4989dcfb4f99a04c3349e1a882d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:57.427175 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ee6f7-6a2f-4b30-842f-d4184c6a0919 service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:57.427456 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ee6f7-6a2f-4b30-842f-d4184c6a0919 service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:57.427794 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ee6f7-6a2f-4b30-842f-d4184c6a0919 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:57.439124 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9c1ee6f7-6a2f-4b30-842f-d4184c6a0919 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:57.461559 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:57.488745 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea6f1f-f7ef-4a07-b9be-585d81aa9a7e None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:57.492390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5fea6f1f-f7ef-4a07-b9be-585d81aa9a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:57.644163 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea6f1f-f7ef-4a07-b9be-585d81aa9a7e None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:57.654806 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ee6f7-6a2f-4b30-842f-d4184c6a0919 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:57.656577 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ee6f7-6a2f-4b30-842f-d4184c6a0919 service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:57.659994 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c0330-2e1e-49a0-ae44-be14175671ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:57.660628 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c0330-2e1e-49a0-ae44-be14175671ce service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:57.660909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c0330-2e1e-49a0-ae44-be14175671ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:57.661610 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c0330-2e1e-49a0-ae44-be14175671ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:57.686271 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c0330-2e1e-49a0-ae44-be14175671ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:57.687795 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c0330-2e1e-49a0-ae44-be14175671ce service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:57.688985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 710/1425] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 31 12:32:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 955 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 12:32:57.700043 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 716/1426] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:32:57.707346 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a750b07-8499-4aff-bfb9-f5361bca4471 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:57.708050 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a750b07-8499-4aff-bfb9-f5361bca4471 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:57.709158 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a750b07-8499-4aff-bfb9-f5361bca4471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:57.833880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3a750b07-8499-4aff-bfb9-f5361bca4471 None None] MFA Rules not processed for user `7179d21011064d5b91d0e35a51b8adae`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:32:57.840094 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3a750b07-8499-4aff-bfb9-f5361bca4471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:57.880224 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 711/1427] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Oct 31 12:32:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:32:57.900878 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c0330-2e1e-49a0-ae44-be14175671ce service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:32:57.902651 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-cc7c0330-2e1e-49a0-ae44-be14175671ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:32:57.914347 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:32:57.937863 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c0330-2e1e-49a0-ae44-be14175671ce service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:32:57.968447 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe716127-04be-46ed-be7a-404bad425564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:32:57.970979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe716127-04be-46ed-be7a-404bad425564 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:32:57.971311 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe716127-04be-46ed-be7a-404bad425564 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:32:57.972379 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe716127-04be-46ed-be7a-404bad425564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:32:58.007144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe716127-04be-46ed-be7a-404bad425564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:32:58.011410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe716127-04be-46ed-be7a-404bad425564 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:32:58.049443 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 717/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:32:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:00.605831 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a750b07-8499-4aff-bfb9-f5361bca4471 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:00.607682 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3a750b07-8499-4aff-bfb9-f5361bca4471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:00.637599 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a750b07-8499-4aff-bfb9-f5361bca4471 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:00.649867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fc09c-1a47-40aa-ae28-c8c8dad1fd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:00.650884 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fc09c-1a47-40aa-ae28-c8c8dad1fd3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:00.651372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fc09c-1a47-40aa-ae28-c8c8dad1fd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:00.651975 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fc09c-1a47-40aa-ae28-c8c8dad1fd3c admin admin] PATH_INFO: `/v3/projects/cef0e9c7c4324330b0a019a0f3855d87` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:00.657451 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fc09c-1a47-40aa-ae28-c8c8dad1fd3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cef0e9c7c4324330b0a019a0f3855d87)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:00.659368 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fc09c-1a47-40aa-ae28-c8c8dad1fd3c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:00.784269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-584fc09c-1a47-40aa-ae28-c8c8dad1fd3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cef0e9c7c4324330b0a019a0f3855d87', 'request_id': 'req-584fc09c-1a47-40aa-ae28-c8c8dad1fd3c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:00.802482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-584fc09c-1a47-40aa-ae28-c8c8dad1fd3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cef0e9c7c4324330b0a019a0f3855d87', 'request_id': 'req-584fc09c-1a47-40aa-ae28-c8c8dad1fd3c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:00.813195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-584fc09c-1a47-40aa-ae28-c8c8dad1fd3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cef0e9c7c4324330b0a019a0f3855d87', 'request_id': 'req-584fc09c-1a47-40aa-ae28-c8c8dad1fd3c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:00.833331 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-584fc09c-1a47-40aa-ae28-c8c8dad1fd3c admin admin] The token cache is being invalidate because project cef0e9c7c4324330b0a019a0f3855d87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:00.834172 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-584fc09c-1a47-40aa-ae28-c8c8dad1fd3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:00.835310 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-584fc09c-1a47-40aa-ae28-c8c8dad1fd3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:00.840040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 712/1429] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:00 2022] DELETE /identity/v3/projects/cef0e9c7c4324330b0a019a0f3855d87 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:00.844067 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe716127-04be-46ed-be7a-404bad425564 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:00.862150 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe716127-04be-46ed-be7a-404bad425564 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:01.028179 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d0240-5417-407d-8b67-efeedffa7242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:01.029155 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d0240-5417-407d-8b67-efeedffa7242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:01.030006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d0240-5417-407d-8b67-efeedffa7242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:01.030703 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d0240-5417-407d-8b67-efeedffa7242 admin admin] PATH_INFO: `/v3/users/7a86883850594f589341324872d886a3` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:01.033414 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d0240-5417-407d-8b67-efeedffa7242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a86883850594f589341324872d886a3)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:01.048439 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d0240-5417-407d-8b67-efeedffa7242 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:01.166628 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-459d0240-5417-407d-8b67-efeedffa7242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a86883850594f589341324872d886a3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:01.167930 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-459d0240-5417-407d-8b67-efeedffa7242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a86883850594f589341324872d886a3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:01.168768 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-459d0240-5417-407d-8b67-efeedffa7242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a86883850594f589341324872d886a3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:01.183170 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-459d0240-5417-407d-8b67-efeedffa7242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a86883850594f589341324872d886a3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:01.206029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-459d0240-5417-407d-8b67-efeedffa7242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a86883850594f589341324872d886a3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:01.239641 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 718/1430] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:00 2022] DELETE /identity/v3/users/7a86883850594f589341324872d886a3 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:01.351178 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fc09c-1a47-40aa-ae28-c8c8dad1fd3c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:01.352923 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-584fc09c-1a47-40aa-ae28-c8c8dad1fd3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:01.416343 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fc09c-1a47-40aa-ae28-c8c8dad1fd3c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:01.657132 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e0179-a2a3-4b7d-a6a6-3b5572d7e5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:01.658088 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e0179-a2a3-4b7d-a6a6-3b5572d7e5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:01.658603 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e0179-a2a3-4b7d-a6a6-3b5572d7e5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:01.659088 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e0179-a2a3-4b7d-a6a6-3b5572d7e5db admin admin] PATH_INFO: `/v3/projects/013c2a6c242c48f2b601d39284114f71` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:01.661075 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e0179-a2a3-4b7d-a6a6-3b5572d7e5db admin admin] RBAC: Authorizing `identity:delete_project(project_id=013c2a6c242c48f2b601d39284114f71)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:01.663575 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e0179-a2a3-4b7d-a6a6-3b5572d7e5db admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:01.779011 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:01.819591 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4d6e0179-a2a3-4b7d-a6a6-3b5572d7e5db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '013c2a6c242c48f2b601d39284114f71', 'request_id': 'req-4d6e0179-a2a3-4b7d-a6a6-3b5572d7e5db'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:01.838437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4d6e0179-a2a3-4b7d-a6a6-3b5572d7e5db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '013c2a6c242c48f2b601d39284114f71', 'request_id': 'req-4d6e0179-a2a3-4b7d-a6a6-3b5572d7e5db'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:01.847067 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4d6e0179-a2a3-4b7d-a6a6-3b5572d7e5db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '013c2a6c242c48f2b601d39284114f71', 'request_id': 'req-4d6e0179-a2a3-4b7d-a6a6-3b5572d7e5db'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:01.865333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4d6e0179-a2a3-4b7d-a6a6-3b5572d7e5db admin admin] The token cache is being invalidate because project 013c2a6c242c48f2b601d39284114f71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:01.865872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4d6e0179-a2a3-4b7d-a6a6-3b5572d7e5db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:01.867008 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4d6e0179-a2a3-4b7d-a6a6-3b5572d7e5db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:01.869740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 713/1431] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:01 2022] DELETE /identity/v3/projects/013c2a6c242c48f2b601d39284114f71 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:01.874039 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d0240-5417-407d-8b67-efeedffa7242 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:01.876359 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-459d0240-5417-407d-8b67-efeedffa7242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:01.924043 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d0240-5417-407d-8b67-efeedffa7242 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:02.097845 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9cb71-95b4-4a8e-b0a7-e82a64e46ce6 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:02.098314 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9cb71-95b4-4a8e-b0a7-e82a64e46ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:02.099239 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9cb71-95b4-4a8e-b0a7-e82a64e46ce6 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:02.101514 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 714/1432] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 31 12:33:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:33:02.154474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea49068-5456-4db1-8bce-8ab6ba6a7cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:02.156045 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea49068-5456-4db1-8bce-8ab6ba6a7cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:02.156889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea49068-5456-4db1-8bce-8ab6ba6a7cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:02.157590 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea49068-5456-4db1-8bce-8ab6ba6a7cab admin admin] PATH_INFO: `/v3/users/fab5e2cf834b4f61bf4b0a84f5c1b859` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:02.159096 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea49068-5456-4db1-8bce-8ab6ba6a7cab admin admin] RBAC: Authorizing `identity:delete_user(user_id=fab5e2cf834b4f61bf4b0a84f5c1b859)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:02.161504 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea49068-5456-4db1-8bce-8ab6ba6a7cab admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:02.184747 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:02.264546 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3ea49068-5456-4db1-8bce-8ab6ba6a7cab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fab5e2cf834b4f61bf4b0a84f5c1b859'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:02.265398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3ea49068-5456-4db1-8bce-8ab6ba6a7cab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fab5e2cf834b4f61bf4b0a84f5c1b859'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:02.266194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3ea49068-5456-4db1-8bce-8ab6ba6a7cab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fab5e2cf834b4f61bf4b0a84f5c1b859'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:02.279438 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3ea49068-5456-4db1-8bce-8ab6ba6a7cab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fab5e2cf834b4f61bf4b0a84f5c1b859'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:02.291139 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3ea49068-5456-4db1-8bce-8ab6ba6a7cab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fab5e2cf834b4f61bf4b0a84f5c1b859'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:02.421867 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 719/1433] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:01 2022] DELETE /identity/v3/users/fab5e2cf834b4f61bf4b0a84f5c1b859 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:02.463678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a1027-9e37-4972-b56d-5f9194d82aec None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:02.463989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a1027-9e37-4972-b56d-5f9194d82aec None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:02.464230 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a1027-9e37-4972-b56d-5f9194d82aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:02.516399 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8b2a1027-9e37-4972-b56d-5f9194d82aec None None] MFA Rules not processed for user `d93ce5759e0648a1934ff4d9c9d8fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:02.517931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8b2a1027-9e37-4972-b56d-5f9194d82aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:02.760674 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 715/1434] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 31 12:33:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:03.440218 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea49068-5456-4db1-8bce-8ab6ba6a7cab admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:03.445164 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3ea49068-5456-4db1-8bce-8ab6ba6a7cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:03.492690 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea49068-5456-4db1-8bce-8ab6ba6a7cab admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:03.519868 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3373271-c1c7-42b0-8f0b-c78818d68458 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:03.520836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3373271-c1c7-42b0-8f0b-c78818d68458 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:03.521325 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3373271-c1c7-42b0-8f0b-c78818d68458 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:03.521856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3373271-c1c7-42b0-8f0b-c78818d68458 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:03.569775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3373271-c1c7-42b0-8f0b-c78818d68458 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:03.572737 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3373271-c1c7-42b0-8f0b-c78818d68458 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:03.630606 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 720/1435] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:05.191254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a1027-9e37-4972-b56d-5f9194d82aec None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:05.193330 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8b2a1027-9e37-4972-b56d-5f9194d82aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:05.369708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a1027-9e37-4972-b56d-5f9194d82aec None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:05.392318 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff11e29-fffb-4ef0-a5a5-c7fcefab34ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:05.394584 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff11e29-fffb-4ef0-a5a5-c7fcefab34ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:05.395728 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff11e29-fffb-4ef0-a5a5-c7fcefab34ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:05.396572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff11e29-fffb-4ef0-a5a5-c7fcefab34ca admin admin] PATH_INFO: `/v3/projects/bc248c6a86d948e0b2301f56b3b705f8` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:05.401199 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff11e29-fffb-4ef0-a5a5-c7fcefab34ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc248c6a86d948e0b2301f56b3b705f8)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:05.408227 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff11e29-fffb-4ef0-a5a5-c7fcefab34ca admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:05.562335 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8ff11e29-fffb-4ef0-a5a5-c7fcefab34ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc248c6a86d948e0b2301f56b3b705f8', 'request_id': 'req-8ff11e29-fffb-4ef0-a5a5-c7fcefab34ca'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:05.567095 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:05.579105 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8ff11e29-fffb-4ef0-a5a5-c7fcefab34ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc248c6a86d948e0b2301f56b3b705f8', 'request_id': 'req-8ff11e29-fffb-4ef0-a5a5-c7fcefab34ca'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:05.596919 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8ff11e29-fffb-4ef0-a5a5-c7fcefab34ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc248c6a86d948e0b2301f56b3b705f8', 'request_id': 'req-8ff11e29-fffb-4ef0-a5a5-c7fcefab34ca'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:05.617691 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8ff11e29-fffb-4ef0-a5a5-c7fcefab34ca admin admin] The token cache is being invalidate because project bc248c6a86d948e0b2301f56b3b705f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:05.619583 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8ff11e29-fffb-4ef0-a5a5-c7fcefab34ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:05.620837 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8ff11e29-fffb-4ef0-a5a5-c7fcefab34ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:05.623243 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 716/1436] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:05 2022] DELETE /identity/v3/projects/bc248c6a86d948e0b2301f56b3b705f8 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:05.628039 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8e210-764a-452a-894d-8c2f5656d391 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:05.628548 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8e210-764a-452a-894d-8c2f5656d391 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:05.628642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8e210-764a-452a-894d-8c2f5656d391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:05.669022 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-99b8e210-764a-452a-894d-8c2f5656d391 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:05.670481 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-99b8e210-764a-452a-894d-8c2f5656d391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:05.845699 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 721/1437] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:05.846680 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819105e-1ce1-46d6-9d4f-b802d175d23d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:05.847001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819105e-1ce1-46d6-9d4f-b802d175d23d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:05.847285 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819105e-1ce1-46d6-9d4f-b802d175d23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:05.893748 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8819105e-1ce1-46d6-9d4f-b802d175d23d None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:05.895882 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8819105e-1ce1-46d6-9d4f-b802d175d23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:05.920043 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 717/1438] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:05.924516 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8e210-764a-452a-894d-8c2f5656d391 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:05.948394 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8e210-764a-452a-894d-8c2f5656d391 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:05.969038 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25381413-0bee-4a67-9fef-200cd2b9c8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:05.970203 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25381413-0bee-4a67-9fef-200cd2b9c8ed admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:05.970982 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25381413-0bee-4a67-9fef-200cd2b9c8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:05.971399 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25381413-0bee-4a67-9fef-200cd2b9c8ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:05.972567 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25381413-0bee-4a67-9fef-200cd2b9c8ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:33:05.973277 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25381413-0bee-4a67-9fef-200cd2b9c8ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:06.002807 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25381413-0bee-4a67-9fef-200cd2b9c8ed admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:06.040354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 722/1439] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:33:06.044992 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819105e-1ce1-46d6-9d4f-b802d175d23d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:06.059233 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819105e-1ce1-46d6-9d4f-b802d175d23d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:06.064081 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719067bc-8243-4af6-989b-1b166028632b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:06.064720 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719067bc-8243-4af6-989b-1b166028632b admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:06.065003 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719067bc-8243-4af6-989b-1b166028632b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:06.065354 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719067bc-8243-4af6-989b-1b166028632b admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:06.066007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719067bc-8243-4af6-989b-1b166028632b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:06.068620 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719067bc-8243-4af6-989b-1b166028632b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:06.114691 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 718/1440] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:06 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:06.119639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25381413-0bee-4a67-9fef-200cd2b9c8ed admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:06.139168 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25381413-0bee-4a67-9fef-200cd2b9c8ed admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:06.283623 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315ee7d-defa-47f9-9e77-52a17ed12cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:06.284317 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315ee7d-defa-47f9-9e77-52a17ed12cff admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:06.284731 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315ee7d-defa-47f9-9e77-52a17ed12cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:06.284979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315ee7d-defa-47f9-9e77-52a17ed12cff admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:06.285606 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315ee7d-defa-47f9-9e77-52a17ed12cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:06.293179 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315ee7d-defa-47f9-9e77-52a17ed12cff admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:06.327804 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:06.352063 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 723/1441] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:06 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:06.355566 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719067bc-8243-4af6-989b-1b166028632b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:06.388724 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b403d9-3c2c-419f-aa2c-4d82eaedc4ea None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:06.389247 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b403d9-3c2c-419f-aa2c-4d82eaedc4ea None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:06.389721 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b403d9-3c2c-419f-aa2c-4d82eaedc4ea None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:06.395401 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 724/1442] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 31 12:33:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:33:06.405064 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569c2ff-d78d-4a62-b9ed-5acb81cce538 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:06.405382 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569c2ff-d78d-4a62-b9ed-5acb81cce538 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:06.405661 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569c2ff-d78d-4a62-b9ed-5acb81cce538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:06.418599 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719067bc-8243-4af6-989b-1b166028632b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:06.444613 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be7ed7-b749-42e4-a631-7061b152b53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:06.445373 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be7ed7-b749-42e4-a631-7061b152b53e admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:06.445741 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be7ed7-b749-42e4-a631-7061b152b53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:06.446081 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be7ed7-b749-42e4-a631-7061b152b53e admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:06.447318 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be7ed7-b749-42e4-a631-7061b152b53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:06.448969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be7ed7-b749-42e4-a631-7061b152b53e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:06.452727 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e569c2ff-d78d-4a62-b9ed-5acb81cce538 None None] MFA Rules not processed for user `d93ce5759e0648a1934ff4d9c9d8fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:06.454308 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e569c2ff-d78d-4a62-b9ed-5acb81cce538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:06.474735 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 719/1443] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:06.479125 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be7ed7-b749-42e4-a631-7061b152b53e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:06.499780 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be7ed7-b749-42e4-a631-7061b152b53e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:06.514183 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccedac-cee2-4efd-b55c-464b1a8b9434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:06.514907 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccedac-cee2-4efd-b55c-464b1a8b9434 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:06.515263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccedac-cee2-4efd-b55c-464b1a8b9434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:06.515612 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccedac-cee2-4efd-b55c-464b1a8b9434 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:06.516339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccedac-cee2-4efd-b55c-464b1a8b9434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:06.518138 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccedac-cee2-4efd-b55c-464b1a8b9434 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:06.567139 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 720/1444] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:33:06.568362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccedac-cee2-4efd-b55c-464b1a8b9434 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:06.598347 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccedac-cee2-4efd-b55c-464b1a8b9434 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:06.618135 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cc452-0aa1-4e2e-9962-f079dac0cddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:06.626760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cc452-0aa1-4e2e-9962-f079dac0cddc admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:06.628709 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cc452-0aa1-4e2e-9962-f079dac0cddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:06.629729 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cc452-0aa1-4e2e-9962-f079dac0cddc admin admin] PATH_INFO: `/v3/projects/47ea953cf2204878a14bd2d66d8b58c5/users/51b53fd843584989b074313a8cea1d51/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:06.667793 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 725/1445] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 31 12:33:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:06.672525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cc452-0aa1-4e2e-9962-f079dac0cddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=47ea953cf2204878a14bd2d66d8b58c5, user_id=51b53fd843584989b074313a8cea1d51, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:06.682698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cc452-0aa1-4e2e-9962-f079dac0cddc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:06.731135 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b9afe-f644-4c0b-bb28-e6d4ca2239d9 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:06.731403 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b9afe-f644-4c0b-bb28-e6d4ca2239d9 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:06.731509 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 721/1446] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:06 2022] PUT /identity/v3/projects/47ea953cf2204878a14bd2d66d8b58c5/users/51b53fd843584989b074313a8cea1d51/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:06.731678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b9afe-f644-4c0b-bb28-e6d4ca2239d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:06.814032 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-2b5b9afe-f644-4c0b-bb28-e6d4ca2239d9 None None] MFA Rules not processed for user `51b53fd843584989b074313a8cea1d51`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:06.834939 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2b5b9afe-f644-4c0b-bb28-e6d4ca2239d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:06.999514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 726/1447] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:07.003174 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cc452-0aa1-4e2e-9962-f079dac0cddc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:07.138849 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cc452-0aa1-4e2e-9962-f079dac0cddc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:07.147664 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddbdc3-f0ea-4cb6-ab62-ed4a8a1674c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:07.149927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddbdc3-f0ea-4cb6-ab62-ed4a8a1674c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:07.150318 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddbdc3-f0ea-4cb6-ab62-ed4a8a1674c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:07.151478 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddbdc3-f0ea-4cb6-ab62-ed4a8a1674c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:07.153525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddbdc3-f0ea-4cb6-ab62-ed4a8a1674c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:07.156514 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddbdc3-f0ea-4cb6-ab62-ed4a8a1674c8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:07.245630 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b9afe-f644-4c0b-bb28-e6d4ca2239d9 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:07.247373 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2b5b9afe-f644-4c0b-bb28-e6d4ca2239d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:07.257733 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 722/1448] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:07 2022] POST /identity/v3/projects => generated 381 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:07.258640 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddbdc3-f0ea-4cb6-ab62-ed4a8a1674c8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:07.417242 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:07.443906 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddbdc3-f0ea-4cb6-ab62-ed4a8a1674c8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:07.473924 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60138d7-1f81-4628-8d51-4f667eec0e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:07.474912 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60138d7-1f81-4628-8d51-4f667eec0e01 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:07.475200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60138d7-1f81-4628-8d51-4f667eec0e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:07.475874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60138d7-1f81-4628-8d51-4f667eec0e01 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:07.477016 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60138d7-1f81-4628-8d51-4f667eec0e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:07.480059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60138d7-1f81-4628-8d51-4f667eec0e01 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:07.572713 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b9afe-f644-4c0b-bb28-e6d4ca2239d9 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:07.599162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:07.599472 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 723/1449] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:07 2022] POST /identity/v3/users => generated 297 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:07.606894 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60138d7-1f81-4628-8d51-4f667eec0e01 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:07.646636 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60138d7-1f81-4628-8d51-4f667eec0e01 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:07.666155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82b2f5-6203-4716-8fae-d79e6863031c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:07.667304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82b2f5-6203-4716-8fae-d79e6863031c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:07.668049 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82b2f5-6203-4716-8fae-d79e6863031c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:07.668510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82b2f5-6203-4716-8fae-d79e6863031c admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:07.671960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82b2f5-6203-4716-8fae-d79e6863031c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:07.676120 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82b2f5-6203-4716-8fae-d79e6863031c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:07.713144 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 724/1450] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:07.719196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82b2f5-6203-4716-8fae-d79e6863031c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:07.766129 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82b2f5-6203-4716-8fae-d79e6863031c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:07.776206 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54809ba9-c42e-4e3d-acaa-cad64b184c54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:07.776899 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54809ba9-c42e-4e3d-acaa-cad64b184c54 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:07.777139 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54809ba9-c42e-4e3d-acaa-cad64b184c54 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:07.778513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ea315-ffe4-4854-b38e-82324241e3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:07.780548 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ea315-ffe4-4854-b38e-82324241e3e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:07.780843 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ea315-ffe4-4854-b38e-82324241e3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:07.781139 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ea315-ffe4-4854-b38e-82324241e3e8 admin admin] PATH_INFO: `/v3/projects/535cd358d6794d3498a4147077591434/users/747cc8af092c47e79f48dd966a3d608d/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:07.785529 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54809ba9-c42e-4e3d-acaa-cad64b184c54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:07.802693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54809ba9-c42e-4e3d-acaa-cad64b184c54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:07.804410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54809ba9-c42e-4e3d-acaa-cad64b184c54 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:07.837099 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 727/1451] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:07.850425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ea315-ffe4-4854-b38e-82324241e3e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=535cd358d6794d3498a4147077591434, user_id=747cc8af092c47e79f48dd966a3d608d, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:07.861027 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ea315-ffe4-4854-b38e-82324241e3e8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:07.904660 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 725/1452] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:07 2022] PUT /identity/v3/projects/535cd358d6794d3498a4147077591434/users/747cc8af092c47e79f48dd966a3d608d/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:07.908454 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54809ba9-c42e-4e3d-acaa-cad64b184c54 service nova] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:07.926028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54809ba9-c42e-4e3d-acaa-cad64b184c54 service nova] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:07.958922 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ea315-ffe4-4854-b38e-82324241e3e8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:07.960892 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d14ea315-ffe4-4854-b38e-82324241e3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:08.127920 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e095e3-9b1b-4adb-ba9d-db000e0156b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:08.128710 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e095e3-9b1b-4adb-ba9d-db000e0156b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:08.129014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e095e3-9b1b-4adb-ba9d-db000e0156b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:08.129372 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e095e3-9b1b-4adb-ba9d-db000e0156b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:08.130066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e095e3-9b1b-4adb-ba9d-db000e0156b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:08.131962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e095e3-9b1b-4adb-ba9d-db000e0156b5 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:08.146257 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 728/1453] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:33:08.154470 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e095e3-9b1b-4adb-ba9d-db000e0156b5 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:08.184167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e095e3-9b1b-4adb-ba9d-db000e0156b5 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:08.191599 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046edb97-d50a-4ba9-8796-f920babef350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:08.192630 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046edb97-d50a-4ba9-8796-f920babef350 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:08.193049 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046edb97-d50a-4ba9-8796-f920babef350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:08.193426 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046edb97-d50a-4ba9-8796-f920babef350 admin admin] PATH_INFO: `/v3/projects/535cd358d6794d3498a4147077591434/users/747cc8af092c47e79f48dd966a3d608d/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:08.195755 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046edb97-d50a-4ba9-8796-f920babef350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=535cd358d6794d3498a4147077591434, user_id=747cc8af092c47e79f48dd966a3d608d, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:08.195877 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ea315-ffe4-4854-b38e-82324241e3e8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:08.200503 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046edb97-d50a-4ba9-8796-f920babef350 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:08.203273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb5e55-12a1-41b2-a18b-56221f6314a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:08.203927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb5e55-12a1-41b2-a18b-56221f6314a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:08.204266 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb5e55-12a1-41b2-a18b-56221f6314a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:08.204542 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb5e55-12a1-41b2-a18b-56221f6314a1 admin admin] PATH_INFO: `/v3/users/95ecd3b749be4913a9bdec3bfde156ee` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:08.205752 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb5e55-12a1-41b2-a18b-56221f6314a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ecd3b749be4913a9bdec3bfde156ee)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:08.207774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb5e55-12a1-41b2-a18b-56221f6314a1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:08.247831 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 729/1454] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:08 2022] PUT /identity/v3/projects/535cd358d6794d3498a4147077591434/users/747cc8af092c47e79f48dd966a3d608d/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:08.254743 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d5a09-a634-4ff9-a743-98b134dfbdda None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:08.255120 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d5a09-a634-4ff9-a743-98b134dfbdda None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:08.255478 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d5a09-a634-4ff9-a743-98b134dfbdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:08.333031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-998d5a09-a634-4ff9-a743-98b134dfbdda None None] MFA Rules not processed for user `747cc8af092c47e79f48dd966a3d608d`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:08.336372 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-998d5a09-a634-4ff9-a743-98b134dfbdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:08.338534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-84eb5e55-12a1-41b2-a18b-56221f6314a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ecd3b749be4913a9bdec3bfde156ee'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:08.369830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-84eb5e55-12a1-41b2-a18b-56221f6314a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ecd3b749be4913a9bdec3bfde156ee'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:08.370717 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-84eb5e55-12a1-41b2-a18b-56221f6314a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ecd3b749be4913a9bdec3bfde156ee'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:08.415162 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-84eb5e55-12a1-41b2-a18b-56221f6314a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ecd3b749be4913a9bdec3bfde156ee'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:08.436675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-84eb5e55-12a1-41b2-a18b-56221f6314a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ecd3b749be4913a9bdec3bfde156ee'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:08.447636 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 726/1455] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:07 2022] DELETE /identity/v3/users/95ecd3b749be4913a9bdec3bfde156ee => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:33:08.449502 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff899ac-f6e4-4674-b7a0-0a099dfddc7a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:08.450009 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff899ac-f6e4-4674-b7a0-0a099dfddc7a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:08.450510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff899ac-f6e4-4674-b7a0-0a099dfddc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:08.472357 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fff899ac-f6e4-4674-b7a0-0a099dfddc7a None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:08.474089 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fff899ac-f6e4-4674-b7a0-0a099dfddc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:08.489724 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 730/1456] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:08.503113 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d5a09-a634-4ff9-a743-98b134dfbdda None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:08.505157 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-998d5a09-a634-4ff9-a743-98b134dfbdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:08.508977 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:08.517075 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:08.605532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 727/1457] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:08.612211 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d5a09-a634-4ff9-a743-98b134dfbdda None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:08.700966 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddc95f-54a0-4d1f-bd81-6f6df64f5481 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:08.702015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddc95f-54a0-4d1f-bd81-6f6df64f5481 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:08.702475 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddc95f-54a0-4d1f-bd81-6f6df64f5481 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:08.703023 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddc95f-54a0-4d1f-bd81-6f6df64f5481 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:08.851060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff899ac-f6e4-4674-b7a0-0a099dfddc7a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:08.852657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fff899ac-f6e4-4674-b7a0-0a099dfddc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:08.868951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddc95f-54a0-4d1f-bd81-6f6df64f5481 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:08.886830 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddc95f-54a0-4d1f-bd81-6f6df64f5481 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:08.924483 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 731/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:08 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:33:09.110028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff899ac-f6e4-4674-b7a0-0a099dfddc7a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:09.121332 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd694737-34ec-4e93-8f7c-51d4705f6cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:09.122559 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd694737-34ec-4e93-8f7c-51d4705f6cfd service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:09.123030 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd694737-34ec-4e93-8f7c-51d4705f6cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:09.123630 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd694737-34ec-4e93-8f7c-51d4705f6cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:09.145677 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd694737-34ec-4e93-8f7c-51d4705f6cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:09.149555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd694737-34ec-4e93-8f7c-51d4705f6cfd service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:09.167050 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 728/1459] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:09.246104 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddc95f-54a0-4d1f-bd81-6f6df64f5481 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:09.259122 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddc95f-54a0-4d1f-bd81-6f6df64f5481 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:09.283017 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710df3a2-403f-470c-97a0-6f42df268390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:09.283754 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710df3a2-403f-470c-97a0-6f42df268390 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:09.284109 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710df3a2-403f-470c-97a0-6f42df268390 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:09.284338 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710df3a2-403f-470c-97a0-6f42df268390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:09.293034 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-710df3a2-403f-470c-97a0-6f42df268390 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:09.462534 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710df3a2-403f-470c-97a0-6f42df268390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:09.464119 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710df3a2-403f-470c-97a0-6f42df268390 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:09.511785 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 732/1460] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:09.599890 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd694737-34ec-4e93-8f7c-51d4705f6cfd service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:09.601543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cd694737-34ec-4e93-8f7c-51d4705f6cfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:09.621410 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd694737-34ec-4e93-8f7c-51d4705f6cfd service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:09.647556 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f53d63-0ab2-4b4e-a4aa-a41ef499a848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:09.649207 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f53d63-0ab2-4b4e-a4aa-a41ef499a848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:09.650420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f53d63-0ab2-4b4e-a4aa-a41ef499a848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:09.651083 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f53d63-0ab2-4b4e-a4aa-a41ef499a848 admin admin] PATH_INFO: `/v3/users/3ba64e65285945c7a04ff367364429ed` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:09.652916 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f53d63-0ab2-4b4e-a4aa-a41ef499a848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba64e65285945c7a04ff367364429ed)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:09.655792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f53d63-0ab2-4b4e-a4aa-a41ef499a848 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:09.709389 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710df3a2-403f-470c-97a0-6f42df268390 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:09.712103 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-710df3a2-403f-470c-97a0-6f42df268390 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:09.745013 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710df3a2-403f-470c-97a0-6f42df268390 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:09.754994 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e92bc-dac1-40ef-9681-0cf411cf183c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:09.755711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e92bc-dac1-40ef-9681-0cf411cf183c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:09.756013 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e92bc-dac1-40ef-9681-0cf411cf183c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:09.756796 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e92bc-dac1-40ef-9681-0cf411cf183c admin admin] PATH_INFO: `/v3/projects/26e3a5259e4c490f8941af0727bebaea` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:09.759311 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e92bc-dac1-40ef-9681-0cf411cf183c admin admin] RBAC: Authorizing `identity:delete_project(project_id=26e3a5259e4c490f8941af0727bebaea)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:09.761502 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e92bc-dac1-40ef-9681-0cf411cf183c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:09.767686 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:09.859768 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6c7e92bc-dac1-40ef-9681-0cf411cf183c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26e3a5259e4c490f8941af0727bebaea', 'request_id': 'req-6c7e92bc-dac1-40ef-9681-0cf411cf183c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:09.883739 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6c7e92bc-dac1-40ef-9681-0cf411cf183c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26e3a5259e4c490f8941af0727bebaea', 'request_id': 'req-6c7e92bc-dac1-40ef-9681-0cf411cf183c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:09.885728 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-78f53d63-0ab2-4b4e-a4aa-a41ef499a848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba64e65285945c7a04ff367364429ed'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:09.895817 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6c7e92bc-dac1-40ef-9681-0cf411cf183c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26e3a5259e4c490f8941af0727bebaea', 'request_id': 'req-6c7e92bc-dac1-40ef-9681-0cf411cf183c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:09.898936 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-78f53d63-0ab2-4b4e-a4aa-a41ef499a848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba64e65285945c7a04ff367364429ed'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:09.900070 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-78f53d63-0ab2-4b4e-a4aa-a41ef499a848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba64e65285945c7a04ff367364429ed'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:09.913293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6c7e92bc-dac1-40ef-9681-0cf411cf183c admin admin] The token cache is being invalidate because project 26e3a5259e4c490f8941af0727bebaea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:09.914154 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6c7e92bc-dac1-40ef-9681-0cf411cf183c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:09.915402 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6c7e92bc-dac1-40ef-9681-0cf411cf183c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:09.918561 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 733/1461] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:09 2022] DELETE /identity/v3/projects/26e3a5259e4c490f8941af0727bebaea => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:09.924255 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-78f53d63-0ab2-4b4e-a4aa-a41ef499a848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba64e65285945c7a04ff367364429ed'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:09.925364 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888faaf6-1f84-4e2c-ab4c-de2523cc1668 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:09.925899 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888faaf6-1f84-4e2c-ab4c-de2523cc1668 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:09.927946 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888faaf6-1f84-4e2c-ab4c-de2523cc1668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:09.938923 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-78f53d63-0ab2-4b4e-a4aa-a41ef499a848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba64e65285945c7a04ff367364429ed'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:09.953241 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 729/1462] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:09 2022] DELETE /identity/v3/users/3ba64e65285945c7a04ff367364429ed => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:09.955622 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b23414-8065-4139-b810-7c638e31e7ee None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:09.955905 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-888faaf6-1f84-4e2c-ab4c-de2523cc1668 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:09.956358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b23414-8065-4139-b810-7c638e31e7ee None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:09.957349 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b23414-8065-4139-b810-7c638e31e7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:09.957733 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-888faaf6-1f84-4e2c-ab4c-de2523cc1668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:09.984503 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b1b23414-8065-4139-b810-7c638e31e7ee None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:09.985776 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b1b23414-8065-4139-b810-7c638e31e7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:10.030883 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:10.079866 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 734/1463] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:10.087134 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ed3da-65aa-4288-8c26-3e2a34f86ac1 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:10.087466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ed3da-65aa-4288-8c26-3e2a34f86ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:10.087851 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ed3da-65aa-4288-8c26-3e2a34f86ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:10.118517 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 730/1464] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:10.129193 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d34ed3da-65aa-4288-8c26-3e2a34f86ac1 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:10.131421 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d34ed3da-65aa-4288-8c26-3e2a34f86ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:10.140537 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b23414-8065-4139-b810-7c638e31e7ee None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:10.142750 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b1b23414-8065-4139-b810-7c638e31e7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:10.143892 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 735/1465] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:10.148398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ed3da-65aa-4288-8c26-3e2a34f86ac1 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:10.166837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ed3da-65aa-4288-8c26-3e2a34f86ac1 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:10.185495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc81546-b4de-4c9f-9976-6b2a2b519cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:10.186944 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc81546-b4de-4c9f-9976-6b2a2b519cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:10.187735 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc81546-b4de-4c9f-9976-6b2a2b519cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:10.189210 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc81546-b4de-4c9f-9976-6b2a2b519cb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:10.192752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc81546-b4de-4c9f-9976-6b2a2b519cb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:33:10.193261 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc81546-b4de-4c9f-9976-6b2a2b519cb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:10.197853 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc81546-b4de-4c9f-9976-6b2a2b519cb6 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:10.235138 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 736/1466] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:33:10.235969 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc81546-b4de-4c9f-9976-6b2a2b519cb6 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:10.249564 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc81546-b4de-4c9f-9976-6b2a2b519cb6 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:10.259474 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b23414-8065-4139-b810-7c638e31e7ee None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:10.260447 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb50fb6-b86f-47a8-bbed-1ea0bbfee2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:10.261596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb50fb6-b86f-47a8-bbed-1ea0bbfee2a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:10.262749 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb50fb6-b86f-47a8-bbed-1ea0bbfee2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:10.263426 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb50fb6-b86f-47a8-bbed-1ea0bbfee2a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:10.264620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb50fb6-b86f-47a8-bbed-1ea0bbfee2a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:10.267483 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f07cd-d305-4b30-98af-0f9a357e294f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:10.270001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f07cd-d305-4b30-98af-0f9a357e294f service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:10.271008 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb50fb6-b86f-47a8-bbed-1ea0bbfee2a5 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:10.271197 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f07cd-d305-4b30-98af-0f9a357e294f service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:10.271553 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f07cd-d305-4b30-98af-0f9a357e294f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:10.291795 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f07cd-d305-4b30-98af-0f9a357e294f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:10.294373 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f07cd-d305-4b30-98af-0f9a357e294f service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:10.310389 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 731/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:10.313688 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 737/1468] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:10 2022] POST /identity/v3/projects => generated 387 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:10.318001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f07cd-d305-4b30-98af-0f9a357e294f service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:10.330799 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f07cd-d305-4b30-98af-0f9a357e294f service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:10.402687 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9771c9-a8c6-4041-a28e-e25c10eb866b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:10.403505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9771c9-a8c6-4041-a28e-e25c10eb866b admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:10.403918 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9771c9-a8c6-4041-a28e-e25c10eb866b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:10.404328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9771c9-a8c6-4041-a28e-e25c10eb866b admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:10.405167 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9771c9-a8c6-4041-a28e-e25c10eb866b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:10.408053 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9771c9-a8c6-4041-a28e-e25c10eb866b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:10.436913 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 732/1469] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:10 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:10.437740 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb50fb6-b86f-47a8-bbed-1ea0bbfee2a5 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:10.452491 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb50fb6-b86f-47a8-bbed-1ea0bbfee2a5 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:10.458757 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff03a52-628d-44c9-9da9-e4704798eb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:10.458962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff03a52-628d-44c9-9da9-e4704798eb26 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:10.459324 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff03a52-628d-44c9-9da9-e4704798eb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:10.460824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff03a52-628d-44c9-9da9-e4704798eb26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:10.460824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff03a52-628d-44c9-9da9-e4704798eb26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:10.462239 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff03a52-628d-44c9-9da9-e4704798eb26 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:10.482877 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 738/1470] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:33:10.488312 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9771c9-a8c6-4041-a28e-e25c10eb866b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:10.503821 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9771c9-a8c6-4041-a28e-e25c10eb866b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:10.510629 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93cf17-969b-49bc-94bb-d8b06761eda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:10.511271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93cf17-969b-49bc-94bb-d8b06761eda2 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:10.511714 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93cf17-969b-49bc-94bb-d8b06761eda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:10.512127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93cf17-969b-49bc-94bb-d8b06761eda2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:10.512856 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93cf17-969b-49bc-94bb-d8b06761eda2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:10.514499 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93cf17-969b-49bc-94bb-d8b06761eda2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:10.529310 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 733/1471] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:10.532502 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff03a52-628d-44c9-9da9-e4704798eb26 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:10.545432 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff03a52-628d-44c9-9da9-e4704798eb26 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:10.550443 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1012a-0202-4dc4-a8b1-5b1b0997c537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:10.551205 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1012a-0202-4dc4-a8b1-5b1b0997c537 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:10.551594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1012a-0202-4dc4-a8b1-5b1b0997c537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:10.551990 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1012a-0202-4dc4-a8b1-5b1b0997c537 admin admin] PATH_INFO: `/v3/projects/63239d7721d141779edf5952622b3b48/users/c804543d879f47ef8f999aedb7adf24e/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:10.575167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1012a-0202-4dc4-a8b1-5b1b0997c537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63239d7721d141779edf5952622b3b48, user_id=c804543d879f47ef8f999aedb7adf24e, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:10.578499 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1012a-0202-4dc4-a8b1-5b1b0997c537 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:10.601635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 739/1472] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:10 2022] PUT /identity/v3/projects/63239d7721d141779edf5952622b3b48/users/c804543d879f47ef8f999aedb7adf24e/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:10.611119 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d827a1-5d30-4a33-b32a-3c5ebe49ef6a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:10.611618 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d827a1-5d30-4a33-b32a-3c5ebe49ef6a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:10.611857 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d827a1-5d30-4a33-b32a-3c5ebe49ef6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:10.651067 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d4d827a1-5d30-4a33-b32a-3c5ebe49ef6a None None] MFA Rules not processed for user `c804543d879f47ef8f999aedb7adf24e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:10.653213 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d4d827a1-5d30-4a33-b32a-3c5ebe49ef6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:10.704190 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1012a-0202-4dc4-a8b1-5b1b0997c537 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:10.707959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b9b1012a-0202-4dc4-a8b1-5b1b0997c537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:10.751832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:10.753363 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:10.779722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 734/1473] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:10.784012 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d827a1-5d30-4a33-b32a-3c5ebe49ef6a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:10.838590 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1012a-0202-4dc4-a8b1-5b1b0997c537 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:10.844304 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9585721-448d-47e1-a79c-3572b38db25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:10.845056 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9585721-448d-47e1-a79c-3572b38db25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:10.845466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9585721-448d-47e1-a79c-3572b38db25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:10.845950 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9585721-448d-47e1-a79c-3572b38db25c admin admin] PATH_INFO: `/v3/projects/08053c3c1ffc4c69936f356f784493fe` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:10.847150 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9585721-448d-47e1-a79c-3572b38db25c admin admin] RBAC: Authorizing `identity:delete_project(project_id=08053c3c1ffc4c69936f356f784493fe)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:10.849224 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9585721-448d-47e1-a79c-3572b38db25c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:10.882162 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d827a1-5d30-4a33-b32a-3c5ebe49ef6a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:10.888798 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16835d0-8aac-46a8-9571-0afd0cfc35bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:10.889708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16835d0-8aac-46a8-9571-0afd0cfc35bb admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:10.890058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16835d0-8aac-46a8-9571-0afd0cfc35bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:10.890406 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16835d0-8aac-46a8-9571-0afd0cfc35bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:10.891231 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16835d0-8aac-46a8-9571-0afd0cfc35bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:10.893450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16835d0-8aac-46a8-9571-0afd0cfc35bb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:10.906367 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-f9585721-448d-47e1-a79c-3572b38db25c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08053c3c1ffc4c69936f356f784493fe', 'request_id': 'req-f9585721-448d-47e1-a79c-3572b38db25c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:10.914146 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-f9585721-448d-47e1-a79c-3572b38db25c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08053c3c1ffc4c69936f356f784493fe', 'request_id': 'req-f9585721-448d-47e1-a79c-3572b38db25c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:10.923241 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-f9585721-448d-47e1-a79c-3572b38db25c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08053c3c1ffc4c69936f356f784493fe', 'request_id': 'req-f9585721-448d-47e1-a79c-3572b38db25c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:10.933732 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 735/1474] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:10 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:33:10.934878 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16835d0-8aac-46a8-9571-0afd0cfc35bb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:10.936661 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e16835d0-8aac-46a8-9571-0afd0cfc35bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:10.949942 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-f9585721-448d-47e1-a79c-3572b38db25c admin admin] The token cache is being invalidate because project 08053c3c1ffc4c69936f356f784493fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:10.950443 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-f9585721-448d-47e1-a79c-3572b38db25c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:10.951450 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-f9585721-448d-47e1-a79c-3572b38db25c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:10.957061 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 740/1475] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:10 2022] DELETE /identity/v3/projects/08053c3c1ffc4c69936f356f784493fe => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:33:10.958306 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9585721-448d-47e1-a79c-3572b38db25c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:10.960878 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f9585721-448d-47e1-a79c-3572b38db25c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:11.013169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16835d0-8aac-46a8-9571-0afd0cfc35bb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:11.018597 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324730e-6987-46f9-8a4f-d1b6431613fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:11.019563 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324730e-6987-46f9-8a4f-d1b6431613fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:11.019910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324730e-6987-46f9-8a4f-d1b6431613fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:11.020282 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324730e-6987-46f9-8a4f-d1b6431613fb admin admin] PATH_INFO: `/v3/projects/ce90c4e10eec473280445253ba522726` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:11.022250 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324730e-6987-46f9-8a4f-d1b6431613fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce90c4e10eec473280445253ba522726)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:11.023954 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324730e-6987-46f9-8a4f-d1b6431613fb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:11.048896 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9585721-448d-47e1-a79c-3572b38db25c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:11.054226 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448bf72-afba-4b9d-a684-8b39c5159628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:11.054839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448bf72-afba-4b9d-a684-8b39c5159628 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:11.055125 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448bf72-afba-4b9d-a684-8b39c5159628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:11.056597 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448bf72-afba-4b9d-a684-8b39c5159628 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:11.057058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448bf72-afba-4b9d-a684-8b39c5159628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:11.059181 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448bf72-afba-4b9d-a684-8b39c5159628 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:11.091976 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 741/1476] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:10 2022] POST /identity/v3/users => generated 300 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:11.092958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448bf72-afba-4b9d-a684-8b39c5159628 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:11.094642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7448bf72-afba-4b9d-a684-8b39c5159628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:11.096725 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4324730e-6987-46f9-8a4f-d1b6431613fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce90c4e10eec473280445253ba522726', 'request_id': 'req-4324730e-6987-46f9-8a4f-d1b6431613fb'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:11.107597 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4324730e-6987-46f9-8a4f-d1b6431613fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce90c4e10eec473280445253ba522726', 'request_id': 'req-4324730e-6987-46f9-8a4f-d1b6431613fb'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:11.108851 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448bf72-afba-4b9d-a684-8b39c5159628 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:11.113914 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4324730e-6987-46f9-8a4f-d1b6431613fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce90c4e10eec473280445253ba522726', 'request_id': 'req-4324730e-6987-46f9-8a4f-d1b6431613fb'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:11.125972 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4324730e-6987-46f9-8a4f-d1b6431613fb admin admin] The token cache is being invalidate because project ce90c4e10eec473280445253ba522726 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:11.126260 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4324730e-6987-46f9-8a4f-d1b6431613fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:11.127059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4324730e-6987-46f9-8a4f-d1b6431613fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:11.128840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 736/1477] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:10 2022] DELETE /identity/v3/projects/ce90c4e10eec473280445253ba522726 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:11.129477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324730e-6987-46f9-8a4f-d1b6431613fb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:11.130788 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4324730e-6987-46f9-8a4f-d1b6431613fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:11.140468 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:11.145498 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:11.174376 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa4dec-a295-4aae-9381-3bfb36c217e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:11.175101 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa4dec-a295-4aae-9381-3bfb36c217e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:11.175383 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa4dec-a295-4aae-9381-3bfb36c217e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:11.175778 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa4dec-a295-4aae-9381-3bfb36c217e2 admin admin] PATH_INFO: `/v3/users/32571937b876411a97e1f2cd9acdfe98` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:11.176943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa4dec-a295-4aae-9381-3bfb36c217e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32571937b876411a97e1f2cd9acdfe98)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:11.178885 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa4dec-a295-4aae-9381-3bfb36c217e2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:11.199412 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324730e-6987-46f9-8a4f-d1b6431613fb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:11.204310 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58b178-b6c5-4aa8-8f3c-f08cbdc016e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:11.204997 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58b178-b6c5-4aa8-8f3c-f08cbdc016e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:11.205357 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58b178-b6c5-4aa8-8f3c-f08cbdc016e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:11.205646 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58b178-b6c5-4aa8-8f3c-f08cbdc016e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:11.206392 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58b178-b6c5-4aa8-8f3c-f08cbdc016e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:11.209023 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58b178-b6c5-4aa8-8f3c-f08cbdc016e0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:11.226924 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 737/1478] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:11.226924 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58b178-b6c5-4aa8-8f3c-f08cbdc016e0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:11.226924 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fa58b178-b6c5-4aa8-8f3c-f08cbdc016e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:11.241695 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-fafa4dec-a295-4aae-9381-3bfb36c217e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32571937b876411a97e1f2cd9acdfe98'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:11.242421 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-fafa4dec-a295-4aae-9381-3bfb36c217e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32571937b876411a97e1f2cd9acdfe98'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:11.243176 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-fafa4dec-a295-4aae-9381-3bfb36c217e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32571937b876411a97e1f2cd9acdfe98'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:11.254015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-fafa4dec-a295-4aae-9381-3bfb36c217e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32571937b876411a97e1f2cd9acdfe98'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:11.255900 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58b178-b6c5-4aa8-8f3c-f08cbdc016e0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:11.262847 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a86c2b-4457-42fa-9af7-4dd14bcd1c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:11.263533 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a86c2b-4457-42fa-9af7-4dd14bcd1c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:11.263994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a86c2b-4457-42fa-9af7-4dd14bcd1c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:11.264356 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a86c2b-4457-42fa-9af7-4dd14bcd1c54 admin admin] PATH_INFO: `/v3/users/6f69f19b59cb48a9a1d6708e825cf725` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:11.265641 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-fafa4dec-a295-4aae-9381-3bfb36c217e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32571937b876411a97e1f2cd9acdfe98'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:11.265949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a86c2b-4457-42fa-9af7-4dd14bcd1c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f69f19b59cb48a9a1d6708e825cf725)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:11.268649 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a86c2b-4457-42fa-9af7-4dd14bcd1c54 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:11.285738 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 742/1479] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:11 2022] DELETE /identity/v3/users/32571937b876411a97e1f2cd9acdfe98 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:11.295545 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa4dec-a295-4aae-9381-3bfb36c217e2 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:11.299372 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-fafa4dec-a295-4aae-9381-3bfb36c217e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:11.341855 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-13a86c2b-4457-42fa-9af7-4dd14bcd1c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f69f19b59cb48a9a1d6708e825cf725'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:11.352117 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-13a86c2b-4457-42fa-9af7-4dd14bcd1c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f69f19b59cb48a9a1d6708e825cf725'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:11.357313 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-13a86c2b-4457-42fa-9af7-4dd14bcd1c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f69f19b59cb48a9a1d6708e825cf725'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:11.389759 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-13a86c2b-4457-42fa-9af7-4dd14bcd1c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f69f19b59cb48a9a1d6708e825cf725'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:11.400871 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa4dec-a295-4aae-9381-3bfb36c217e2 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:11.410228 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-13a86c2b-4457-42fa-9af7-4dd14bcd1c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f69f19b59cb48a9a1d6708e825cf725'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:11.414892 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e8b2b-88df-449f-b4f8-3c90abfbd5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:11.416622 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e8b2b-88df-449f-b4f8-3c90abfbd5ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:11.417369 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e8b2b-88df-449f-b4f8-3c90abfbd5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:11.417754 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e8b2b-88df-449f-b4f8-3c90abfbd5ec admin admin] PATH_INFO: `/v3/projects/4f8cb53b62cf47908873183e7af4b55b/users/3ec6966eb6b44dd9bb994700004f559c/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:11.421512 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 738/1480] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:11 2022] DELETE /identity/v3/users/6f69f19b59cb48a9a1d6708e825cf725 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:11.464821 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e8b2b-88df-449f-b4f8-3c90abfbd5ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f8cb53b62cf47908873183e7af4b55b, user_id=3ec6966eb6b44dd9bb994700004f559c, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:11.467557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e8b2b-88df-449f-b4f8-3c90abfbd5ec admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:11.498374 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 743/1481] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:11 2022] PUT /identity/v3/projects/4f8cb53b62cf47908873183e7af4b55b/users/3ec6966eb6b44dd9bb994700004f559c/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:11.500005 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a86c2b-4457-42fa-9af7-4dd14bcd1c54 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:11.501909 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-13a86c2b-4457-42fa-9af7-4dd14bcd1c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:11.626509 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a86c2b-4457-42fa-9af7-4dd14bcd1c54 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:11.669528 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:11.715069 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f932da0-6ff5-4bf2-95c5-a11f9106efcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:11.715815 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f932da0-6ff5-4bf2-95c5-a11f9106efcb admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:11.716157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f932da0-6ff5-4bf2-95c5-a11f9106efcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:11.716501 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f932da0-6ff5-4bf2-95c5-a11f9106efcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:11.717328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f932da0-6ff5-4bf2-95c5-a11f9106efcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:11.719067 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f932da0-6ff5-4bf2-95c5-a11f9106efcb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:11.734326 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 739/1482] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:11.738978 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e8b2b-88df-449f-b4f8-3c90abfbd5ec admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:11.755921 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e8b2b-88df-449f-b4f8-3c90abfbd5ec admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:11.761406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883f20c-e771-4ffc-afc3-25845ad55f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:11.761967 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883f20c-e771-4ffc-afc3-25845ad55f8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:11.762238 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883f20c-e771-4ffc-afc3-25845ad55f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:11.762515 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883f20c-e771-4ffc-afc3-25845ad55f8e admin admin] PATH_INFO: `/v3/projects/4f8cb53b62cf47908873183e7af4b55b/users/3ec6966eb6b44dd9bb994700004f559c/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:11.764852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883f20c-e771-4ffc-afc3-25845ad55f8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f8cb53b62cf47908873183e7af4b55b, user_id=3ec6966eb6b44dd9bb994700004f559c, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:11.767577 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883f20c-e771-4ffc-afc3-25845ad55f8e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:11.781241 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 744/1483] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:11 2022] PUT /identity/v3/projects/4f8cb53b62cf47908873183e7af4b55b/users/3ec6966eb6b44dd9bb994700004f559c/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:11.794157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b882dc-fd20-4f2c-9196-01e217039051 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:11.794446 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b882dc-fd20-4f2c-9196-01e217039051 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:11.794726 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b882dc-fd20-4f2c-9196-01e217039051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:11.827754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c8b882dc-fd20-4f2c-9196-01e217039051 None None] MFA Rules not processed for user `3ec6966eb6b44dd9bb994700004f559c`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:11.829675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c8b882dc-fd20-4f2c-9196-01e217039051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:11.930835 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883f20c-e771-4ffc-afc3-25845ad55f8e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:11.934633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 740/1484] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:11.935962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9883f20c-e771-4ffc-afc3-25845ad55f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:11.949215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b882dc-fd20-4f2c-9196-01e217039051 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:11.950863 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c8b882dc-fd20-4f2c-9196-01e217039051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:11.988968 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:12.027293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b882dc-fd20-4f2c-9196-01e217039051 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:12.031504 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32d982-ed7b-43cb-94cb-95038a2997d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:12.032777 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32d982-ed7b-43cb-94cb-95038a2997d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:12.033178 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32d982-ed7b-43cb-94cb-95038a2997d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:12.033626 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32d982-ed7b-43cb-94cb-95038a2997d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:12.037533 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883f20c-e771-4ffc-afc3-25845ad55f8e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:12.043198 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819f7b7-b905-4d58-8169-4cea2ab69561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:12.043826 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819f7b7-b905-4d58-8169-4cea2ab69561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:12.044103 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819f7b7-b905-4d58-8169-4cea2ab69561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:12.044251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32d982-ed7b-43cb-94cb-95038a2997d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:12.044385 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819f7b7-b905-4d58-8169-4cea2ab69561 admin admin] PATH_INFO: `/v3/projects/94da5d9b6b1f4bbe8258e983dd3e2956` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:12.045533 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819f7b7-b905-4d58-8169-4cea2ab69561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94da5d9b6b1f4bbe8258e983dd3e2956)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:12.046034 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32d982-ed7b-43cb-94cb-95038a2997d7 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:12.048124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819f7b7-b905-4d58-8169-4cea2ab69561 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:12.056315 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 741/1485] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:11 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:12.057343 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32d982-ed7b-43cb-94cb-95038a2997d7 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:12.058750 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4b32d982-ed7b-43cb-94cb-95038a2997d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:12.077510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32d982-ed7b-43cb-94cb-95038a2997d7 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:12.084906 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95640bae-85f0-4f7c-9901-b1ec6251e0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:12.085831 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95640bae-85f0-4f7c-9901-b1ec6251e0d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:12.086366 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95640bae-85f0-4f7c-9901-b1ec6251e0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:12.086733 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95640bae-85f0-4f7c-9901-b1ec6251e0d5 admin admin] PATH_INFO: `/v3/projects/8c14af27cb5447c89e65afc8a4b413a5` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:12.088664 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95640bae-85f0-4f7c-9901-b1ec6251e0d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c14af27cb5447c89e65afc8a4b413a5)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:12.090672 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95640bae-85f0-4f7c-9901-b1ec6251e0d5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:12.153300 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7819f7b7-b905-4d58-8169-4cea2ab69561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94da5d9b6b1f4bbe8258e983dd3e2956', 'request_id': 'req-7819f7b7-b905-4d58-8169-4cea2ab69561'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:12.161766 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7819f7b7-b905-4d58-8169-4cea2ab69561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94da5d9b6b1f4bbe8258e983dd3e2956', 'request_id': 'req-7819f7b7-b905-4d58-8169-4cea2ab69561'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:12.170185 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7819f7b7-b905-4d58-8169-4cea2ab69561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94da5d9b6b1f4bbe8258e983dd3e2956', 'request_id': 'req-7819f7b7-b905-4d58-8169-4cea2ab69561'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:12.173377 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:12.191360 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-95640bae-85f0-4f7c-9901-b1ec6251e0d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c14af27cb5447c89e65afc8a4b413a5', 'request_id': 'req-95640bae-85f0-4f7c-9901-b1ec6251e0d5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:12.200971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7819f7b7-b905-4d58-8169-4cea2ab69561 admin admin] The token cache is being invalidate because project 94da5d9b6b1f4bbe8258e983dd3e2956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:12.204210 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7819f7b7-b905-4d58-8169-4cea2ab69561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:12.205177 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7819f7b7-b905-4d58-8169-4cea2ab69561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:12.207428 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 745/1486] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:11 2022] DELETE /identity/v3/projects/94da5d9b6b1f4bbe8258e983dd3e2956 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:12.210752 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-95640bae-85f0-4f7c-9901-b1ec6251e0d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c14af27cb5447c89e65afc8a4b413a5', 'request_id': 'req-95640bae-85f0-4f7c-9901-b1ec6251e0d5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:12.212975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4588ec-7d49-4df7-903d-938ddc2aa3db None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:12.213382 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4588ec-7d49-4df7-903d-938ddc2aa3db None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:12.213727 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4588ec-7d49-4df7-903d-938ddc2aa3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:12.218496 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-95640bae-85f0-4f7c-9901-b1ec6251e0d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c14af27cb5447c89e65afc8a4b413a5', 'request_id': 'req-95640bae-85f0-4f7c-9901-b1ec6251e0d5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:12.235720 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-95640bae-85f0-4f7c-9901-b1ec6251e0d5 admin admin] The token cache is being invalidate because project 8c14af27cb5447c89e65afc8a4b413a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:12.236102 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-95640bae-85f0-4f7c-9901-b1ec6251e0d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:12.237076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-95640bae-85f0-4f7c-9901-b1ec6251e0d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:12.239354 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 742/1487] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:12 2022] DELETE /identity/v3/projects/8c14af27cb5447c89e65afc8a4b413a5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:12.246605 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bc9d9-29dd-45c0-96dc-4826520bec01 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:12.246605 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bc9d9-29dd-45c0-96dc-4826520bec01 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:12.246605 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bc9d9-29dd-45c0-96dc-4826520bec01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:12.255623 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-5f4588ec-7d49-4df7-903d-938ddc2aa3db None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:12.257045 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5f4588ec-7d49-4df7-903d-938ddc2aa3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:12.284535 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-502bc9d9-29dd-45c0-96dc-4826520bec01 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:12.285881 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-502bc9d9-29dd-45c0-96dc-4826520bec01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:12.341384 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 746/1488] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:12.346292 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6886d4-e15e-4654-bbcd-ae7579a6871a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:12.346623 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6886d4-e15e-4654-bbcd-ae7579a6871a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:12.346846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6886d4-e15e-4654-bbcd-ae7579a6871a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:12.355091 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 743/1489] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:12.363740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ca9a4-daab-432a-961c-fc4c75f5da5e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:12.364248 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ca9a4-daab-432a-961c-fc4c75f5da5e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:12.364511 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ca9a4-daab-432a-961c-fc4c75f5da5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:12.367823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-6b6886d4-e15e-4654-bbcd-ae7579a6871a None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:12.369754 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6b6886d4-e15e-4654-bbcd-ae7579a6871a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:12.383732 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 747/1490] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:12.387734 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6886d4-e15e-4654-bbcd-ae7579a6871a None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:12.388660 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2f1ca9a4-daab-432a-961c-fc4c75f5da5e None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:12.389993 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2f1ca9a4-daab-432a-961c-fc4c75f5da5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:12.397336 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6886d4-e15e-4654-bbcd-ae7579a6871a None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:12.400652 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 744/1491] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:12.402368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbc390-3cdf-49ce-8600-cd19139010cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:12.403087 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbc390-3cdf-49ce-8600-cd19139010cd admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:12.403553 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbc390-3cdf-49ce-8600-cd19139010cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:12.403942 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbc390-3cdf-49ce-8600-cd19139010cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:12.404578 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ca9a4-daab-432a-961c-fc4c75f5da5e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:12.404778 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbc390-3cdf-49ce-8600-cd19139010cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:33:12.405226 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbc390-3cdf-49ce-8600-cd19139010cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:12.406996 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbc390-3cdf-49ce-8600-cd19139010cd admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:12.413903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ca9a4-daab-432a-961c-fc4c75f5da5e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:12.419271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cb81a-4e21-47a3-b55f-ac86abe4c8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:12.420048 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cb81a-4e21-47a3-b55f-ac86abe4c8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:12.420332 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cb81a-4e21-47a3-b55f-ac86abe4c8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:12.420670 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 748/1492] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:33:12.421433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cb81a-4e21-47a3-b55f-ac86abe4c8e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:12.423794 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cb81a-4e21-47a3-b55f-ac86abe4c8e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:33:12.424105 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cb81a-4e21-47a3-b55f-ac86abe4c8e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:12.424702 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbc390-3cdf-49ce-8600-cd19139010cd admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:12.426145 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cb81a-4e21-47a3-b55f-ac86abe4c8e4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:12.435458 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbc390-3cdf-49ce-8600-cd19139010cd admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:12.439997 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 745/1493] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:33:12.440894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbbea4-e8b6-4118-b635-c85e83bbcefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:12.441548 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbbea4-e8b6-4118-b635-c85e83bbcefd admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:12.441830 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbbea4-e8b6-4118-b635-c85e83bbcefd admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:12.442232 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbbea4-e8b6-4118-b635-c85e83bbcefd admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:12.443100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbbea4-e8b6-4118-b635-c85e83bbcefd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:12.444127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cb81a-4e21-47a3-b55f-ac86abe4c8e4 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:12.445031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbbea4-e8b6-4118-b635-c85e83bbcefd admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:12.455830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cb81a-4e21-47a3-b55f-ac86abe4c8e4 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:12.460786 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8d486-4f6a-4841-9cb0-51c4c7ad3f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:12.461579 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8d486-4f6a-4841-9cb0-51c4c7ad3f89 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:12.462037 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8d486-4f6a-4841-9cb0-51c4c7ad3f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:12.462353 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8d486-4f6a-4841-9cb0-51c4c7ad3f89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:12.462986 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba8d486-4f6a-4841-9cb0-51c4c7ad3f89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:12.465281 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba8d486-4f6a-4841-9cb0-51c4c7ad3f89 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:12.483721 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 749/1494] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:12 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:33:12.486166 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbbea4-e8b6-4118-b635-c85e83bbcefd admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:12.501279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 746/1495] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:12 2022] POST /identity/v3/projects => generated 363 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:12.501591 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:12.505560 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8d486-4f6a-4841-9cb0-51c4c7ad3f89 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:12.609363 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbbea4-e8b6-4118-b635-c85e83bbcefd admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:12.615231 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8f565-bca1-46c8-9012-1470a2c061d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:12.615446 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8d486-4f6a-4841-9cb0-51c4c7ad3f89 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:12.615858 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8f565-bca1-46c8-9012-1470a2c061d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:12.616135 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8f565-bca1-46c8-9012-1470a2c061d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:12.616554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8f565-bca1-46c8-9012-1470a2c061d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:12.617463 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8f565-bca1-46c8-9012-1470a2c061d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:12.619802 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8f565-bca1-46c8-9012-1470a2c061d9 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:12.621754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a45a10-68b6-434f-a875-099dadcff4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:12.622429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a45a10-68b6-434f-a875-099dadcff4ec admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:12.622759 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a45a10-68b6-434f-a875-099dadcff4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:12.623463 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a45a10-68b6-434f-a875-099dadcff4ec admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:12.624312 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a45a10-68b6-434f-a875-099dadcff4ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:12.627671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a45a10-68b6-434f-a875-099dadcff4ec admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:12.655068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 750/1496] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:12 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:12.656645 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8f565-bca1-46c8-9012-1470a2c061d9 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:12.660881 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d6f8f565-bca1-46c8-9012-1470a2c061d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:12.667861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 747/1497] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:12 2022] POST /identity/v3/users => generated 282 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:12.668919 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a45a10-68b6-434f-a875-099dadcff4ec admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:12.679604 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8f565-bca1-46c8-9012-1470a2c061d9 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:12.681842 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a45a10-68b6-434f-a875-099dadcff4ec admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:12.686590 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d711ed5-eed2-4a9d-9532-f51e8f7418f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:12.687717 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214aa32a-c4e3-4018-a967-15f5d6c212ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:12.687891 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214aa32a-c4e3-4018-a967-15f5d6c212ec admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:12.688234 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214aa32a-c4e3-4018-a967-15f5d6c212ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:12.688773 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d711ed5-eed2-4a9d-9532-f51e8f7418f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:12.689282 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214aa32a-c4e3-4018-a967-15f5d6c212ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:12.689873 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d711ed5-eed2-4a9d-9532-f51e8f7418f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:12.689985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214aa32a-c4e3-4018-a967-15f5d6c212ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:12.690551 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d711ed5-eed2-4a9d-9532-f51e8f7418f3 admin admin] PATH_INFO: `/v3/users/51b53fd843584989b074313a8cea1d51` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:12.691918 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d711ed5-eed2-4a9d-9532-f51e8f7418f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51b53fd843584989b074313a8cea1d51)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:12.692028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214aa32a-c4e3-4018-a967-15f5d6c212ec admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:12.695605 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d711ed5-eed2-4a9d-9532-f51e8f7418f3 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:12.705870 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 748/1498] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:12.706818 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214aa32a-c4e3-4018-a967-15f5d6c212ec admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:12.718524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214aa32a-c4e3-4018-a967-15f5d6c212ec admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:12.730589 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319bb80-3621-497d-a460-d9f44536222e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:12.731268 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319bb80-3621-497d-a460-d9f44536222e admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:12.731688 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319bb80-3621-497d-a460-d9f44536222e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:12.732045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319bb80-3621-497d-a460-d9f44536222e admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:12.732701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319bb80-3621-497d-a460-d9f44536222e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:12.735173 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319bb80-3621-497d-a460-d9f44536222e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:12.737833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:12.767048 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 749/1499] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:12.768542 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319bb80-3621-497d-a460-d9f44536222e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:12.791288 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319bb80-3621-497d-a460-d9f44536222e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:12.797049 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252ac34-b575-4bbd-926b-78be289d4f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:12.797820 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252ac34-b575-4bbd-926b-78be289d4f01 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:12.798106 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252ac34-b575-4bbd-926b-78be289d4f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:12.798382 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252ac34-b575-4bbd-926b-78be289d4f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:12.799955 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252ac34-b575-4bbd-926b-78be289d4f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:12.801745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252ac34-b575-4bbd-926b-78be289d4f01 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:12.812952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7d711ed5-eed2-4a9d-9532-f51e8f7418f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51b53fd843584989b074313a8cea1d51'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:12.814167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7d711ed5-eed2-4a9d-9532-f51e8f7418f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51b53fd843584989b074313a8cea1d51'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:12.815055 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 750/1500] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:12.815520 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7d711ed5-eed2-4a9d-9532-f51e8f7418f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51b53fd843584989b074313a8cea1d51'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:12.816067 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252ac34-b575-4bbd-926b-78be289d4f01 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:12.818296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e252ac34-b575-4bbd-926b-78be289d4f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:12.841033 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252ac34-b575-4bbd-926b-78be289d4f01 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:12.850149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d2a29-4929-4f8f-bfe5-ec6799be0b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:12.852119 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d2a29-4929-4f8f-bfe5-ec6799be0b14 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:12.852682 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d2a29-4929-4f8f-bfe5-ec6799be0b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:12.853935 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d2a29-4929-4f8f-bfe5-ec6799be0b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:12.854701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d2a29-4929-4f8f-bfe5-ec6799be0b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:12.854979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7d711ed5-eed2-4a9d-9532-f51e8f7418f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51b53fd843584989b074313a8cea1d51'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:12.856788 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d2a29-4929-4f8f-bfe5-ec6799be0b14 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:12.875426 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7d711ed5-eed2-4a9d-9532-f51e8f7418f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51b53fd843584989b074313a8cea1d51'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:12.882305 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 751/1501] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:12.883810 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d2a29-4929-4f8f-bfe5-ec6799be0b14 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:12.886365 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c12d2a29-4929-4f8f-bfe5-ec6799be0b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:12.904771 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d2a29-4929-4f8f-bfe5-ec6799be0b14 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:12.911469 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f3caa-859d-405d-969d-af6348e3fb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:12.912155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f3caa-859d-405d-969d-af6348e3fb4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:12.912516 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f3caa-859d-405d-969d-af6348e3fb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:12.912981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f3caa-859d-405d-969d-af6348e3fb4b admin admin] PATH_INFO: `/v3/projects/937e901075f0415b87229c806fdf221c/users/3f2f3130c12f46bc9839fe85defaac13/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:12.917910 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 751/1502] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:12 2022] DELETE /identity/v3/users/51b53fd843584989b074313a8cea1d51 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:12.923813 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d711ed5-eed2-4a9d-9532-f51e8f7418f3 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:12.933946 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f3caa-859d-405d-969d-af6348e3fb4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=937e901075f0415b87229c806fdf221c, user_id=3f2f3130c12f46bc9839fe85defaac13, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:12.937208 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f3caa-859d-405d-969d-af6348e3fb4b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:12.964819 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 752/1503] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:12 2022] PUT /identity/v3/projects/937e901075f0415b87229c806fdf221c/users/3f2f3130c12f46bc9839fe85defaac13/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:12.967910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bb937-32ef-4b00-8343-f4804ff3bc5a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:12.972086 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bb937-32ef-4b00-8343-f4804ff3bc5a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:12.972086 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bb937-32ef-4b00-8343-f4804ff3bc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:12.998462 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a23bb937-32ef-4b00-8343-f4804ff3bc5a None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:12.999899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a23bb937-32ef-4b00-8343-f4804ff3bc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:13.064897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d711ed5-eed2-4a9d-9532-f51e8f7418f3 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:13.088701 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:13.093691 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 753/1504] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:13.095262 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebafdc-35e7-48e7-957c-8bba407864b3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:13.095655 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebafdc-35e7-48e7-957c-8bba407864b3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:13.096195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebafdc-35e7-48e7-957c-8bba407864b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:13.130228 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3aebafdc-35e7-48e7-957c-8bba407864b3 None None] MFA Rules not processed for user `3f2f3130c12f46bc9839fe85defaac13`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:13.132083 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3aebafdc-35e7-48e7-957c-8bba407864b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:13.140102 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8180586-7c8e-42e4-96c7-dbfbe71ccb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:13.140808 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8180586-7c8e-42e4-96c7-dbfbe71ccb73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:13.141133 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8180586-7c8e-42e4-96c7-dbfbe71ccb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:13.141438 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8180586-7c8e-42e4-96c7-dbfbe71ccb73 admin admin] PATH_INFO: `/v3/projects/28bb175b25a842c3af06030ce86bf259/users/eb93a3e0b2974b4b9070b0c95ae3657c/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:13.162241 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8180586-7c8e-42e4-96c7-dbfbe71ccb73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28bb175b25a842c3af06030ce86bf259, user_id=eb93a3e0b2974b4b9070b0c95ae3657c, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:13.167187 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8180586-7c8e-42e4-96c7-dbfbe71ccb73 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:13.196423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 752/1505] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:12 2022] PUT /identity/v3/projects/28bb175b25a842c3af06030ce86bf259/users/eb93a3e0b2974b4b9070b0c95ae3657c/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:13.196423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8180586-7c8e-42e4-96c7-dbfbe71ccb73 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:13.196423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b8180586-7c8e-42e4-96c7-dbfbe71ccb73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:13.222098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 754/1506] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:13.225702 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebafdc-35e7-48e7-957c-8bba407864b3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:13.225702 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3aebafdc-35e7-48e7-957c-8bba407864b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:13.286338 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8180586-7c8e-42e4-96c7-dbfbe71ccb73 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:13.295679 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:13.296986 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c028ba-6887-46e6-a3f5-1d20a3e6324b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:13.298272 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c028ba-6887-46e6-a3f5-1d20a3e6324b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:13.298530 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c028ba-6887-46e6-a3f5-1d20a3e6324b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:13.298847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c028ba-6887-46e6-a3f5-1d20a3e6324b admin admin] PATH_INFO: `/v3/users/c804543d879f47ef8f999aedb7adf24e` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:13.300518 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c028ba-6887-46e6-a3f5-1d20a3e6324b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c804543d879f47ef8f999aedb7adf24e)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:13.302481 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c028ba-6887-46e6-a3f5-1d20a3e6324b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:13.325318 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebafdc-35e7-48e7-957c-8bba407864b3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:13.415983 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-17c028ba-6887-46e6-a3f5-1d20a3e6324b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c804543d879f47ef8f999aedb7adf24e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:13.417653 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-17c028ba-6887-46e6-a3f5-1d20a3e6324b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c804543d879f47ef8f999aedb7adf24e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:13.418517 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-17c028ba-6887-46e6-a3f5-1d20a3e6324b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c804543d879f47ef8f999aedb7adf24e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:13.428076 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-17c028ba-6887-46e6-a3f5-1d20a3e6324b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c804543d879f47ef8f999aedb7adf24e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:13.432162 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310c4c7-8842-418a-a7a5-1b8b3879490d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:13.433525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310c4c7-8842-418a-a7a5-1b8b3879490d service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:13.434020 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310c4c7-8842-418a-a7a5-1b8b3879490d service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:13.434340 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310c4c7-8842-418a-a7a5-1b8b3879490d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:13.436623 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c310c4c7-8842-418a-a7a5-1b8b3879490d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:13.439006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-17c028ba-6887-46e6-a3f5-1d20a3e6324b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c804543d879f47ef8f999aedb7adf24e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:13.451930 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310c4c7-8842-418a-a7a5-1b8b3879490d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:13.453495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310c4c7-8842-418a-a7a5-1b8b3879490d service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:13.465192 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 753/1507] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:13 2022] DELETE /identity/v3/users/c804543d879f47ef8f999aedb7adf24e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:13.468223 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 755/1508] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:13.469054 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310c4c7-8842-418a-a7a5-1b8b3879490d service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:13.469582 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27b210-843e-4a4b-827f-12750d52948a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:13.469902 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27b210-843e-4a4b-827f-12750d52948a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:13.470178 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27b210-843e-4a4b-827f-12750d52948a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:13.474449 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c310c4c7-8842-418a-a7a5-1b8b3879490d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:13.487791 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310c4c7-8842-418a-a7a5-1b8b3879490d service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:13.513451 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ac27b210-843e-4a4b-827f-12750d52948a None None] MFA Rules not processed for user `eb93a3e0b2974b4b9070b0c95ae3657c`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:13.514959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ac27b210-843e-4a4b-827f-12750d52948a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:13.533698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:13.566996 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594c0fe-eac4-4dd2-948e-a768b81d6c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:13.567631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594c0fe-eac4-4dd2-948e-a768b81d6c59 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:13.567914 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594c0fe-eac4-4dd2-948e-a768b81d6c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:13.568337 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594c0fe-eac4-4dd2-948e-a768b81d6c59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:13.568983 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594c0fe-eac4-4dd2-948e-a768b81d6c59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:13.571182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594c0fe-eac4-4dd2-948e-a768b81d6c59 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:13.616155 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 754/1509] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:13.616155 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac71716-61af-4047-abb3-7bf3a5e6033c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:13.616155 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac71716-61af-4047-abb3-7bf3a5e6033c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:13.616155 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac71716-61af-4047-abb3-7bf3a5e6033c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:13.636317 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 756/1510] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:13 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:13.636317 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594c0fe-eac4-4dd2-948e-a768b81d6c59 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:13.637346 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e594c0fe-eac4-4dd2-948e-a768b81d6c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:13.644384 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-7ac71716-61af-4047-abb3-7bf3a5e6033c None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:13.646070 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7ac71716-61af-4047-abb3-7bf3a5e6033c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:13.740914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 755/1511] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:13.742655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac71716-61af-4047-abb3-7bf3a5e6033c None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:13.753495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac71716-61af-4047-abb3-7bf3a5e6033c None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:13.759067 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f619ce-691d-4ee7-b207-76d4ef810698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:13.760224 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f619ce-691d-4ee7-b207-76d4ef810698 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:13.760507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f619ce-691d-4ee7-b207-76d4ef810698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:13.760783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f619ce-691d-4ee7-b207-76d4ef810698 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:13.761785 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f619ce-691d-4ee7-b207-76d4ef810698 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:13.764213 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f619ce-691d-4ee7-b207-76d4ef810698 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:13.767179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594c0fe-eac4-4dd2-948e-a768b81d6c59 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:13.773481 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e61699-5c6e-4fd1-ae88-3695a334b7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:13.774254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e61699-5c6e-4fd1-ae88-3695a334b7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:13.775639 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e61699-5c6e-4fd1-ae88-3695a334b7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:13.775639 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e61699-5c6e-4fd1-ae88-3695a334b7e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:13.776672 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e61699-5c6e-4fd1-ae88-3695a334b7e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:13.781831 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e61699-5c6e-4fd1-ae88-3695a334b7e6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:13.796766 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 756/1512] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:13 2022] POST /identity/v3/users => generated 295 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:13.800799 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f619ce-691d-4ee7-b207-76d4ef810698 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:13.800799 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f9f619ce-691d-4ee7-b207-76d4ef810698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:13.824053 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 757/1513] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:13 2022] POST /identity/v3/projects => generated 365 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:13.824053 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e61699-5c6e-4fd1-ae88-3695a334b7e6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:13.840145 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:13.887912 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f619ce-691d-4ee7-b207-76d4ef810698 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:13.914130 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e61699-5c6e-4fd1-ae88-3695a334b7e6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:13.921325 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57d8d8-8b32-4695-b4a9-6d6494c823b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:13.922054 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57d8d8-8b32-4695-b4a9-6d6494c823b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:13.922415 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57d8d8-8b32-4695-b4a9-6d6494c823b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:13.922800 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57d8d8-8b32-4695-b4a9-6d6494c823b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:13.923476 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57d8d8-8b32-4695-b4a9-6d6494c823b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:13.926448 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57d8d8-8b32-4695-b4a9-6d6494c823b6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:13.942291 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 758/1514] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:13.942291 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57d8d8-8b32-4695-b4a9-6d6494c823b6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:13.956184 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666efb0-598b-4152-a9f0-e4f9d3ed7a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:13.956618 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57d8d8-8b32-4695-b4a9-6d6494c823b6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:13.956984 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666efb0-598b-4152-a9f0-e4f9d3ed7a77 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:13.957320 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666efb0-598b-4152-a9f0-e4f9d3ed7a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:13.958099 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666efb0-598b-4152-a9f0-e4f9d3ed7a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:13.963077 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338eb188-8d86-4441-bc7f-5e7375ea3ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:13.963790 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338eb188-8d86-4441-bc7f-5e7375ea3ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:13.964078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338eb188-8d86-4441-bc7f-5e7375ea3ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:13.964399 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338eb188-8d86-4441-bc7f-5e7375ea3ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:13.965139 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338eb188-8d86-4441-bc7f-5e7375ea3ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:13.967835 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338eb188-8d86-4441-bc7f-5e7375ea3ff8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:13.968216 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:13.971495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666efb0-598b-4152-a9f0-e4f9d3ed7a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:13.973018 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666efb0-598b-4152-a9f0-e4f9d3ed7a77 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:13.987613 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 757/1515] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:13.988787 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666efb0-598b-4152-a9f0-e4f9d3ed7a77 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:14.001243 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666efb0-598b-4152-a9f0-e4f9d3ed7a77 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:14.006472 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35426cf3-6c3a-401a-bfdd-b823a4d9828e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:14.007152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35426cf3-6c3a-401a-bfdd-b823a4d9828e admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:14.007643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35426cf3-6c3a-401a-bfdd-b823a4d9828e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:14.007922 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35426cf3-6c3a-401a-bfdd-b823a4d9828e admin admin] PATH_INFO: `/v3/projects/734ed786b2a94d57bef2dbd70663503d/users/641ce3a822e5481ba12b7e0fceef0c56/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:14.015494 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 759/1516] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:13 2022] POST /identity/v3/users => generated 289 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:14.016723 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338eb188-8d86-4441-bc7f-5e7375ea3ff8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:14.028044 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35426cf3-6c3a-401a-bfdd-b823a4d9828e admin admin] RBAC: Authorizing `identity:create_grant(project_id=734ed786b2a94d57bef2dbd70663503d, user_id=641ce3a822e5481ba12b7e0fceef0c56, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:14.030435 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338eb188-8d86-4441-bc7f-5e7375ea3ff8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:14.030884 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35426cf3-6c3a-401a-bfdd-b823a4d9828e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:14.037651 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c16870-48c8-4635-a04e-1a432a1812e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:14.038161 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c16870-48c8-4635-a04e-1a432a1812e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:14.039051 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c16870-48c8-4635-a04e-1a432a1812e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:14.039378 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c16870-48c8-4635-a04e-1a432a1812e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:14.041348 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c16870-48c8-4635-a04e-1a432a1812e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:14.044816 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c16870-48c8-4635-a04e-1a432a1812e2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:14.079489 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 758/1517] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:13 2022] PUT /identity/v3/projects/734ed786b2a94d57bef2dbd70663503d/users/641ce3a822e5481ba12b7e0fceef0c56/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:14.084100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35426cf3-6c3a-401a-bfdd-b823a4d9828e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:14.095233 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 760/1518] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:14.096985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c16870-48c8-4635-a04e-1a432a1812e2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:14.113403 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c16870-48c8-4635-a04e-1a432a1812e2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:14.172106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35426cf3-6c3a-401a-bfdd-b823a4d9828e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:14.178452 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567060f-ac7d-482a-9e31-b382880bc645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:14.179069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567060f-ac7d-482a-9e31-b382880bc645 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:14.179344 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567060f-ac7d-482a-9e31-b382880bc645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:14.180215 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567060f-ac7d-482a-9e31-b382880bc645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:14.180335 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567060f-ac7d-482a-9e31-b382880bc645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:14.182149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567060f-ac7d-482a-9e31-b382880bc645 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:14.192036 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c71abd-7cfd-45fd-accd-838000ab0a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:14.192988 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c71abd-7cfd-45fd-accd-838000ab0a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:14.193310 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c71abd-7cfd-45fd-accd-838000ab0a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:14.193594 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c71abd-7cfd-45fd-accd-838000ab0a17 admin admin] PATH_INFO: `/v3/projects/9d60111f8d064bfa9936a19ec2a9de1f/users/7983b8a50e0648fc85385ed009cfde60/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:14.197084 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 759/1519] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:14.198667 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567060f-ac7d-482a-9e31-b382880bc645 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:14.211375 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c71abd-7cfd-45fd-accd-838000ab0a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d60111f8d064bfa9936a19ec2a9de1f, user_id=7983b8a50e0648fc85385ed009cfde60, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:14.212973 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567060f-ac7d-482a-9e31-b382880bc645 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:14.215877 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c71abd-7cfd-45fd-accd-838000ab0a17 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:14.217853 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b345fe7-2bf8-464b-acde-3ecd2e788583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:14.218675 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b345fe7-2bf8-464b-acde-3ecd2e788583 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:14.218955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b345fe7-2bf8-464b-acde-3ecd2e788583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:14.219234 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b345fe7-2bf8-464b-acde-3ecd2e788583 admin admin] PATH_INFO: `/v3/projects/734ed786b2a94d57bef2dbd70663503d/users/641ce3a822e5481ba12b7e0fceef0c56/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:14.221249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b345fe7-2bf8-464b-acde-3ecd2e788583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=734ed786b2a94d57bef2dbd70663503d, user_id=641ce3a822e5481ba12b7e0fceef0c56, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:14.224986 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b345fe7-2bf8-464b-acde-3ecd2e788583 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:14.236677 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 760/1520] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:14 2022] PUT /identity/v3/projects/734ed786b2a94d57bef2dbd70663503d/users/641ce3a822e5481ba12b7e0fceef0c56/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:33:14.237808 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 761/1521] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:14 2022] PUT /identity/v3/projects/9d60111f8d064bfa9936a19ec2a9de1f/users/7983b8a50e0648fc85385ed009cfde60/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:14.242224 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b345fe7-2bf8-464b-acde-3ecd2e788583 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:14.249804 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8037d-85fc-45bc-87f9-6127e194670f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:14.250092 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8037d-85fc-45bc-87f9-6127e194670f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:14.250415 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8037d-85fc-45bc-87f9-6127e194670f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:14.283011 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8ac8037d-85fc-45bc-87f9-6127e194670f None None] MFA Rules not processed for user `641ce3a822e5481ba12b7e0fceef0c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:14.284033 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8ac8037d-85fc-45bc-87f9-6127e194670f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:14.360774 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b345fe7-2bf8-464b-acde-3ecd2e788583 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:14.365872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7039cb-4284-44e7-99a4-d79bc9789eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:14.366575 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7039cb-4284-44e7-99a4-d79bc9789eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:14.366857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7039cb-4284-44e7-99a4-d79bc9789eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:14.367127 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7039cb-4284-44e7-99a4-d79bc9789eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:14.367782 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7039cb-4284-44e7-99a4-d79bc9789eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:14.369653 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7039cb-4284-44e7-99a4-d79bc9789eb3 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:14.371821 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:14.405885 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 762/1522] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:14.406456 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8037d-85fc-45bc-87f9-6127e194670f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:14.408137 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8ac8037d-85fc-45bc-87f9-6127e194670f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:14.412459 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 761/1523] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:33:14.416717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7039cb-4284-44e7-99a4-d79bc9789eb3 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:14.418562 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1b7039cb-4284-44e7-99a4-d79bc9789eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:14.426407 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8037d-85fc-45bc-87f9-6127e194670f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:14.432927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5702b-338c-4451-b1c7-034f326f7cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:14.433845 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5702b-338c-4451-b1c7-034f326f7cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:14.434198 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5702b-338c-4451-b1c7-034f326f7cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:14.434546 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5702b-338c-4451-b1c7-034f326f7cb6 admin admin] PATH_INFO: `/v3/projects/47ea953cf2204878a14bd2d66d8b58c5` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:14.435953 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5702b-338c-4451-b1c7-034f326f7cb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47ea953cf2204878a14bd2d66d8b58c5)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:14.438250 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5702b-338c-4451-b1c7-034f326f7cb6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:14.516337 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7039cb-4284-44e7-99a4-d79bc9789eb3 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:14.522400 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-65b5702b-338c-4451-b1c7-034f326f7cb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47ea953cf2204878a14bd2d66d8b58c5', 'request_id': 'req-65b5702b-338c-4451-b1c7-034f326f7cb6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:14.531096 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:14.539896 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-65b5702b-338c-4451-b1c7-034f326f7cb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47ea953cf2204878a14bd2d66d8b58c5', 'request_id': 'req-65b5702b-338c-4451-b1c7-034f326f7cb6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:14.548568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-65b5702b-338c-4451-b1c7-034f326f7cb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47ea953cf2204878a14bd2d66d8b58c5', 'request_id': 'req-65b5702b-338c-4451-b1c7-034f326f7cb6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:14.563802 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-65b5702b-338c-4451-b1c7-034f326f7cb6 admin admin] The token cache is being invalidate because project 47ea953cf2204878a14bd2d66d8b58c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:14.564112 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-65b5702b-338c-4451-b1c7-034f326f7cb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:14.565215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-65b5702b-338c-4451-b1c7-034f326f7cb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:14.567089 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 763/1524] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:14 2022] DELETE /identity/v3/projects/47ea953cf2204878a14bd2d66d8b58c5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:14.568159 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5702b-338c-4451-b1c7-034f326f7cb6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:14.570030 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-65b5702b-338c-4451-b1c7-034f326f7cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:14.594551 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202b77c-130c-45cf-8926-01a3e7c3d796 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:14.595616 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202b77c-130c-45cf-8926-01a3e7c3d796 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:14.595898 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202b77c-130c-45cf-8926-01a3e7c3d796 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:14.596177 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202b77c-130c-45cf-8926-01a3e7c3d796 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:14.598083 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e202b77c-130c-45cf-8926-01a3e7c3d796 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:14.658843 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5702b-338c-4451-b1c7-034f326f7cb6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:14.666095 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d13b79-23a5-40f6-beae-696186e9fccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:14.667471 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d13b79-23a5-40f6-beae-696186e9fccb admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:14.667926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d13b79-23a5-40f6-beae-696186e9fccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:14.668564 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d13b79-23a5-40f6-beae-696186e9fccb admin admin] PATH_INFO: `/v3/projects/9d60111f8d064bfa9936a19ec2a9de1f/users/7983b8a50e0648fc85385ed009cfde60/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:14.671916 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d13b79-23a5-40f6-beae-696186e9fccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d60111f8d064bfa9936a19ec2a9de1f, user_id=7983b8a50e0648fc85385ed009cfde60, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:14.675213 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d13b79-23a5-40f6-beae-696186e9fccb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:14.684851 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202b77c-130c-45cf-8926-01a3e7c3d796 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:14.686525 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202b77c-130c-45cf-8926-01a3e7c3d796 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:14.698000 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 764/1525] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:14 2022] PUT /identity/v3/projects/9d60111f8d064bfa9936a19ec2a9de1f/users/7983b8a50e0648fc85385ed009cfde60/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:14.711356 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d13b79-23a5-40f6-beae-696186e9fccb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:14.719759 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-82d13b79-23a5-40f6-beae-696186e9fccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:14.745628 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 762/1526] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:14.763041 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ddac2-b05c-411b-95e7-4ff57ef81209 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:14.765303 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ddac2-b05c-411b-95e7-4ff57ef81209 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:14.765803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ddac2-b05c-411b-95e7-4ff57ef81209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:14.847771 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-437ddac2-b05c-411b-95e7-4ff57ef81209 None None] MFA Rules not processed for user `7983b8a50e0648fc85385ed009cfde60`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:14.849567 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-437ddac2-b05c-411b-95e7-4ff57ef81209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:14.912644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d13b79-23a5-40f6-beae-696186e9fccb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:14.918343 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e22753-8faa-465d-b05d-d0a2c2093734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:14.919295 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e22753-8faa-465d-b05d-d0a2c2093734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:14.919696 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e22753-8faa-465d-b05d-d0a2c2093734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:14.920041 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e22753-8faa-465d-b05d-d0a2c2093734 admin admin] PATH_INFO: `/v3/users/747cc8af092c47e79f48dd966a3d608d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:14.922326 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e22753-8faa-465d-b05d-d0a2c2093734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=747cc8af092c47e79f48dd966a3d608d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:14.924706 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e22753-8faa-465d-b05d-d0a2c2093734 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:14.927628 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:15.008944 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 763/1527] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:15.021096 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ddac2-b05c-411b-95e7-4ff57ef81209 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:15.024161 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-437ddac2-b05c-411b-95e7-4ff57ef81209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:15.050592 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c6e22753-8faa-465d-b05d-d0a2c2093734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '747cc8af092c47e79f48dd966a3d608d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:15.113661 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c6e22753-8faa-465d-b05d-d0a2c2093734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '747cc8af092c47e79f48dd966a3d608d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:15.114440 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c6e22753-8faa-465d-b05d-d0a2c2093734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '747cc8af092c47e79f48dd966a3d608d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:15.157415 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c6e22753-8faa-465d-b05d-d0a2c2093734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '747cc8af092c47e79f48dd966a3d608d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:15.176297 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:15.186876 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c6e22753-8faa-465d-b05d-d0a2c2093734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '747cc8af092c47e79f48dd966a3d608d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:15.195194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ddac2-b05c-411b-95e7-4ff57ef81209 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:15.213566 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 765/1528] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:14 2022] DELETE /identity/v3/users/747cc8af092c47e79f48dd966a3d608d => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:15.213904 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972270b-43df-4b64-887a-dc5edfcb0c61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:15.214809 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972270b-43df-4b64-887a-dc5edfcb0c61 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:15.216371 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972270b-43df-4b64-887a-dc5edfcb0c61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:15.216920 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e22753-8faa-465d-b05d-d0a2c2093734 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:15.217852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972270b-43df-4b64-887a-dc5edfcb0c61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:15.219165 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c6e22753-8faa-465d-b05d-d0a2c2093734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:15.224636 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e972270b-43df-4b64-887a-dc5edfcb0c61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:15.251279 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972270b-43df-4b64-887a-dc5edfcb0c61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:15.255539 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972270b-43df-4b64-887a-dc5edfcb0c61 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:15.282267 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 764/1529] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:33:15.358615 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e22753-8faa-465d-b05d-d0a2c2093734 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:15.364329 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf688ac-9bb5-496f-8620-9babb1ca87e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:15.365190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf688ac-9bb5-496f-8620-9babb1ca87e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:15.365592 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf688ac-9bb5-496f-8620-9babb1ca87e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:15.366030 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf688ac-9bb5-496f-8620-9babb1ca87e4 admin admin] PATH_INFO: `/v3/projects/63239d7721d141779edf5952622b3b48` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:15.369415 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf688ac-9bb5-496f-8620-9babb1ca87e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63239d7721d141779edf5952622b3b48)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:15.372665 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf688ac-9bb5-496f-8620-9babb1ca87e4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:15.440665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972270b-43df-4b64-887a-dc5edfcb0c61 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:15.442201 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e972270b-43df-4b64-887a-dc5edfcb0c61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:15.459193 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972270b-43df-4b64-887a-dc5edfcb0c61 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:15.485438 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ddf688ac-9bb5-496f-8620-9babb1ca87e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63239d7721d141779edf5952622b3b48', 'request_id': 'req-ddf688ac-9bb5-496f-8620-9babb1ca87e4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:15.502701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ddf688ac-9bb5-496f-8620-9babb1ca87e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63239d7721d141779edf5952622b3b48', 'request_id': 'req-ddf688ac-9bb5-496f-8620-9babb1ca87e4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:15.516657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ddf688ac-9bb5-496f-8620-9babb1ca87e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63239d7721d141779edf5952622b3b48', 'request_id': 'req-ddf688ac-9bb5-496f-8620-9babb1ca87e4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:15.550562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ddf688ac-9bb5-496f-8620-9babb1ca87e4 admin admin] The token cache is being invalidate because project 63239d7721d141779edf5952622b3b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:15.550859 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ddf688ac-9bb5-496f-8620-9babb1ca87e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:15.551531 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ddf688ac-9bb5-496f-8620-9babb1ca87e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:15.555031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87b16c-9468-4388-9965-fafa718c53ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:15.555715 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87b16c-9468-4388-9965-fafa718c53ee service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:15.555975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87b16c-9468-4388-9965-fafa718c53ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:15.556264 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87b16c-9468-4388-9965-fafa718c53ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:15.558452 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3a87b16c-9468-4388-9965-fafa718c53ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:15.561173 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 766/1530] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:15 2022] DELETE /identity/v3/projects/63239d7721d141779edf5952622b3b48 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:15.565589 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf688ac-9bb5-496f-8620-9babb1ca87e4 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:15.569693 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ddf688ac-9bb5-496f-8620-9babb1ca87e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:15.602679 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:15.647420 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87b16c-9468-4388-9965-fafa718c53ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:15.649413 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87b16c-9468-4388-9965-fafa718c53ee service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:15.663839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 765/1531] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:33:15.687371 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf688ac-9bb5-496f-8620-9babb1ca87e4 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:15.694215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4521a0-80f0-487a-9842-8c518c4e0516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:15.694959 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4521a0-80f0-487a-9842-8c518c4e0516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:15.695242 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4521a0-80f0-487a-9842-8c518c4e0516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:15.695741 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4521a0-80f0-487a-9842-8c518c4e0516 admin admin] PATH_INFO: `/v3/users/3ec6966eb6b44dd9bb994700004f559c` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:15.697627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4521a0-80f0-487a-9842-8c518c4e0516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ec6966eb6b44dd9bb994700004f559c)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:15.699868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4521a0-80f0-487a-9842-8c518c4e0516 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:15.779444 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9d4521a0-80f0-487a-9842-8c518c4e0516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ec6966eb6b44dd9bb994700004f559c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:15.790433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9d4521a0-80f0-487a-9842-8c518c4e0516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ec6966eb6b44dd9bb994700004f559c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:15.791183 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9d4521a0-80f0-487a-9842-8c518c4e0516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ec6966eb6b44dd9bb994700004f559c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:15.806787 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9d4521a0-80f0-487a-9842-8c518c4e0516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ec6966eb6b44dd9bb994700004f559c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:15.814681 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9d4521a0-80f0-487a-9842-8c518c4e0516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ec6966eb6b44dd9bb994700004f559c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:15.851707 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 767/1532] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:15 2022] DELETE /identity/v3/users/3ec6966eb6b44dd9bb994700004f559c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:16.329986 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87b16c-9468-4388-9965-fafa718c53ee service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:16.335434 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3a87b16c-9468-4388-9965-fafa718c53ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:16.361776 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87b16c-9468-4388-9965-fafa718c53ee service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:16.457506 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ebf68-b6f0-4ecc-9728-0899866e3fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:16.459029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ebf68-b6f0-4ecc-9728-0899866e3fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:16.459547 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ebf68-b6f0-4ecc-9728-0899866e3fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:16.460000 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ebf68-b6f0-4ecc-9728-0899866e3fd9 admin admin] PATH_INFO: `/v3/projects/535cd358d6794d3498a4147077591434` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:16.461525 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ebf68-b6f0-4ecc-9728-0899866e3fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=535cd358d6794d3498a4147077591434)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:16.464298 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ebf68-b6f0-4ecc-9728-0899866e3fd9 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:16.556795 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:16.562076 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-894ebf68-b6f0-4ecc-9728-0899866e3fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '535cd358d6794d3498a4147077591434', 'request_id': 'req-894ebf68-b6f0-4ecc-9728-0899866e3fd9'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:16.582094 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-894ebf68-b6f0-4ecc-9728-0899866e3fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '535cd358d6794d3498a4147077591434', 'request_id': 'req-894ebf68-b6f0-4ecc-9728-0899866e3fd9'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:16.590681 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-894ebf68-b6f0-4ecc-9728-0899866e3fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '535cd358d6794d3498a4147077591434', 'request_id': 'req-894ebf68-b6f0-4ecc-9728-0899866e3fd9'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:16.607940 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-894ebf68-b6f0-4ecc-9728-0899866e3fd9 admin admin] The token cache is being invalidate because project 535cd358d6794d3498a4147077591434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:16.608256 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-894ebf68-b6f0-4ecc-9728-0899866e3fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:16.608965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-894ebf68-b6f0-4ecc-9728-0899866e3fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:16.610943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 766/1533] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:16 2022] DELETE /identity/v3/projects/535cd358d6794d3498a4147077591434 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:16.615800 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26586eb9-55df-4f63-a410-04980cfb2f3f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:16.616095 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26586eb9-55df-4f63-a410-04980cfb2f3f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:16.616426 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26586eb9-55df-4f63-a410-04980cfb2f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:16.645339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-26586eb9-55df-4f63-a410-04980cfb2f3f None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:16.646466 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-26586eb9-55df-4f63-a410-04980cfb2f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:16.740859 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 768/1534] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:16.750083 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a5da7-ee4f-42d6-b4f9-817ebca632a4 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:16.750388 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a5da7-ee4f-42d6-b4f9-817ebca632a4 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:16.750651 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a5da7-ee4f-42d6-b4f9-817ebca632a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:16.784072 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-737a5da7-ee4f-42d6-b4f9-817ebca632a4 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:16.786064 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-737a5da7-ee4f-42d6-b4f9-817ebca632a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:16.824514 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26586eb9-55df-4f63-a410-04980cfb2f3f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:16.835038 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 767/1535] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:16.838634 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26586eb9-55df-4f63-a410-04980cfb2f3f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:16.846710 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841b2bd-9fbf-42b3-8405-a7dbaf8a46ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:16.848160 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841b2bd-9fbf-42b3-8405-a7dbaf8a46ca admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:16.848620 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841b2bd-9fbf-42b3-8405-a7dbaf8a46ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:16.848982 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841b2bd-9fbf-42b3-8405-a7dbaf8a46ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:16.849845 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841b2bd-9fbf-42b3-8405-a7dbaf8a46ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:33:16.850150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841b2bd-9fbf-42b3-8405-a7dbaf8a46ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:16.854076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841b2bd-9fbf-42b3-8405-a7dbaf8a46ca admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:16.886320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 769/1536] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:33:16.888457 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a5da7-ee4f-42d6-b4f9-817ebca632a4 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:16.901570 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a5da7-ee4f-42d6-b4f9-817ebca632a4 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:16.903242 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841b2bd-9fbf-42b3-8405-a7dbaf8a46ca admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:16.908766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8841b2bd-9fbf-42b3-8405-a7dbaf8a46ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:16.916714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e2822-3417-4a2c-9ddd-b140a868215f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:16.917939 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e2822-3417-4a2c-9ddd-b140a868215f admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:16.921951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e2822-3417-4a2c-9ddd-b140a868215f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:16.922299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e2822-3417-4a2c-9ddd-b140a868215f admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:16.922970 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e2822-3417-4a2c-9ddd-b140a868215f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:16.935805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e2822-3417-4a2c-9ddd-b140a868215f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:16.941274 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841b2bd-9fbf-42b3-8405-a7dbaf8a46ca admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:16.953018 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c543353-9bc7-44de-98f4-045370d7621c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:16.953715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c543353-9bc7-44de-98f4-045370d7621c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:16.953999 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c543353-9bc7-44de-98f4-045370d7621c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:16.954274 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c543353-9bc7-44de-98f4-045370d7621c admin admin] PATH_INFO: `/v3/projects/4f8cb53b62cf47908873183e7af4b55b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:16.955435 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c543353-9bc7-44de-98f4-045370d7621c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f8cb53b62cf47908873183e7af4b55b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:16.957369 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c543353-9bc7-44de-98f4-045370d7621c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:16.988887 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:17.010420 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 768/1537] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:16 2022] POST /identity/v3/projects => generated 389 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:17.012237 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e2822-3417-4a2c-9ddd-b140a868215f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:17.108651 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3c543353-9bc7-44de-98f4-045370d7621c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f8cb53b62cf47908873183e7af4b55b', 'request_id': 'req-3c543353-9bc7-44de-98f4-045370d7621c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:17.126338 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e2822-3417-4a2c-9ddd-b140a868215f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:17.133279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3c543353-9bc7-44de-98f4-045370d7621c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f8cb53b62cf47908873183e7af4b55b', 'request_id': 'req-3c543353-9bc7-44de-98f4-045370d7621c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:17.142919 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3c543353-9bc7-44de-98f4-045370d7621c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f8cb53b62cf47908873183e7af4b55b', 'request_id': 'req-3c543353-9bc7-44de-98f4-045370d7621c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:17.160930 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3c543353-9bc7-44de-98f4-045370d7621c admin admin] The token cache is being invalidate because project 4f8cb53b62cf47908873183e7af4b55b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:17.161265 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3c543353-9bc7-44de-98f4-045370d7621c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:17.162041 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3c543353-9bc7-44de-98f4-045370d7621c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:17.164229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 770/1538] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:16 2022] DELETE /identity/v3/projects/4f8cb53b62cf47908873183e7af4b55b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:17.181849 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374a364-2f17-4805-bb95-eafd0195ac6b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:17.182144 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374a364-2f17-4805-bb95-eafd0195ac6b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:17.182422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374a364-2f17-4805-bb95-eafd0195ac6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:17.209432 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4374a364-2f17-4805-bb95-eafd0195ac6b None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:17.211391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4374a364-2f17-4805-bb95-eafd0195ac6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:17.233692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb5c74-48fb-415e-a038-ccad92f7c063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:17.234468 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb5c74-48fb-415e-a038-ccad92f7c063 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:17.234750 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb5c74-48fb-415e-a038-ccad92f7c063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:17.235025 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb5c74-48fb-415e-a038-ccad92f7c063 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:17.235777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb5c74-48fb-415e-a038-ccad92f7c063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:17.238165 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb5c74-48fb-415e-a038-ccad92f7c063 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:17.270301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 769/1539] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:17 2022] POST /identity/v3/users => generated 295 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:33:17.273867 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb5c74-48fb-415e-a038-ccad92f7c063 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:17.276381 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c0bb5c74-48fb-415e-a038-ccad92f7c063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:17.289676 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb5c74-48fb-415e-a038-ccad92f7c063 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:17.296973 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7a0b7-aec4-443d-94ef-313a35b955cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:17.297765 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7a0b7-aec4-443d-94ef-313a35b955cc admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:17.298140 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7a0b7-aec4-443d-94ef-313a35b955cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:17.298551 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7a0b7-aec4-443d-94ef-313a35b955cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:17.299202 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7a0b7-aec4-443d-94ef-313a35b955cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:17.301067 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 771/1540] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:17.301201 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7a0b7-aec4-443d-94ef-313a35b955cc admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:17.310032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367823d6-cc4a-425d-b772-fa38e33c80d0 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:17.310323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367823d6-cc4a-425d-b772-fa38e33c80d0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:17.310598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367823d6-cc4a-425d-b772-fa38e33c80d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:17.318764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 770/1541] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:33:17.322651 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7a0b7-aec4-443d-94ef-313a35b955cc admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:17.336058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7a0b7-aec4-443d-94ef-313a35b955cc admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:17.342878 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3d901-93f2-4488-80aa-3db06a29b374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:17.343611 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3d901-93f2-4488-80aa-3db06a29b374 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:17.343892 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3d901-93f2-4488-80aa-3db06a29b374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:17.344297 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3d901-93f2-4488-80aa-3db06a29b374 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:17.344957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3d901-93f2-4488-80aa-3db06a29b374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:17.355266 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3d901-93f2-4488-80aa-3db06a29b374 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:17.355909 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-367823d6-cc4a-425d-b772-fa38e33c80d0 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:17.357818 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-367823d6-cc4a-425d-b772-fa38e33c80d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:17.367846 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 772/1542] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:17.370643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 771/1543] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:17.371854 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367823d6-cc4a-425d-b772-fa38e33c80d0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:17.372059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3d901-93f2-4488-80aa-3db06a29b374 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:17.382535 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3d901-93f2-4488-80aa-3db06a29b374 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:17.388630 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10703512-8fb8-4b71-83d9-032e79b5df51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:17.389482 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10703512-8fb8-4b71-83d9-032e79b5df51 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:17.389761 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10703512-8fb8-4b71-83d9-032e79b5df51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:17.390086 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367823d6-cc4a-425d-b772-fa38e33c80d0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:17.390693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10703512-8fb8-4b71-83d9-032e79b5df51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:17.391415 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10703512-8fb8-4b71-83d9-032e79b5df51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:33:17.391718 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10703512-8fb8-4b71-83d9-032e79b5df51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:17.393420 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10703512-8fb8-4b71-83d9-032e79b5df51 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:17.395947 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de327eb1-e528-4ee0-b00c-a08f1af7a935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:17.396789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de327eb1-e528-4ee0-b00c-a08f1af7a935 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:17.397075 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de327eb1-e528-4ee0-b00c-a08f1af7a935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:17.397375 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de327eb1-e528-4ee0-b00c-a08f1af7a935 admin admin] PATH_INFO: `/v3/projects/bd2d47373ef443caa64a8e51930cf572/users/0f876fa986c44fefb723f8bf760bdbce/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:17.410729 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 772/1544] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:33:17.414677 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de327eb1-e528-4ee0-b00c-a08f1af7a935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd2d47373ef443caa64a8e51930cf572, user_id=0f876fa986c44fefb723f8bf760bdbce, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:17.415553 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10703512-8fb8-4b71-83d9-032e79b5df51 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:17.417764 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de327eb1-e528-4ee0-b00c-a08f1af7a935 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:17.428089 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10703512-8fb8-4b71-83d9-032e79b5df51 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:17.434518 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:17.454515 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 773/1545] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:17 2022] PUT /identity/v3/projects/bd2d47373ef443caa64a8e51930cf572/users/0f876fa986c44fefb723f8bf760bdbce/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:17.464993 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc32c8-039e-4b2e-bf98-e3fcb08c9db1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:17.465174 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc32c8-039e-4b2e-bf98-e3fcb08c9db1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:17.465457 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc32c8-039e-4b2e-bf98-e3fcb08c9db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:17.494911 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3adc32c8-039e-4b2e-bf98-e3fcb08c9db1 None None] MFA Rules not processed for user `0f876fa986c44fefb723f8bf760bdbce`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:17.496172 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3adc32c8-039e-4b2e-bf98-e3fcb08c9db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:17.510755 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9baf637-9f3a-4590-8710-26cfdd3a8a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:17.511530 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baf637-9f3a-4590-8710-26cfdd3a8a52 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:17.511879 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baf637-9f3a-4590-8710-26cfdd3a8a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:17.512289 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baf637-9f3a-4590-8710-26cfdd3a8a52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:17.513153 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9baf637-9f3a-4590-8710-26cfdd3a8a52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:17.515821 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9baf637-9f3a-4590-8710-26cfdd3a8a52 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:17.555835 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 773/1546] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:17 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:17.560283 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9baf637-9f3a-4590-8710-26cfdd3a8a52 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:17.584429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:17.593664 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 774/1547] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:17.594413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc32c8-039e-4b2e-bf98-e3fcb08c9db1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:17.608453 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc32c8-039e-4b2e-bf98-e3fcb08c9db1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:17.647321 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9baf637-9f3a-4590-8710-26cfdd3a8a52 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:17.652892 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f246d-4c94-43ee-aac4-5b3e0af36bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:17.653527 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f246d-4c94-43ee-aac4-5b3e0af36bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:17.653807 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f246d-4c94-43ee-aac4-5b3e0af36bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:17.654074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f246d-4c94-43ee-aac4-5b3e0af36bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:17.654711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f246d-4c94-43ee-aac4-5b3e0af36bd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:17.656770 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f246d-4c94-43ee-aac4-5b3e0af36bd8 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:17.674714 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c33ad4-3044-4593-a8a8-1bbe91a452b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:17.675366 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c33ad4-3044-4593-a8a8-1bbe91a452b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:17.675664 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c33ad4-3044-4593-a8a8-1bbe91a452b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:17.675941 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c33ad4-3044-4593-a8a8-1bbe91a452b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:17.676588 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c33ad4-3044-4593-a8a8-1bbe91a452b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:17.678544 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c33ad4-3044-4593-a8a8-1bbe91a452b0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:17.681660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 774/1548] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:17 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:17.685337 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f246d-4c94-43ee-aac4-5b3e0af36bd8 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:17.695095 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f246d-4c94-43ee-aac4-5b3e0af36bd8 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:17.701759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb2b81-36eb-423b-99f6-baeb0323cd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:17.702400 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb2b81-36eb-423b-99f6-baeb0323cd58 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:17.702712 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb2b81-36eb-423b-99f6-baeb0323cd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:17.703031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb2b81-36eb-423b-99f6-baeb0323cd58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:17.703670 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb2b81-36eb-423b-99f6-baeb0323cd58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:17.705355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb2b81-36eb-423b-99f6-baeb0323cd58 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:17.714930 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 775/1549] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:17 2022] POST /identity/v3/projects => generated 389 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:17.716791 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c33ad4-3044-4593-a8a8-1bbe91a452b0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:17.720695 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 775/1550] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:33:17.724784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb2b81-36eb-423b-99f6-baeb0323cd58 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:17.736140 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb2b81-36eb-423b-99f6-baeb0323cd58 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:17.784291 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c33ad4-3044-4593-a8a8-1bbe91a452b0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:17.789193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ca7f2-74cc-4e41-b668-e344b5a886a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:17.789797 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ca7f2-74cc-4e41-b668-e344b5a886a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:17.790074 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ca7f2-74cc-4e41-b668-e344b5a886a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:17.790375 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ca7f2-74cc-4e41-b668-e344b5a886a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:17.791000 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ca7f2-74cc-4e41-b668-e344b5a886a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:17.792143 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a98fd-b930-4a95-8b53-05826b10308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:17.792754 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a98fd-b930-4a95-8b53-05826b10308b admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:17.792868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ca7f2-74cc-4e41-b668-e344b5a886a8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:17.793041 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a98fd-b930-4a95-8b53-05826b10308b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:17.793351 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a98fd-b930-4a95-8b53-05826b10308b admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:17.794001 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a98fd-b930-4a95-8b53-05826b10308b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:17.795580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a98fd-b930-4a95-8b53-05826b10308b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:17.805326 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 776/1551] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:33:17.810260 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a98fd-b930-4a95-8b53-05826b10308b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:17.818058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 776/1552] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:17 2022] POST /identity/v3/users => generated 301 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:17.819139 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ca7f2-74cc-4e41-b668-e344b5a886a8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:17.820465 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a98fd-b930-4a95-8b53-05826b10308b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:17.826416 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0533f4-2784-4858-ad97-91d19ca87261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:17.827162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0533f4-2784-4858-ad97-91d19ca87261 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:17.827704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0533f4-2784-4858-ad97-91d19ca87261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:17.828139 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0533f4-2784-4858-ad97-91d19ca87261 admin admin] PATH_INFO: `/v3/projects/196668eccf58421ebb1d54d07956cdac/users/f0126cedaa634f2786c122a082b72ab1/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:17.830519 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ca7f2-74cc-4e41-b668-e344b5a886a8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:17.830976 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:17.836247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4453c-fd57-4b57-9a8c-3aeeb4d08027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:17.836847 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4453c-fd57-4b57-9a8c-3aeeb4d08027 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:17.837156 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4453c-fd57-4b57-9a8c-3aeeb4d08027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:17.837432 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4453c-fd57-4b57-9a8c-3aeeb4d08027 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:17.838129 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4453c-fd57-4b57-9a8c-3aeeb4d08027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:17.839888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4453c-fd57-4b57-9a8c-3aeeb4d08027 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:17.845949 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0533f4-2784-4858-ad97-91d19ca87261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=196668eccf58421ebb1d54d07956cdac, user_id=f0126cedaa634f2786c122a082b72ab1, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:17.848504 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0533f4-2784-4858-ad97-91d19ca87261 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:17.851320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 777/1553] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:33:17.856074 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4453c-fd57-4b57-9a8c-3aeeb4d08027 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:17.865017 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 777/1554] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:17 2022] PUT /identity/v3/projects/196668eccf58421ebb1d54d07956cdac/users/f0126cedaa634f2786c122a082b72ab1/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:33:17.871591 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4453c-fd57-4b57-9a8c-3aeeb4d08027 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:17.875683 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012eab9-f333-4f83-a9bf-43352a003c79 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:17.876156 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012eab9-f333-4f83-a9bf-43352a003c79 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:17.876669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012eab9-f333-4f83-a9bf-43352a003c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:17.917788 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-0012eab9-f333-4f83-a9bf-43352a003c79 None None] MFA Rules not processed for user `f0126cedaa634f2786c122a082b72ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:17.919185 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0012eab9-f333-4f83-a9bf-43352a003c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:17.952065 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3619f17-8939-41ab-9969-74b197abba68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:17.952823 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3619f17-8939-41ab-9969-74b197abba68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:17.953203 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3619f17-8939-41ab-9969-74b197abba68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:17.953593 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3619f17-8939-41ab-9969-74b197abba68 admin admin] PATH_INFO: `/v3/projects/001df249a2fd46edbe4fc93e0991cbf9/users/3b24df7fc8ff4b488b5b7ad853715407/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:17.963434 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:17.974589 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3619f17-8939-41ab-9969-74b197abba68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=001df249a2fd46edbe4fc93e0991cbf9, user_id=3b24df7fc8ff4b488b5b7ad853715407, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:17.978948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3619f17-8939-41ab-9969-74b197abba68 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:17.996258 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 778/1555] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:17 2022] PUT /identity/v3/projects/001df249a2fd46edbe4fc93e0991cbf9/users/3b24df7fc8ff4b488b5b7ad853715407/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:33:18.000898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3619f17-8939-41ab-9969-74b197abba68 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:18.019042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 778/1556] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:18.027426 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012eab9-f333-4f83-a9bf-43352a003c79 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:18.029226 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0012eab9-f333-4f83-a9bf-43352a003c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:18.106708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3619f17-8939-41ab-9969-74b197abba68 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:18.111343 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659b2df-da45-4478-8b02-5112bd47fbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:18.111983 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659b2df-da45-4478-8b02-5112bd47fbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:18.112265 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659b2df-da45-4478-8b02-5112bd47fbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:18.112546 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659b2df-da45-4478-8b02-5112bd47fbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:18.113226 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659b2df-da45-4478-8b02-5112bd47fbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:18.114809 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659b2df-da45-4478-8b02-5112bd47fbe3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:18.117413 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012eab9-f333-4f83-a9bf-43352a003c79 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:18.125177 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 779/1557] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:18.126123 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659b2df-da45-4478-8b02-5112bd47fbe3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:18.127712 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6659b2df-da45-4478-8b02-5112bd47fbe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:18.169702 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd87995-a731-4832-b97e-59c710483fab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:18.170310 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd87995-a731-4832-b97e-59c710483fab service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:18.170587 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd87995-a731-4832-b97e-59c710483fab service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:18.170856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd87995-a731-4832-b97e-59c710483fab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:18.186612 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659b2df-da45-4478-8b02-5112bd47fbe3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:18.191116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97d8be-be89-4aa8-926f-0d60bd43b53c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:18.192075 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97d8be-be89-4aa8-926f-0d60bd43b53c service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:18.192361 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97d8be-be89-4aa8-926f-0d60bd43b53c service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:18.192721 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97d8be-be89-4aa8-926f-0d60bd43b53c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:18.194502 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cd97d8be-be89-4aa8-926f-0d60bd43b53c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:18.213422 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:18.229665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd87995-a731-4832-b97e-59c710483fab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:18.231108 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd87995-a731-4832-b97e-59c710483fab service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:18.241505 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 779/1558] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:33:18.250923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd87995-a731-4832-b97e-59c710483fab service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:18.263501 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97d8be-be89-4aa8-926f-0d60bd43b53c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:18.265004 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97d8be-be89-4aa8-926f-0d60bd43b53c service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:18.266227 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd87995-a731-4832-b97e-59c710483fab service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:18.272501 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce7987-37cd-4b7e-8d9d-5f92bd2ace29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:18.273331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce7987-37cd-4b7e-8d9d-5f92bd2ace29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:18.273798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce7987-37cd-4b7e-8d9d-5f92bd2ace29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:18.274751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce7987-37cd-4b7e-8d9d-5f92bd2ace29 admin admin] PATH_INFO: `/v3/projects/001df249a2fd46edbe4fc93e0991cbf9/users/3b24df7fc8ff4b488b5b7ad853715407/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:18.276968 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce7987-37cd-4b7e-8d9d-5f92bd2ace29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=001df249a2fd46edbe4fc93e0991cbf9, user_id=3b24df7fc8ff4b488b5b7ad853715407, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:18.281587 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce7987-37cd-4b7e-8d9d-5f92bd2ace29 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:18.289334 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 780/1559] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:18.295636 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 780/1560] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:18 2022] PUT /identity/v3/projects/001df249a2fd46edbe4fc93e0991cbf9/users/3b24df7fc8ff4b488b5b7ad853715407/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:18.309033 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d5fbd-ed9b-4ad7-a34a-dccb407191c3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:18.310092 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d5fbd-ed9b-4ad7-a34a-dccb407191c3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:18.310417 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d5fbd-ed9b-4ad7-a34a-dccb407191c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:18.346439 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e14d5fbd-ed9b-4ad7-a34a-dccb407191c3 None None] MFA Rules not processed for user `3b24df7fc8ff4b488b5b7ad853715407`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:18.347827 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e14d5fbd-ed9b-4ad7-a34a-dccb407191c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:18.373781 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:18.451000 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 781/1561] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:18 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:18.479633 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce7987-37cd-4b7e-8d9d-5f92bd2ace29 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:18.576711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce7987-37cd-4b7e-8d9d-5f92bd2ace29 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:18.586372 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3b1a6-f662-4caa-bf69-74302e755be1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:18.587854 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3b1a6-f662-4caa-bf69-74302e755be1 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:18.588299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3b1a6-f662-4caa-bf69-74302e755be1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:18.588718 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3b1a6-f662-4caa-bf69-74302e755be1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:18.610304 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3b1a6-f662-4caa-bf69-74302e755be1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:18.612042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3b1a6-f662-4caa-bf69-74302e755be1 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:18.637145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 781/1562] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:18 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:19.014811 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d5fbd-ed9b-4ad7-a34a-dccb407191c3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:19.021925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f6085-8b17-4ada-8d92-9997d3fd4d15 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:19.022209 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f6085-8b17-4ada-8d92-9997d3fd4d15 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:19.022500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f6085-8b17-4ada-8d92-9997d3fd4d15 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:19.024076 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 782/1563] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 31 12:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:33:19.038168 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb214cd-eca2-4fb7-800b-4618163d0bbb None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:19.038702 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb214cd-eca2-4fb7-800b-4618163d0bbb None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:19.039213 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb214cd-eca2-4fb7-800b-4618163d0bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:19.080084 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-0bb214cd-eca2-4fb7-800b-4618163d0bbb None None] MFA Rules not processed for user `d93ce5759e0648a1934ff4d9c9d8fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:19.090406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0bb214cd-eca2-4fb7-800b-4618163d0bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:19.099324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d5fbd-ed9b-4ad7-a34a-dccb407191c3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:19.104621 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba677f-c5d3-462e-b977-204b0dd82b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:19.105396 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba677f-c5d3-462e-b977-204b0dd82b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:19.105723 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba677f-c5d3-462e-b977-204b0dd82b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:19.106064 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba677f-c5d3-462e-b977-204b0dd82b6f admin admin] PATH_INFO: `/v3/users/0f876fa986c44fefb723f8bf760bdbce` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:19.107320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba677f-c5d3-462e-b977-204b0dd82b6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f876fa986c44fefb723f8bf760bdbce)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:19.110331 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba677f-c5d3-462e-b977-204b0dd82b6f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:19.176401 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-40ba677f-c5d3-462e-b977-204b0dd82b6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f876fa986c44fefb723f8bf760bdbce'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:19.191807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-40ba677f-c5d3-462e-b977-204b0dd82b6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f876fa986c44fefb723f8bf760bdbce'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:19.194367 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-40ba677f-c5d3-462e-b977-204b0dd82b6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f876fa986c44fefb723f8bf760bdbce'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:19.200541 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 783/1564] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 31 12:33:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:19.202544 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb214cd-eca2-4fb7-800b-4618163d0bbb None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:19.205956 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0bb214cd-eca2-4fb7-800b-4618163d0bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:19.221688 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-40ba677f-c5d3-462e-b977-204b0dd82b6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f876fa986c44fefb723f8bf760bdbce'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:19.228120 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb214cd-eca2-4fb7-800b-4618163d0bbb None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:19.232861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-40ba677f-c5d3-462e-b977-204b0dd82b6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f876fa986c44fefb723f8bf760bdbce'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:19.236866 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabb115-82fd-4428-820a-08da0ba2d405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:19.237534 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabb115-82fd-4428-820a-08da0ba2d405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:19.237815 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabb115-82fd-4428-820a-08da0ba2d405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:19.238091 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabb115-82fd-4428-820a-08da0ba2d405 admin admin] PATH_INFO: `/v3/users/eb93a3e0b2974b4b9070b0c95ae3657c` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:19.239256 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabb115-82fd-4428-820a-08da0ba2d405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb93a3e0b2974b4b9070b0c95ae3657c)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:19.240877 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 782/1565] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:19 2022] DELETE /identity/v3/users/0f876fa986c44fefb723f8bf760bdbce => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:19.241722 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabb115-82fd-4428-820a-08da0ba2d405 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:19.242737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba677f-c5d3-462e-b977-204b0dd82b6f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:19.245084 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-40ba677f-c5d3-462e-b977-204b0dd82b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:19.307903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:19.317481 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-cbabb115-82fd-4428-820a-08da0ba2d405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb93a3e0b2974b4b9070b0c95ae3657c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:19.318303 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-cbabb115-82fd-4428-820a-08da0ba2d405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb93a3e0b2974b4b9070b0c95ae3657c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:19.319014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-cbabb115-82fd-4428-820a-08da0ba2d405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb93a3e0b2974b4b9070b0c95ae3657c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:19.327541 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-cbabb115-82fd-4428-820a-08da0ba2d405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb93a3e0b2974b4b9070b0c95ae3657c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:19.330083 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:19.336833 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-cbabb115-82fd-4428-820a-08da0ba2d405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb93a3e0b2974b4b9070b0c95ae3657c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:19.354061 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba677f-c5d3-462e-b977-204b0dd82b6f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:19.359657 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 784/1566] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:19 2022] DELETE /identity/v3/users/eb93a3e0b2974b4b9070b0c95ae3657c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:19.362636 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110d650-3265-434e-9780-627eb91e29c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:19.362757 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30c49d-9e00-4778-82ad-885a4151cd1d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:19.362757 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30c49d-9e00-4778-82ad-885a4151cd1d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:19.362757 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30c49d-9e00-4778-82ad-885a4151cd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:19.362965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110d650-3265-434e-9780-627eb91e29c2 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:19.362965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110d650-3265-434e-9780-627eb91e29c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:19.362965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110d650-3265-434e-9780-627eb91e29c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:19.365832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b110d650-3265-434e-9780-627eb91e29c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:19.379421 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110d650-3265-434e-9780-627eb91e29c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:19.381091 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110d650-3265-434e-9780-627eb91e29c2 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:19.383452 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-0b30c49d-9e00-4778-82ad-885a4151cd1d None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:19.386327 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0b30c49d-9e00-4778-82ad-885a4151cd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:19.394549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 783/1567] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:19.407610 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4161a1-e42e-42bc-8a66-b1daea5edefd None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:19.407901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4161a1-e42e-42bc-8a66-b1daea5edefd None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:19.408183 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4161a1-e42e-42bc-8a66-b1daea5edefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:19.450683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2e4161a1-e42e-42bc-8a66-b1daea5edefd None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:19.452208 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2e4161a1-e42e-42bc-8a66-b1daea5edefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:19.485193 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 785/1568] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:19.496872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30c49d-9e00-4778-82ad-885a4151cd1d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:19.507945 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0b30c49d-9e00-4778-82ad-885a4151cd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:19.601159 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 784/1569] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:19.615666 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4161a1-e42e-42bc-8a66-b1daea5edefd None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:19.623503 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30c49d-9e00-4778-82ad-885a4151cd1d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:19.628502 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb673ce-34a2-4795-8b20-685e128b6be8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:19.629277 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb673ce-34a2-4795-8b20-685e128b6be8 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:19.629618 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb673ce-34a2-4795-8b20-685e128b6be8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:19.629954 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb673ce-34a2-4795-8b20-685e128b6be8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:19.630755 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4161a1-e42e-42bc-8a66-b1daea5edefd None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:19.635188 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217d688-14db-48fd-8e5a-f39f910ec0e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:19.635879 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217d688-14db-48fd-8e5a-f39f910ec0e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:19.637616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217d688-14db-48fd-8e5a-f39f910ec0e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:19.637981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217d688-14db-48fd-8e5a-f39f910ec0e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:19.640903 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb673ce-34a2-4795-8b20-685e128b6be8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:19.642693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb673ce-34a2-4795-8b20-685e128b6be8 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:19.649453 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217d688-14db-48fd-8e5a-f39f910ec0e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:19.651003 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217d688-14db-48fd-8e5a-f39f910ec0e0 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:19.664317 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 785/1570] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:33:19.665812 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 786/1571] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:33:20.376591 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217d688-14db-48fd-8e5a-f39f910ec0e0 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:20.378500 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5217d688-14db-48fd-8e5a-f39f910ec0e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:20.402488 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217d688-14db-48fd-8e5a-f39f910ec0e0 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:20.408209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49b6de-ba09-43f9-8b0c-46f2c42b6641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:20.408926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49b6de-ba09-43f9-8b0c-46f2c42b6641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:20.409250 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49b6de-ba09-43f9-8b0c-46f2c42b6641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:20.409535 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49b6de-ba09-43f9-8b0c-46f2c42b6641 admin admin] PATH_INFO: `/v3/projects/28bb175b25a842c3af06030ce86bf259` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:20.410842 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49b6de-ba09-43f9-8b0c-46f2c42b6641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28bb175b25a842c3af06030ce86bf259)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:20.412865 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49b6de-ba09-43f9-8b0c-46f2c42b6641 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:20.433975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb673ce-34a2-4795-8b20-685e128b6be8 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:20.436221 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0bb673ce-34a2-4795-8b20-685e128b6be8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:20.452339 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb673ce-34a2-4795-8b20-685e128b6be8 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:20.459867 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050fdaf-5a5c-4a3f-9c05-00527a9831a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:20.460762 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050fdaf-5a5c-4a3f-9c05-00527a9831a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:20.461081 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050fdaf-5a5c-4a3f-9c05-00527a9831a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:20.461443 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050fdaf-5a5c-4a3f-9c05-00527a9831a5 admin admin] PATH_INFO: `/v3/projects/bd2d47373ef443caa64a8e51930cf572` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:20.463269 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050fdaf-5a5c-4a3f-9c05-00527a9831a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd2d47373ef443caa64a8e51930cf572)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:20.465451 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050fdaf-5a5c-4a3f-9c05-00527a9831a5 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:20.492758 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2d49b6de-ba09-43f9-8b0c-46f2c42b6641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28bb175b25a842c3af06030ce86bf259', 'request_id': 'req-2d49b6de-ba09-43f9-8b0c-46f2c42b6641'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:20.503248 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2d49b6de-ba09-43f9-8b0c-46f2c42b6641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28bb175b25a842c3af06030ce86bf259', 'request_id': 'req-2d49b6de-ba09-43f9-8b0c-46f2c42b6641'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:20.510079 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2d49b6de-ba09-43f9-8b0c-46f2c42b6641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28bb175b25a842c3af06030ce86bf259', 'request_id': 'req-2d49b6de-ba09-43f9-8b0c-46f2c42b6641'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:20.518735 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3050fdaf-5a5c-4a3f-9c05-00527a9831a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd2d47373ef443caa64a8e51930cf572', 'request_id': 'req-3050fdaf-5a5c-4a3f-9c05-00527a9831a5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:20.525002 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2d49b6de-ba09-43f9-8b0c-46f2c42b6641 admin admin] The token cache is being invalidate because project 28bb175b25a842c3af06030ce86bf259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:20.525444 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2d49b6de-ba09-43f9-8b0c-46f2c42b6641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:20.526211 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2d49b6de-ba09-43f9-8b0c-46f2c42b6641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:20.526945 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3050fdaf-5a5c-4a3f-9c05-00527a9831a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd2d47373ef443caa64a8e51930cf572', 'request_id': 'req-3050fdaf-5a5c-4a3f-9c05-00527a9831a5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:20.527929 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 786/1572] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:20 2022] DELETE /identity/v3/projects/28bb175b25a842c3af06030ce86bf259 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:20.531922 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49b6de-ba09-43f9-8b0c-46f2c42b6641 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:20.533527 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2d49b6de-ba09-43f9-8b0c-46f2c42b6641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:20.536031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3050fdaf-5a5c-4a3f-9c05-00527a9831a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd2d47373ef443caa64a8e51930cf572', 'request_id': 'req-3050fdaf-5a5c-4a3f-9c05-00527a9831a5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:20.550520 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3050fdaf-5a5c-4a3f-9c05-00527a9831a5 admin admin] The token cache is being invalidate because project bd2d47373ef443caa64a8e51930cf572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:20.550826 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3050fdaf-5a5c-4a3f-9c05-00527a9831a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:20.551445 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3050fdaf-5a5c-4a3f-9c05-00527a9831a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:20.553000 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 787/1573] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:20 2022] DELETE /identity/v3/projects/bd2d47373ef443caa64a8e51930cf572 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:33:20.557434 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050fdaf-5a5c-4a3f-9c05-00527a9831a5 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:20.558897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3050fdaf-5a5c-4a3f-9c05-00527a9831a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:20.564112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:20.578828 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:20.615047 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49b6de-ba09-43f9-8b0c-46f2c42b6641 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:20.637452 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050fdaf-5a5c-4a3f-9c05-00527a9831a5 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:20.642555 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30947d-d6c9-4679-b0c3-91a7c3dbf925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:20.643285 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30947d-d6c9-4679-b0c3-91a7c3dbf925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:20.643639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30947d-d6c9-4679-b0c3-91a7c3dbf925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:20.643985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30947d-d6c9-4679-b0c3-91a7c3dbf925 admin admin] PATH_INFO: `/v3/users/3b24df7fc8ff4b488b5b7ad853715407` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:20.645265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30947d-d6c9-4679-b0c3-91a7c3dbf925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b24df7fc8ff4b488b5b7ad853715407)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:20.647326 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30947d-d6c9-4679-b0c3-91a7c3dbf925 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:20.701137 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b6883-9d4a-4679-beff-74869c97fd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:20.701968 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b6883-9d4a-4679-beff-74869c97fd0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:20.702319 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b6883-9d4a-4679-beff-74869c97fd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:20.702710 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b6883-9d4a-4679-beff-74869c97fd0f admin admin] PATH_INFO: `/v3/users/7983b8a50e0648fc85385ed009cfde60` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:20.703537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7b30947d-d6c9-4679-b0c3-91a7c3dbf925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b24df7fc8ff4b488b5b7ad853715407'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:20.703975 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b6883-9d4a-4679-beff-74869c97fd0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7983b8a50e0648fc85385ed009cfde60)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:20.704198 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7b30947d-d6c9-4679-b0c3-91a7c3dbf925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b24df7fc8ff4b488b5b7ad853715407'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:20.705390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7b30947d-d6c9-4679-b0c3-91a7c3dbf925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b24df7fc8ff4b488b5b7ad853715407'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:20.706369 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b6883-9d4a-4679-beff-74869c97fd0f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:20.719163 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7b30947d-d6c9-4679-b0c3-91a7c3dbf925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b24df7fc8ff4b488b5b7ad853715407'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:20.732636 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7b30947d-d6c9-4679-b0c3-91a7c3dbf925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b24df7fc8ff4b488b5b7ad853715407'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:20.755177 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 788/1574] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:20 2022] DELETE /identity/v3/users/3b24df7fc8ff4b488b5b7ad853715407 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:33:20.783456 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-005b6883-9d4a-4679-beff-74869c97fd0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7983b8a50e0648fc85385ed009cfde60'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:20.796063 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-005b6883-9d4a-4679-beff-74869c97fd0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7983b8a50e0648fc85385ed009cfde60'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:20.797484 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-005b6883-9d4a-4679-beff-74869c97fd0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7983b8a50e0648fc85385ed009cfde60'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:20.814579 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-005b6883-9d4a-4679-beff-74869c97fd0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7983b8a50e0648fc85385ed009cfde60'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:20.830073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-005b6883-9d4a-4679-beff-74869c97fd0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7983b8a50e0648fc85385ed009cfde60'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:20.836695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 787/1575] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:20 2022] DELETE /identity/v3/users/7983b8a50e0648fc85385ed009cfde60 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:21.200432 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30947d-d6c9-4679-b0c3-91a7c3dbf925 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:21.201862 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7b30947d-d6c9-4679-b0c3-91a7c3dbf925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:21.268437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b6883-9d4a-4679-beff-74869c97fd0f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:21.270463 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-005b6883-9d4a-4679-beff-74869c97fd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:21.312807 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30947d-d6c9-4679-b0c3-91a7c3dbf925 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:21.347063 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:21.400993 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383f29e-2c29-451d-b72c-ed74ac18d3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:21.401714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383f29e-2c29-451d-b72c-ed74ac18d3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:21.402274 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383f29e-2c29-451d-b72c-ed74ac18d3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:21.402552 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383f29e-2c29-451d-b72c-ed74ac18d3d3 admin admin] PATH_INFO: `/v3/projects/001df249a2fd46edbe4fc93e0991cbf9` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:21.404754 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383f29e-2c29-451d-b72c-ed74ac18d3d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=001df249a2fd46edbe4fc93e0991cbf9)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:21.404868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b6883-9d4a-4679-beff-74869c97fd0f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:21.406192 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383f29e-2c29-451d-b72c-ed74ac18d3d3 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:21.416578 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5267685-0a67-429b-8758-abc5e6665c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:21.417267 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5267685-0a67-429b-8758-abc5e6665c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:21.417556 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5267685-0a67-429b-8758-abc5e6665c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:21.420887 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5267685-0a67-429b-8758-abc5e6665c54 admin admin] PATH_INFO: `/v3/projects/9d60111f8d064bfa9936a19ec2a9de1f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:21.423124 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5267685-0a67-429b-8758-abc5e6665c54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d60111f8d064bfa9936a19ec2a9de1f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:21.433398 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5267685-0a67-429b-8758-abc5e6665c54 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:21.435548 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:21.515970 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7383f29e-2c29-451d-b72c-ed74ac18d3d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '001df249a2fd46edbe4fc93e0991cbf9', 'request_id': 'req-7383f29e-2c29-451d-b72c-ed74ac18d3d3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:21.523734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f5267685-0a67-429b-8758-abc5e6665c54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d60111f8d064bfa9936a19ec2a9de1f', 'request_id': 'req-f5267685-0a67-429b-8758-abc5e6665c54'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:21.536396 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7383f29e-2c29-451d-b72c-ed74ac18d3d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '001df249a2fd46edbe4fc93e0991cbf9', 'request_id': 'req-7383f29e-2c29-451d-b72c-ed74ac18d3d3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:21.539027 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f5267685-0a67-429b-8758-abc5e6665c54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d60111f8d064bfa9936a19ec2a9de1f', 'request_id': 'req-f5267685-0a67-429b-8758-abc5e6665c54'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:21.549550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f5267685-0a67-429b-8758-abc5e6665c54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d60111f8d064bfa9936a19ec2a9de1f', 'request_id': 'req-f5267685-0a67-429b-8758-abc5e6665c54'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:21.556553 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7383f29e-2c29-451d-b72c-ed74ac18d3d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '001df249a2fd46edbe4fc93e0991cbf9', 'request_id': 'req-7383f29e-2c29-451d-b72c-ed74ac18d3d3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:21.579188 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f5267685-0a67-429b-8758-abc5e6665c54 admin admin] The token cache is being invalidate because project 9d60111f8d064bfa9936a19ec2a9de1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:21.580378 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f5267685-0a67-429b-8758-abc5e6665c54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:21.585527 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f5267685-0a67-429b-8758-abc5e6665c54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:21.586815 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7383f29e-2c29-451d-b72c-ed74ac18d3d3 admin admin] The token cache is being invalidate because project 001df249a2fd46edbe4fc93e0991cbf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:21.587444 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7383f29e-2c29-451d-b72c-ed74ac18d3d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:21.588039 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7383f29e-2c29-451d-b72c-ed74ac18d3d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:21.588163 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 788/1576] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:21 2022] DELETE /identity/v3/projects/9d60111f8d064bfa9936a19ec2a9de1f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:21.592252 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 789/1577] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:21 2022] DELETE /identity/v3/projects/001df249a2fd46edbe4fc93e0991cbf9 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:21.595903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd9985-96fa-4a98-895b-38f6b2c0bf87 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:21.596201 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd9985-96fa-4a98-895b-38f6b2c0bf87 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:21.596475 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd9985-96fa-4a98-895b-38f6b2c0bf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:21.597623 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e811c-8484-43db-84e9-c26333e29654 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:21.598079 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e811c-8484-43db-84e9-c26333e29654 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:21.598604 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e811c-8484-43db-84e9-c26333e29654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:21.637652 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0bcd9985-96fa-4a98-895b-38f6b2c0bf87 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:21.638845 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0bcd9985-96fa-4a98-895b-38f6b2c0bf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:21.669245 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-871e811c-8484-43db-84e9-c26333e29654 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:21.670532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-871e811c-8484-43db-84e9-c26333e29654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:21.754166 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 789/1578] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:21.757026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695158d-38ea-46ff-ab57-14b21a1df900 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:21.757437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695158d-38ea-46ff-ab57-14b21a1df900 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:21.757844 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695158d-38ea-46ff-ab57-14b21a1df900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:21.773893 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 790/1579] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:21.781423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87461dbd-2782-47e4-8bf1-d69f70053a49 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:21.781713 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87461dbd-2782-47e4-8bf1-d69f70053a49 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:21.781990 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87461dbd-2782-47e4-8bf1-d69f70053a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:21.807026 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-87461dbd-2782-47e4-8bf1-d69f70053a49 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:21.808271 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-87461dbd-2782-47e4-8bf1-d69f70053a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:21.817134 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 791/1580] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:21.822076 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87461dbd-2782-47e4-8bf1-d69f70053a49 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:21.832728 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87461dbd-2782-47e4-8bf1-d69f70053a49 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:21.837868 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f52e4-21e9-40bd-b379-316a1d5468ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:21.838508 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f52e4-21e9-40bd-b379-316a1d5468ff admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:21.838785 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f52e4-21e9-40bd-b379-316a1d5468ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:21.839057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f52e4-21e9-40bd-b379-316a1d5468ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:21.839772 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f52e4-21e9-40bd-b379-316a1d5468ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:33:21.840064 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f52e4-21e9-40bd-b379-316a1d5468ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:21.841730 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f52e4-21e9-40bd-b379-316a1d5468ff admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:21.865640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 792/1581] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:33:21.866763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f52e4-21e9-40bd-b379-316a1d5468ff admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:21.878256 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f52e4-21e9-40bd-b379-316a1d5468ff admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:21.883528 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e8ee7-b4ee-4511-a4f4-0755a546a169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:21.884746 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e8ee7-b4ee-4511-a4f4-0755a546a169 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:21.885058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e8ee7-b4ee-4511-a4f4-0755a546a169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:21.885382 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e8ee7-b4ee-4511-a4f4-0755a546a169 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:21.886029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e8ee7-b4ee-4511-a4f4-0755a546a169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:21.888055 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e8ee7-b4ee-4511-a4f4-0755a546a169 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:21.907167 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c695158d-38ea-46ff-ab57-14b21a1df900 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:21.908491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c695158d-38ea-46ff-ab57-14b21a1df900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:21.917531 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 790/1582] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:21.921546 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695158d-38ea-46ff-ab57-14b21a1df900 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:21.921676 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 793/1583] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:21 2022] POST /identity/v3/projects => generated 409 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:21.925498 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e8ee7-b4ee-4511-a4f4-0755a546a169 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:21.932111 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695158d-38ea-46ff-ab57-14b21a1df900 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:21.951269 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:22.008071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654c9b6-860e-461f-b7f0-f13b7e1d5b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:22.008755 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654c9b6-860e-461f-b7f0-f13b7e1d5b8b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:22.010254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654c9b6-860e-461f-b7f0-f13b7e1d5b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:22.010502 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654c9b6-860e-461f-b7f0-f13b7e1d5b8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:22.011173 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654c9b6-860e-461f-b7f0-f13b7e1d5b8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:33:22.011530 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654c9b6-860e-461f-b7f0-f13b7e1d5b8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:22.013776 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654c9b6-860e-461f-b7f0-f13b7e1d5b8b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:22.037187 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 791/1584] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:33:22.039644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654c9b6-860e-461f-b7f0-f13b7e1d5b8b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:22.048522 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e8ee7-b4ee-4511-a4f4-0755a546a169 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:22.066908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654c9b6-860e-461f-b7f0-f13b7e1d5b8b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:22.067101 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83db26-2703-411a-aa57-de9be7e358a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:22.067101 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83db26-2703-411a-aa57-de9be7e358a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:22.067101 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83db26-2703-411a-aa57-de9be7e358a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:22.067101 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83db26-2703-411a-aa57-de9be7e358a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:22.067444 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83db26-2703-411a-aa57-de9be7e358a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:22.067444 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83db26-2703-411a-aa57-de9be7e358a9 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:22.068434 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2ef88-1b98-4830-8ee2-4ffd3a52bfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:22.069188 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2ef88-1b98-4830-8ee2-4ffd3a52bfbc admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:22.069831 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2ef88-1b98-4830-8ee2-4ffd3a52bfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:22.069999 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2ef88-1b98-4830-8ee2-4ffd3a52bfbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:22.075552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2ef88-1b98-4830-8ee2-4ffd3a52bfbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:22.075552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2ef88-1b98-4830-8ee2-4ffd3a52bfbc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:22.094406 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:22.111226 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 794/1585] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:21 2022] POST /identity/v3/users => generated 305 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:33:22.115680 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83db26-2703-411a-aa57-de9be7e358a9 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:22.122918 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 792/1586] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:22 2022] POST /identity/v3/projects => generated 367 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:22.124356 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2ef88-1b98-4830-8ee2-4ffd3a52bfbc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:22.155653 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83db26-2703-411a-aa57-de9be7e358a9 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:22.234408 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2ef88-1b98-4830-8ee2-4ffd3a52bfbc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:22.234711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecbdea-2bcc-4c15-8798-fe57329514bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:22.235359 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecbdea-2bcc-4c15-8798-fe57329514bf admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:22.235718 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecbdea-2bcc-4c15-8798-fe57329514bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:22.236052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecbdea-2bcc-4c15-8798-fe57329514bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:22.236851 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecbdea-2bcc-4c15-8798-fe57329514bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:22.238596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecbdea-2bcc-4c15-8798-fe57329514bf admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:22.241974 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9c73e-68ed-4975-bec1-9f7000128d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:22.243059 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9c73e-68ed-4975-bec1-9f7000128d96 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:22.244083 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9c73e-68ed-4975-bec1-9f7000128d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:22.244541 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9c73e-68ed-4975-bec1-9f7000128d96 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:22.245893 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9c73e-68ed-4975-bec1-9f7000128d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:22.249832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9c73e-68ed-4975-bec1-9f7000128d96 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:22.251244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 795/1587] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:22.255242 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecbdea-2bcc-4c15-8798-fe57329514bf admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:22.274336 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecbdea-2bcc-4c15-8798-fe57329514bf admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:22.280399 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d12f1-55a5-4e24-80d3-7f6629977448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:22.280957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d12f1-55a5-4e24-80d3-7f6629977448 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:22.281269 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d12f1-55a5-4e24-80d3-7f6629977448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:22.281548 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d12f1-55a5-4e24-80d3-7f6629977448 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:22.282810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d12f1-55a5-4e24-80d3-7f6629977448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:22.284793 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d12f1-55a5-4e24-80d3-7f6629977448 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:22.291877 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 793/1588] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:22 2022] POST /identity/v3/users => generated 284 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:22.292970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9c73e-68ed-4975-bec1-9f7000128d96 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:22.306732 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9c73e-68ed-4975-bec1-9f7000128d96 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:22.308167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 796/1589] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:22.316654 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f9331-39e9-477b-b37d-228d6cd12b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:22.317319 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f9331-39e9-477b-b37d-228d6cd12b3b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:22.317600 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f9331-39e9-477b-b37d-228d6cd12b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:22.317869 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f9331-39e9-477b-b37d-228d6cd12b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:22.318531 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f9331-39e9-477b-b37d-228d6cd12b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:22.319133 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d12f1-55a5-4e24-80d3-7f6629977448 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:22.320251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f9331-39e9-477b-b37d-228d6cd12b3b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:22.337617 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 794/1590] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:22.338621 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f9331-39e9-477b-b37d-228d6cd12b3b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:22.346964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d12f1-55a5-4e24-80d3-7f6629977448 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:22.355164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f9331-39e9-477b-b37d-228d6cd12b3b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:22.360318 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13c61c-2823-41ca-8091-ed42cbd5f3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:22.361182 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13c61c-2823-41ca-8091-ed42cbd5f3e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:22.361807 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13c61c-2823-41ca-8091-ed42cbd5f3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:22.362193 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13c61c-2823-41ca-8091-ed42cbd5f3e9 admin admin] PATH_INFO: `/v3/projects/e76be1cc37004c7b8d818b40e5dff0ec/users/fdb0dae65d4048ea854d742560355b84/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:22.368177 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e646083-f633-49f9-94d9-b671f7a86fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:22.369406 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e646083-f633-49f9-94d9-b671f7a86fdb admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:22.369689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e646083-f633-49f9-94d9-b671f7a86fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:22.369964 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e646083-f633-49f9-94d9-b671f7a86fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:22.370613 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e646083-f633-49f9-94d9-b671f7a86fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:22.373234 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e646083-f633-49f9-94d9-b671f7a86fdb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:22.398474 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 795/1591] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:22.403066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e646083-f633-49f9-94d9-b671f7a86fdb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:22.419727 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e646083-f633-49f9-94d9-b671f7a86fdb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:22.426695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6017ec-7e09-4ce0-9bf5-e5860bb05438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:22.427431 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6017ec-7e09-4ce0-9bf5-e5860bb05438 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:22.427698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6017ec-7e09-4ce0-9bf5-e5860bb05438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:22.427976 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6017ec-7e09-4ce0-9bf5-e5860bb05438 admin admin] PATH_INFO: `/v3/projects/8da0dc5d9dd74c4c8d6ddf6b8da52d2c/users/178b286fa1fb4af5b3c50639e21d480e/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:22.451914 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6017ec-7e09-4ce0-9bf5-e5860bb05438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8da0dc5d9dd74c4c8d6ddf6b8da52d2c, user_id=178b286fa1fb4af5b3c50639e21d480e, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:22.455904 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6017ec-7e09-4ce0-9bf5-e5860bb05438 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:22.481920 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 796/1592] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:22 2022] PUT /identity/v3/projects/8da0dc5d9dd74c4c8d6ddf6b8da52d2c/users/178b286fa1fb4af5b3c50639e21d480e/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:22.495562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9401e-cc11-4a7b-8b36-d05b76992a02 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:22.495851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9401e-cc11-4a7b-8b36-d05b76992a02 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:22.496128 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9401e-cc11-4a7b-8b36-d05b76992a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:22.521839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13c61c-2823-41ca-8091-ed42cbd5f3e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76be1cc37004c7b8d818b40e5dff0ec, user_id=fdb0dae65d4048ea854d742560355b84, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:22.525022 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13c61c-2823-41ca-8091-ed42cbd5f3e9 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:22.542862 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 797/1593] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:22 2022] PUT /identity/v3/projects/e76be1cc37004c7b8d818b40e5dff0ec/users/fdb0dae65d4048ea854d742560355b84/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:22.550316 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-acc9401e-cc11-4a7b-8b36-d05b76992a02 None None] MFA Rules not processed for user `178b286fa1fb4af5b3c50639e21d480e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:22.552135 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-acc9401e-cc11-4a7b-8b36-d05b76992a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:22.554774 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f677f-f87e-4cf2-ae4a-2a1d7226d6bc None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:22.555159 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f677f-f87e-4cf2-ae4a-2a1d7226d6bc None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:22.555514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f677f-f87e-4cf2-ae4a-2a1d7226d6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:22.596001 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3a9f677f-f87e-4cf2-ae4a-2a1d7226d6bc None None] MFA Rules not processed for user `fdb0dae65d4048ea854d742560355b84`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:22.597346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3a9f677f-f87e-4cf2-ae4a-2a1d7226d6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:22.642445 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 797/1594] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:22.646013 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9401e-cc11-4a7b-8b36-d05b76992a02 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:22.672027 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:22.681979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 798/1595] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:22 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:22.686834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f677f-f87e-4cf2-ae4a-2a1d7226d6bc None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:22.688079 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:22.734383 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9401e-cc11-4a7b-8b36-d05b76992a02 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:22.740413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dd1bb-c362-4bef-bc27-f24077917107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:22.741246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dd1bb-c362-4bef-bc27-f24077917107 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:22.741530 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dd1bb-c362-4bef-bc27-f24077917107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:22.741906 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5dd1bb-c362-4bef-bc27-f24077917107 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:22.742547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5dd1bb-c362-4bef-bc27-f24077917107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:22.745148 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5dd1bb-c362-4bef-bc27-f24077917107 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:22.781015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f677f-f87e-4cf2-ae4a-2a1d7226d6bc None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:22.788247 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36944530-dd38-4bc3-b427-3c58441303bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:22.789471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36944530-dd38-4bc3-b427-3c58441303bc admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:22.791232 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36944530-dd38-4bc3-b427-3c58441303bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:22.791618 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36944530-dd38-4bc3-b427-3c58441303bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:22.792710 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36944530-dd38-4bc3-b427-3c58441303bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:22.795745 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36944530-dd38-4bc3-b427-3c58441303bc admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:22.799150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 798/1596] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:22 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:33:22.803273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dd1bb-c362-4bef-bc27-f24077917107 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:22.855218 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 799/1597] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:22 2022] POST /identity/v3/projects => generated 409 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:33:22.859896 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36944530-dd38-4bc3-b427-3c58441303bc admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:22.941970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5dd1bb-c362-4bef-bc27-f24077917107 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:23.011329 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36944530-dd38-4bc3-b427-3c58441303bc admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:23.019353 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2793755-ebad-4bc4-9bc4-b71fb3a4881b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:23.020403 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2793755-ebad-4bc4-9bc4-b71fb3a4881b admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:23.020864 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2793755-ebad-4bc4-9bc4-b71fb3a4881b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:23.021463 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2793755-ebad-4bc4-9bc4-b71fb3a4881b admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:23.022331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2793755-ebad-4bc4-9bc4-b71fb3a4881b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:23.026213 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2793755-ebad-4bc4-9bc4-b71fb3a4881b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:23.049387 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43823218-209d-4148-85f0-39c9fe841d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:23.050068 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43823218-209d-4148-85f0-39c9fe841d2f admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:23.050361 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43823218-209d-4148-85f0-39c9fe841d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:23.050685 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43823218-209d-4148-85f0-39c9fe841d2f admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:23.051305 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43823218-209d-4148-85f0-39c9fe841d2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:23.053780 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43823218-209d-4148-85f0-39c9fe841d2f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:23.060909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 800/1598] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:22 2022] POST /identity/v3/users => generated 311 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:23.067997 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2793755-ebad-4bc4-9bc4-b71fb3a4881b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:23.081280 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2793755-ebad-4bc4-9bc4-b71fb3a4881b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:23.085148 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 799/1599] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:22 2022] POST /identity/v3/users => generated 290 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:33:23.088183 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43823218-209d-4148-85f0-39c9fe841d2f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:23.088651 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b703dc5-77b7-475b-989c-7edec5af5ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:23.089227 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b703dc5-77b7-475b-989c-7edec5af5ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:23.089506 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b703dc5-77b7-475b-989c-7edec5af5ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:23.089778 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b703dc5-77b7-475b-989c-7edec5af5ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:23.090428 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b703dc5-77b7-475b-989c-7edec5af5ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:23.092014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b703dc5-77b7-475b-989c-7edec5af5ac0 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:23.099492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43823218-209d-4148-85f0-39c9fe841d2f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:23.105280 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 801/1600] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:23.105422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614cfc9-28ca-4500-bfb8-54293a3ea0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:23.105599 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614cfc9-28ca-4500-bfb8-54293a3ea0fb admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:23.106004 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614cfc9-28ca-4500-bfb8-54293a3ea0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:23.106303 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614cfc9-28ca-4500-bfb8-54293a3ea0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:23.107054 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614cfc9-28ca-4500-bfb8-54293a3ea0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:23.108229 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b703dc5-77b7-475b-989c-7edec5af5ac0 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:23.108902 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614cfc9-28ca-4500-bfb8-54293a3ea0fb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:23.119347 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b703dc5-77b7-475b-989c-7edec5af5ac0 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:23.121378 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 800/1601] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:33:23.125596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1c04d-95bb-4a34-905d-7f5150684f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:23.125978 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614cfc9-28ca-4500-bfb8-54293a3ea0fb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:23.126465 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1c04d-95bb-4a34-905d-7f5150684f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:23.126810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1c04d-95bb-4a34-905d-7f5150684f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:23.128425 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1c04d-95bb-4a34-905d-7f5150684f9b admin admin] PATH_INFO: `/v3/projects/4d02c991499b4dbc8d204e85420d6630/users/c12491ec69aa48a79668345ef37e0083/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:23.139126 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614cfc9-28ca-4500-bfb8-54293a3ea0fb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:23.145993 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb55a5-b4e2-461d-bf01-1a5fca96efdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:23.146703 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1c04d-95bb-4a34-905d-7f5150684f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d02c991499b4dbc8d204e85420d6630, user_id=c12491ec69aa48a79668345ef37e0083, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:23.146821 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb55a5-b4e2-461d-bf01-1a5fca96efdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:23.147210 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb55a5-b4e2-461d-bf01-1a5fca96efdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:23.147553 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb55a5-b4e2-461d-bf01-1a5fca96efdb admin admin] PATH_INFO: `/v3/projects/4b8ffb2f1f03412b89bd40d4c5c66735/users/ac16a22adb8e44158c95a9fa64779ba4/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:23.149786 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1c04d-95bb-4a34-905d-7f5150684f9b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:23.169303 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 802/1602] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:23 2022] PUT /identity/v3/projects/4d02c991499b4dbc8d204e85420d6630/users/c12491ec69aa48a79668345ef37e0083/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:33:23.174106 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb55a5-b4e2-461d-bf01-1a5fca96efdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8ffb2f1f03412b89bd40d4c5c66735, user_id=ac16a22adb8e44158c95a9fa64779ba4, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:23.177318 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb55a5-b4e2-461d-bf01-1a5fca96efdb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:23.177857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1c04d-95bb-4a34-905d-7f5150684f9b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:23.201577 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 801/1603] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:23 2022] PUT /identity/v3/projects/4b8ffb2f1f03412b89bd40d4c5c66735/users/ac16a22adb8e44158c95a9fa64779ba4/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:23.206505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb55a5-b4e2-461d-bf01-1a5fca96efdb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:23.236453 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:23.238016 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:23.268992 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1c04d-95bb-4a34-905d-7f5150684f9b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:23.307120 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb55a5-b4e2-461d-bf01-1a5fca96efdb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:23.313537 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06ea86-ed4c-46a8-99ca-23155cb7bbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:23.314324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06ea86-ed4c-46a8-99ca-23155cb7bbce admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:23.314878 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06ea86-ed4c-46a8-99ca-23155cb7bbce admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:23.315324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06ea86-ed4c-46a8-99ca-23155cb7bbce admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:23.316754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06ea86-ed4c-46a8-99ca-23155cb7bbce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:23.318945 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06ea86-ed4c-46a8-99ca-23155cb7bbce admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:23.339727 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 802/1604] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:23.341176 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06ea86-ed4c-46a8-99ca-23155cb7bbce admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:23.356392 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06ea86-ed4c-46a8-99ca-23155cb7bbce admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:23.362389 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504e024-5460-4e96-b822-a379d128ac05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:23.363743 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504e024-5460-4e96-b822-a379d128ac05 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:23.364130 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a7b91-efd7-43e0-9b7d-737f7c403ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:23.364310 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504e024-5460-4e96-b822-a379d128ac05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:23.364531 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504e024-5460-4e96-b822-a379d128ac05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:23.365253 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504e024-5460-4e96-b822-a379d128ac05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:23.365590 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a7b91-efd7-43e0-9b7d-737f7c403ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:23.366329 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a7b91-efd7-43e0-9b7d-737f7c403ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:23.366839 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a7b91-efd7-43e0-9b7d-737f7c403ebb admin admin] PATH_INFO: `/v3/projects/4b8ffb2f1f03412b89bd40d4c5c66735/users/ac16a22adb8e44158c95a9fa64779ba4/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:23.367179 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504e024-5460-4e96-b822-a379d128ac05 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:23.370109 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a7b91-efd7-43e0-9b7d-737f7c403ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8ffb2f1f03412b89bd40d4c5c66735, user_id=ac16a22adb8e44158c95a9fa64779ba4, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:23.374641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a7b91-efd7-43e0-9b7d-737f7c403ebb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:23.383943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 803/1605] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:33:23.392626 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504e024-5460-4e96-b822-a379d128ac05 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:23.401164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 803/1606] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:23 2022] PUT /identity/v3/projects/4b8ffb2f1f03412b89bd40d4c5c66735/users/ac16a22adb8e44158c95a9fa64779ba4/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:23.404114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504e024-5460-4e96-b822-a379d128ac05 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:23.412875 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ab429-c4a3-4657-870b-b5604804aa32 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:23.413289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ab429-c4a3-4657-870b-b5604804aa32 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:23.413927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ab429-c4a3-4657-870b-b5604804aa32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:23.456411 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-986ab429-c4a3-4657-870b-b5604804aa32 None None] MFA Rules not processed for user `ac16a22adb8e44158c95a9fa64779ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:23.457770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-986ab429-c4a3-4657-870b-b5604804aa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:23.484999 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c051704-7cd5-4f20-a3c8-644fdb1cbcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:23.485320 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c051704-7cd5-4f20-a3c8-644fdb1cbcea admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:23.485996 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c051704-7cd5-4f20-a3c8-644fdb1cbcea admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:23.486320 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c051704-7cd5-4f20-a3c8-644fdb1cbcea admin admin] PATH_INFO: `/v3/projects/4d02c991499b4dbc8d204e85420d6630/users/c12491ec69aa48a79668345ef37e0083/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:23.488509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c051704-7cd5-4f20-a3c8-644fdb1cbcea admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d02c991499b4dbc8d204e85420d6630, user_id=c12491ec69aa48a79668345ef37e0083, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:23.491303 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c051704-7cd5-4f20-a3c8-644fdb1cbcea admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:23.502645 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 804/1607] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:23 2022] PUT /identity/v3/projects/4d02c991499b4dbc8d204e85420d6630/users/c12491ec69aa48a79668345ef37e0083/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:23.513795 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd4638-fe95-40fc-8b12-a5e0ef825abb None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:23.514048 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd4638-fe95-40fc-8b12-a5e0ef825abb None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:23.514345 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd4638-fe95-40fc-8b12-a5e0ef825abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:23.530328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 804/1608] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:23.542784 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ab429-c4a3-4657-870b-b5604804aa32 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:23.544209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-986ab429-c4a3-4657-870b-b5604804aa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:23.549519 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-70fd4638-fe95-40fc-8b12-a5e0ef825abb None None] MFA Rules not processed for user `c12491ec69aa48a79668345ef37e0083`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:23.550766 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-70fd4638-fe95-40fc-8b12-a5e0ef825abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:23.608573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ab429-c4a3-4657-870b-b5604804aa32 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:23.619838 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:23.625324 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 805/1609] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:23 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:23.634470 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd4638-fe95-40fc-8b12-a5e0ef825abb None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:23.635816 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-70fd4638-fe95-40fc-8b12-a5e0ef825abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:23.648277 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:23.661357 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4607a-1eb8-497c-9901-0f345b087ad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:23.662113 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4607a-1eb8-497c-9901-0f345b087ad0 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:23.662403 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4607a-1eb8-497c-9901-0f345b087ad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:23.662744 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4607a-1eb8-497c-9901-0f345b087ad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:23.701661 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd4638-fe95-40fc-8b12-a5e0ef825abb None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:23.710672 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c67ec-a61e-44ef-ba41-035636955d3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:23.711426 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c67ec-a61e-44ef-ba41-035636955d3a service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:23.711832 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c67ec-a61e-44ef-ba41-035636955d3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:23.712346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c67ec-a61e-44ef-ba41-035636955d3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:23.731369 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c67ec-a61e-44ef-ba41-035636955d3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:23.733001 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c67ec-a61e-44ef-ba41-035636955d3a service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:23.735516 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4607a-1eb8-497c-9901-0f345b087ad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:23.737211 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4607a-1eb8-497c-9901-0f345b087ad0 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:23.749251 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 806/1610] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:23 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:33:23.753271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 805/1611] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:23.842357 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c67ec-a61e-44ef-ba41-035636955d3a service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:23.851324 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c67ec-a61e-44ef-ba41-035636955d3a service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:23.855852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dccaf5-eca7-4b22-a429-25976ddaa5a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:23.856452 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dccaf5-eca7-4b22-a429-25976ddaa5a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:23.856762 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dccaf5-eca7-4b22-a429-25976ddaa5a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:23.857071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dccaf5-eca7-4b22-a429-25976ddaa5a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:23.916276 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dccaf5-eca7-4b22-a429-25976ddaa5a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:23.917740 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dccaf5-eca7-4b22-a429-25976ddaa5a8 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:23.932145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 807/1612] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:23.952987 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4607a-1eb8-497c-9901-0f345b087ad0 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:23.961655 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4607a-1eb8-497c-9901-0f345b087ad0 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:23.965852 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d20958-cd89-4397-a169-c9eafbe5ec23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:23.966522 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d20958-cd89-4397-a169-c9eafbe5ec23 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:23.966893 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d20958-cd89-4397-a169-c9eafbe5ec23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:23.967242 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d20958-cd89-4397-a169-c9eafbe5ec23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:24.026146 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d20958-cd89-4397-a169-c9eafbe5ec23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:24.027564 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d20958-cd89-4397-a169-c9eafbe5ec23 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:24.036771 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 806/1613] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:23 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:30.372697 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dccaf5-eca7-4b22-a429-25976ddaa5a8 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:30.439052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dccaf5-eca7-4b22-a429-25976ddaa5a8 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:30.444290 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d87e4-048a-42fe-908e-5b8918a936a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:30.444965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d87e4-048a-42fe-908e-5b8918a936a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:30.445327 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d87e4-048a-42fe-908e-5b8918a936a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:30.445603 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d87e4-048a-42fe-908e-5b8918a936a2 admin admin] PATH_INFO: `/v3/users/178b286fa1fb4af5b3c50639e21d480e` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:30.447378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d87e4-048a-42fe-908e-5b8918a936a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=178b286fa1fb4af5b3c50639e21d480e)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:30.449364 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d87e4-048a-42fe-908e-5b8918a936a2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:30.499573 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:30.503415 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ad1d87e4-048a-42fe-908e-5b8918a936a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '178b286fa1fb4af5b3c50639e21d480e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:30.504840 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ad1d87e4-048a-42fe-908e-5b8918a936a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '178b286fa1fb4af5b3c50639e21d480e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:30.506472 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ad1d87e4-048a-42fe-908e-5b8918a936a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '178b286fa1fb4af5b3c50639e21d480e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:30.516204 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ad1d87e4-048a-42fe-908e-5b8918a936a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '178b286fa1fb4af5b3c50639e21d480e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:30.525078 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ad1d87e4-048a-42fe-908e-5b8918a936a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '178b286fa1fb4af5b3c50639e21d480e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:30.545143 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 808/1614] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:30 2022] DELETE /identity/v3/users/178b286fa1fb4af5b3c50639e21d480e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:30.550890 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d87e4-048a-42fe-908e-5b8918a936a2 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:30.551423 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fbe5b-7105-497f-9b88-e61496e137f5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:30.551911 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fbe5b-7105-497f-9b88-e61496e137f5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:30.552000 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494fbe5b-7105-497f-9b88-e61496e137f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:30.552333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ad1d87e4-048a-42fe-908e-5b8918a936a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:30.572961 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-494fbe5b-7105-497f-9b88-e61496e137f5 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:30.574231 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-494fbe5b-7105-497f-9b88-e61496e137f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:30.627732 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d87e4-048a-42fe-908e-5b8918a936a2 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:30.636189 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220c717-b04d-4e2d-b9c7-bcb9ee52462e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:30.637380 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220c717-b04d-4e2d-b9c7-bcb9ee52462e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:30.637666 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220c717-b04d-4e2d-b9c7-bcb9ee52462e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:30.637939 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220c717-b04d-4e2d-b9c7-bcb9ee52462e admin admin] PATH_INFO: `/v3/users/fdb0dae65d4048ea854d742560355b84` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:30.639240 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220c717-b04d-4e2d-b9c7-bcb9ee52462e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb0dae65d4048ea854d742560355b84)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:30.651315 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220c717-b04d-4e2d-b9c7-bcb9ee52462e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:30.651511 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 807/1615] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:30.661324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fbe5b-7105-497f-9b88-e61496e137f5 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:30.663126 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-494fbe5b-7105-497f-9b88-e61496e137f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:30.714072 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c220c717-b04d-4e2d-b9c7-bcb9ee52462e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb0dae65d4048ea854d742560355b84'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:30.714528 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:30.715013 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c220c717-b04d-4e2d-b9c7-bcb9ee52462e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb0dae65d4048ea854d742560355b84'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:30.715810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c220c717-b04d-4e2d-b9c7-bcb9ee52462e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb0dae65d4048ea854d742560355b84'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:30.724111 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c220c717-b04d-4e2d-b9c7-bcb9ee52462e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb0dae65d4048ea854d742560355b84'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:30.732574 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c220c717-b04d-4e2d-b9c7-bcb9ee52462e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb0dae65d4048ea854d742560355b84'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:30.743751 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494fbe5b-7105-497f-9b88-e61496e137f5 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:30.754811 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 809/1616] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:30 2022] DELETE /identity/v3/users/fdb0dae65d4048ea854d742560355b84 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:33:30.757293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fa4ed-80de-4a5c-a29b-38c939046d22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:30.757933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fa4ed-80de-4a5c-a29b-38c939046d22 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:30.758216 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fa4ed-80de-4a5c-a29b-38c939046d22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:30.758491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fa4ed-80de-4a5c-a29b-38c939046d22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:30.759795 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eb55a-a2ce-457e-acb4-0138ccc23d44 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:30.760144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eb55a-a2ce-457e-acb4-0138ccc23d44 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:30.760318 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c52fa4ed-80de-4a5c-a29b-38c939046d22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:30.760690 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eb55a-a2ce-457e-acb4-0138ccc23d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:30.786402 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52fa4ed-80de-4a5c-a29b-38c939046d22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:30.788843 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52fa4ed-80de-4a5c-a29b-38c939046d22 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:30.789265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d00eb55a-a2ce-457e-acb4-0138ccc23d44 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:30.791296 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d00eb55a-a2ce-457e-acb4-0138ccc23d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:30.804493 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 808/1617] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:33:30.842820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:30.888149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 810/1618] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:30.903247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fa4ed-80de-4a5c-a29b-38c939046d22 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:30.906306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c52fa4ed-80de-4a5c-a29b-38c939046d22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:30.919355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fa4ed-80de-4a5c-a29b-38c939046d22 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:30.997459 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1239f-3336-434f-abcf-7f5409b8bedc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:30.998175 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1239f-3336-434f-abcf-7f5409b8bedc service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:30.998588 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1239f-3336-434f-abcf-7f5409b8bedc service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:30.998901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1239f-3336-434f-abcf-7f5409b8bedc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:31.013023 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1239f-3336-434f-abcf-7f5409b8bedc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:31.014881 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1239f-3336-434f-abcf-7f5409b8bedc service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:31.040446 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 809/1619] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:31.331959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00eb55a-a2ce-457e-acb4-0138ccc23d44 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:31.336413 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d00eb55a-a2ce-457e-acb4-0138ccc23d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:31.359365 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00eb55a-a2ce-457e-acb4-0138ccc23d44 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:31.370997 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dba13-73a2-49d7-a07b-5cc23f6bd2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:31.372453 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dba13-73a2-49d7-a07b-5cc23f6bd2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:31.372604 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dba13-73a2-49d7-a07b-5cc23f6bd2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:31.372863 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dba13-73a2-49d7-a07b-5cc23f6bd2ab admin admin] PATH_INFO: `/v3/projects/8da0dc5d9dd74c4c8d6ddf6b8da52d2c` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:31.374351 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dba13-73a2-49d7-a07b-5cc23f6bd2ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=8da0dc5d9dd74c4c8d6ddf6b8da52d2c)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:31.376819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dba13-73a2-49d7-a07b-5cc23f6bd2ab admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:31.428305 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8d2dba13-73a2-49d7-a07b-5cc23f6bd2ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8da0dc5d9dd74c4c8d6ddf6b8da52d2c', 'request_id': 'req-8d2dba13-73a2-49d7-a07b-5cc23f6bd2ab'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:31.434787 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8d2dba13-73a2-49d7-a07b-5cc23f6bd2ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8da0dc5d9dd74c4c8d6ddf6b8da52d2c', 'request_id': 'req-8d2dba13-73a2-49d7-a07b-5cc23f6bd2ab'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:31.441607 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8d2dba13-73a2-49d7-a07b-5cc23f6bd2ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8da0dc5d9dd74c4c8d6ddf6b8da52d2c', 'request_id': 'req-8d2dba13-73a2-49d7-a07b-5cc23f6bd2ab'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:31.455156 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8d2dba13-73a2-49d7-a07b-5cc23f6bd2ab admin admin] The token cache is being invalidate because project 8da0dc5d9dd74c4c8d6ddf6b8da52d2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:31.455446 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8d2dba13-73a2-49d7-a07b-5cc23f6bd2ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:31.456092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8d2dba13-73a2-49d7-a07b-5cc23f6bd2ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:31.457744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 811/1620] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:31 2022] DELETE /identity/v3/projects/8da0dc5d9dd74c4c8d6ddf6b8da52d2c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:31.462405 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1239f-3336-434f-abcf-7f5409b8bedc service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:31.472469 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1239f-3336-434f-abcf-7f5409b8bedc service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:31.488931 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dba13-73a2-49d7-a07b-5cc23f6bd2ab admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:31.490516 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8d2dba13-73a2-49d7-a07b-5cc23f6bd2ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:31.537887 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31441f-91da-4363-bbd7-7972deb61882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:31.538833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31441f-91da-4363-bbd7-7972deb61882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:31.539110 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31441f-91da-4363-bbd7-7972deb61882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:31.539330 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31441f-91da-4363-bbd7-7972deb61882 admin admin] PATH_INFO: `/v3/users/ac16a22adb8e44158c95a9fa64779ba4` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:31.540692 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31441f-91da-4363-bbd7-7972deb61882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac16a22adb8e44158c95a9fa64779ba4)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:31.543249 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31441f-91da-4363-bbd7-7972deb61882 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:31.564298 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dba13-73a2-49d7-a07b-5cc23f6bd2ab admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:31.569708 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67684f8-a744-4378-b78b-6d68f8181187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:31.570555 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67684f8-a744-4378-b78b-6d68f8181187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:31.571089 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67684f8-a744-4378-b78b-6d68f8181187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:31.572048 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67684f8-a744-4378-b78b-6d68f8181187 admin admin] PATH_INFO: `/v3/projects/e76be1cc37004c7b8d818b40e5dff0ec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:31.573715 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67684f8-a744-4378-b78b-6d68f8181187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76be1cc37004c7b8d818b40e5dff0ec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:31.575773 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67684f8-a744-4378-b78b-6d68f8181187 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:31.592819 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ab31441f-91da-4363-bbd7-7972deb61882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac16a22adb8e44158c95a9fa64779ba4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:31.600060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ab31441f-91da-4363-bbd7-7972deb61882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac16a22adb8e44158c95a9fa64779ba4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:31.600663 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ab31441f-91da-4363-bbd7-7972deb61882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac16a22adb8e44158c95a9fa64779ba4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:31.614513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ab31441f-91da-4363-bbd7-7972deb61882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac16a22adb8e44158c95a9fa64779ba4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:31.619590 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:31.623337 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ab31441f-91da-4363-bbd7-7972deb61882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac16a22adb8e44158c95a9fa64779ba4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:31.628908 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d67684f8-a744-4378-b78b-6d68f8181187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76be1cc37004c7b8d818b40e5dff0ec', 'request_id': 'req-d67684f8-a744-4378-b78b-6d68f8181187'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:31.631101 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 810/1621] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:31 2022] DELETE /identity/v3/users/ac16a22adb8e44158c95a9fa64779ba4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:31.636778 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d67684f8-a744-4378-b78b-6d68f8181187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76be1cc37004c7b8d818b40e5dff0ec', 'request_id': 'req-d67684f8-a744-4378-b78b-6d68f8181187'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:31.643507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d67684f8-a744-4378-b78b-6d68f8181187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76be1cc37004c7b8d818b40e5dff0ec', 'request_id': 'req-d67684f8-a744-4378-b78b-6d68f8181187'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:31.646092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:31.659370 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d67684f8-a744-4378-b78b-6d68f8181187 admin admin] The token cache is being invalidate because project e76be1cc37004c7b8d818b40e5dff0ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:31.659370 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d67684f8-a744-4378-b78b-6d68f8181187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:31.659370 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d67684f8-a744-4378-b78b-6d68f8181187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:31.660465 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 812/1622] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:31 2022] DELETE /identity/v3/projects/e76be1cc37004c7b8d818b40e5dff0ec => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:33:31.664587 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31441f-91da-4363-bbd7-7972deb61882 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:31.666549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ab31441f-91da-4363-bbd7-7972deb61882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:31.763518 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31441f-91da-4363-bbd7-7972deb61882 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:31.786613 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6687ab-092f-464b-a7b2-c8af7742e02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:31.787564 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6687ab-092f-464b-a7b2-c8af7742e02b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:31.788100 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6687ab-092f-464b-a7b2-c8af7742e02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:31.788862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6687ab-092f-464b-a7b2-c8af7742e02b admin admin] PATH_INFO: `/v3/users/c12491ec69aa48a79668345ef37e0083` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:31.790946 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6687ab-092f-464b-a7b2-c8af7742e02b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c12491ec69aa48a79668345ef37e0083)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:31.795179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6687ab-092f-464b-a7b2-c8af7742e02b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:31.858953 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5e6687ab-092f-464b-a7b2-c8af7742e02b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c12491ec69aa48a79668345ef37e0083'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:31.869665 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5e6687ab-092f-464b-a7b2-c8af7742e02b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c12491ec69aa48a79668345ef37e0083'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:31.870350 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5e6687ab-092f-464b-a7b2-c8af7742e02b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c12491ec69aa48a79668345ef37e0083'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:31.885096 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5e6687ab-092f-464b-a7b2-c8af7742e02b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c12491ec69aa48a79668345ef37e0083'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:31.893644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5e6687ab-092f-464b-a7b2-c8af7742e02b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c12491ec69aa48a79668345ef37e0083'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:31.900955 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 811/1623] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:31 2022] DELETE /identity/v3/users/c12491ec69aa48a79668345ef37e0083 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:31.987478 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67684f8-a744-4378-b78b-6d68f8181187 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:31.988887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d67684f8-a744-4378-b78b-6d68f8181187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:32.101790 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67684f8-a744-4378-b78b-6d68f8181187 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:32.171024 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8da9f-2ffb-4f5f-b98d-af0f34e864bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:32.171670 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8da9f-2ffb-4f5f-b98d-af0f34e864bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:32.171967 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8da9f-2ffb-4f5f-b98d-af0f34e864bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:32.172228 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8da9f-2ffb-4f5f-b98d-af0f34e864bd admin admin] PATH_INFO: `/v3/projects/4b8ffb2f1f03412b89bd40d4c5c66735` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:32.173418 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8da9f-2ffb-4f5f-b98d-af0f34e864bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b8ffb2f1f03412b89bd40d4c5c66735)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:32.175532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8da9f-2ffb-4f5f-b98d-af0f34e864bd admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:32.193586 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6687ab-092f-464b-a7b2-c8af7742e02b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:32.195190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5e6687ab-092f-464b-a7b2-c8af7742e02b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:32.213947 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6687ab-092f-464b-a7b2-c8af7742e02b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:32.219387 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ca5e6-f1ac-4ec2-ae5a-70118cdb983d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:32.220068 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ca5e6-f1ac-4ec2-ae5a-70118cdb983d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:32.220355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ca5e6-f1ac-4ec2-ae5a-70118cdb983d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:32.220657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ca5e6-f1ac-4ec2-ae5a-70118cdb983d admin admin] PATH_INFO: `/v3/users/f0126cedaa634f2786c122a082b72ab1` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:32.222014 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ca5e6-f1ac-4ec2-ae5a-70118cdb983d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0126cedaa634f2786c122a082b72ab1)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:32.223818 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ca5e6-f1ac-4ec2-ae5a-70118cdb983d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:32.241664 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-aaa8da9f-2ffb-4f5f-b98d-af0f34e864bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b8ffb2f1f03412b89bd40d4c5c66735', 'request_id': 'req-aaa8da9f-2ffb-4f5f-b98d-af0f34e864bd'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:32.251527 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-aaa8da9f-2ffb-4f5f-b98d-af0f34e864bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b8ffb2f1f03412b89bd40d4c5c66735', 'request_id': 'req-aaa8da9f-2ffb-4f5f-b98d-af0f34e864bd'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:32.264420 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-aaa8da9f-2ffb-4f5f-b98d-af0f34e864bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b8ffb2f1f03412b89bd40d4c5c66735', 'request_id': 'req-aaa8da9f-2ffb-4f5f-b98d-af0f34e864bd'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:32.282448 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-aaa8da9f-2ffb-4f5f-b98d-af0f34e864bd admin admin] The token cache is being invalidate because project 4b8ffb2f1f03412b89bd40d4c5c66735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:32.282611 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-aaa8da9f-2ffb-4f5f-b98d-af0f34e864bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:32.282704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3a9ca5e6-f1ac-4ec2-ae5a-70118cdb983d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0126cedaa634f2786c122a082b72ab1'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:32.283238 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-aaa8da9f-2ffb-4f5f-b98d-af0f34e864bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:32.284915 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 813/1624] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:31 2022] DELETE /identity/v3/projects/4b8ffb2f1f03412b89bd40d4c5c66735 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:32.286942 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8da9f-2ffb-4f5f-b98d-af0f34e864bd admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:32.288951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-aaa8da9f-2ffb-4f5f-b98d-af0f34e864bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:32.295778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3a9ca5e6-f1ac-4ec2-ae5a-70118cdb983d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0126cedaa634f2786c122a082b72ab1'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:32.296497 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3a9ca5e6-f1ac-4ec2-ae5a-70118cdb983d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0126cedaa634f2786c122a082b72ab1'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:32.308431 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:32.311121 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3a9ca5e6-f1ac-4ec2-ae5a-70118cdb983d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0126cedaa634f2786c122a082b72ab1'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:32.319921 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3a9ca5e6-f1ac-4ec2-ae5a-70118cdb983d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0126cedaa634f2786c122a082b72ab1'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:32.326380 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 812/1625] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:32 2022] DELETE /identity/v3/users/f0126cedaa634f2786c122a082b72ab1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:33:32.327719 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29e89b-89ce-4042-886f-e5cade28aec7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:32.328010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29e89b-89ce-4042-886f-e5cade28aec7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:32.328284 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29e89b-89ce-4042-886f-e5cade28aec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:32.331130 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:32.348484 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ad29e89b-89ce-4042-886f-e5cade28aec7 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:32.349750 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ad29e89b-89ce-4042-886f-e5cade28aec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:32.365895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8da9f-2ffb-4f5f-b98d-af0f34e864bd admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:32.420118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 813/1626] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:32.421532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06364b-0cee-4fbd-be9e-63137d601e73 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:32.421822 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06364b-0cee-4fbd-be9e-63137d601e73 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:32.422231 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06364b-0cee-4fbd-be9e-63137d601e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:32.435191 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425ee40-7e00-4bb5-a58a-e57bbaf5b7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:32.436565 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425ee40-7e00-4bb5-a58a-e57bbaf5b7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:32.436986 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425ee40-7e00-4bb5-a58a-e57bbaf5b7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:32.437428 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425ee40-7e00-4bb5-a58a-e57bbaf5b7a8 admin admin] PATH_INFO: `/v3/projects/4d02c991499b4dbc8d204e85420d6630` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:32.438583 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425ee40-7e00-4bb5-a58a-e57bbaf5b7a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d02c991499b4dbc8d204e85420d6630)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:32.440460 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425ee40-7e00-4bb5-a58a-e57bbaf5b7a8 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:32.443407 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ca06364b-0cee-4fbd-be9e-63137d601e73 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:32.444750 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ca06364b-0cee-4fbd-be9e-63137d601e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:32.454183 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 814/1627] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:32.455961 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6677e6e-b386-41d1-af2a-ab281c4576c9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:32.456256 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6677e6e-b386-41d1-af2a-ab281c4576c9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:32.456464 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6677e6e-b386-41d1-af2a-ab281c4576c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:32.483278 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c6677e6e-b386-41d1-af2a-ab281c4576c9 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:32.484548 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c6677e6e-b386-41d1-af2a-ab281c4576c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:32.502445 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8425ee40-7e00-4bb5-a58a-e57bbaf5b7a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d02c991499b4dbc8d204e85420d6630', 'request_id': 'req-8425ee40-7e00-4bb5-a58a-e57bbaf5b7a8'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:32.509971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8425ee40-7e00-4bb5-a58a-e57bbaf5b7a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d02c991499b4dbc8d204e85420d6630', 'request_id': 'req-8425ee40-7e00-4bb5-a58a-e57bbaf5b7a8'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:32.516942 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8425ee40-7e00-4bb5-a58a-e57bbaf5b7a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d02c991499b4dbc8d204e85420d6630', 'request_id': 'req-8425ee40-7e00-4bb5-a58a-e57bbaf5b7a8'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:32.530739 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8425ee40-7e00-4bb5-a58a-e57bbaf5b7a8 admin admin] The token cache is being invalidate because project 4d02c991499b4dbc8d204e85420d6630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:32.531048 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8425ee40-7e00-4bb5-a58a-e57bbaf5b7a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:32.531686 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8425ee40-7e00-4bb5-a58a-e57bbaf5b7a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:32.533226 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 814/1628] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:32 2022] DELETE /identity/v3/projects/4d02c991499b4dbc8d204e85420d6630 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:32.534002 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425ee40-7e00-4bb5-a58a-e57bbaf5b7a8 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:32.535714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8425ee40-7e00-4bb5-a58a-e57bbaf5b7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:32.552077 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 815/1629] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:32.553484 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a90c20-15be-465b-87f5-db9c992efc19 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:32.553845 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a90c20-15be-465b-87f5-db9c992efc19 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:32.554192 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a90c20-15be-465b-87f5-db9c992efc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:32.574075 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-09a90c20-15be-465b-87f5-db9c992efc19 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:32.575369 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-09a90c20-15be-465b-87f5-db9c992efc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:32.583465 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 816/1630] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:32.584294 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a90c20-15be-465b-87f5-db9c992efc19 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:32.594898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a90c20-15be-465b-87f5-db9c992efc19 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:32.599540 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378abaf1-e3bd-4df2-9361-09c0a7e9c3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:32.600135 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378abaf1-e3bd-4df2-9361-09c0a7e9c3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:32.600420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378abaf1-e3bd-4df2-9361-09c0a7e9c3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:32.600697 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378abaf1-e3bd-4df2-9361-09c0a7e9c3f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:32.601374 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378abaf1-e3bd-4df2-9361-09c0a7e9c3f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:33:32.601677 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378abaf1-e3bd-4df2-9361-09c0a7e9c3f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:32.602914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425ee40-7e00-4bb5-a58a-e57bbaf5b7a8 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:32.603307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378abaf1-e3bd-4df2-9361-09c0a7e9c3f5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:32.606736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81d43c-7807-4a64-b936-6ac3cedd24c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:32.607426 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81d43c-7807-4a64-b936-6ac3cedd24c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:32.607825 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81d43c-7807-4a64-b936-6ac3cedd24c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:32.608003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81d43c-7807-4a64-b936-6ac3cedd24c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:32.609806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-bb81d43c-7807-4a64-b936-6ac3cedd24c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:32.616361 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 817/1631] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:33:32.617596 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6965c1-0951-4f77-bc24-7f24f71869be None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:32.617887 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6965c1-0951-4f77-bc24-7f24f71869be None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:32.618193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6965c1-0951-4f77-bc24-7f24f71869be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:32.626130 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81d43c-7807-4a64-b936-6ac3cedd24c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:32.627645 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81d43c-7807-4a64-b936-6ac3cedd24c7 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:32.637963 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 815/1632] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:32.638741 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81d43c-7807-4a64-b936-6ac3cedd24c7 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:32.639187 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6c6965c1-0951-4f77-bc24-7f24f71869be None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:32.640451 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6c6965c1-0951-4f77-bc24-7f24f71869be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:32.649026 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81d43c-7807-4a64-b936-6ac3cedd24c7 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:32.650416 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 818/1633] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:32.654645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6965c1-0951-4f77-bc24-7f24f71869be None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:32.655281 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed8e79-b7ca-47b5-89cf-d7132facc8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:32.656054 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed8e79-b7ca-47b5-89cf-d7132facc8bf admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:32.656545 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed8e79-b7ca-47b5-89cf-d7132facc8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:32.656780 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed8e79-b7ca-47b5-89cf-d7132facc8bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:32.657440 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed8e79-b7ca-47b5-89cf-d7132facc8bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:32.659728 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed8e79-b7ca-47b5-89cf-d7132facc8bf admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:32.664438 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6965c1-0951-4f77-bc24-7f24f71869be None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:32.670500 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56077a00-e9ff-459e-803e-685416909646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:32.670676 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:32.671119 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56077a00-e9ff-459e-803e-685416909646 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:32.671404 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56077a00-e9ff-459e-803e-685416909646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:32.671704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56077a00-e9ff-459e-803e-685416909646 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:32.672453 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56077a00-e9ff-459e-803e-685416909646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:33:32.672764 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56077a00-e9ff-459e-803e-685416909646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:32.674603 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56077a00-e9ff-459e-803e-685416909646 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:32.690648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 819/1634] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:33:32.695272 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56077a00-e9ff-459e-803e-685416909646 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:32.698305 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 816/1635] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:32 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:32.703125 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed8e79-b7ca-47b5-89cf-d7132facc8bf admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:32.706186 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56077a00-e9ff-459e-803e-685416909646 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:32.763234 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:32.773583 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed8e79-b7ca-47b5-89cf-d7132facc8bf admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:32.778502 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458e91d-43db-4d65-b857-cde98cd6f550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:32.779142 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458e91d-43db-4d65-b857-cde98cd6f550 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:32.779427 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458e91d-43db-4d65-b857-cde98cd6f550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:32.779699 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458e91d-43db-4d65-b857-cde98cd6f550 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:32.780332 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458e91d-43db-4d65-b857-cde98cd6f550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:32.782297 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458e91d-43db-4d65-b857-cde98cd6f550 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:32.786975 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca9bc7-500f-4842-a3bd-e45e0a8cb555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:32.787897 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca9bc7-500f-4842-a3bd-e45e0a8cb555 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:32.788319 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca9bc7-500f-4842-a3bd-e45e0a8cb555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:32.789101 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca9bc7-500f-4842-a3bd-e45e0a8cb555 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:32.790015 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca9bc7-500f-4842-a3bd-e45e0a8cb555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:32.792478 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca9bc7-500f-4842-a3bd-e45e0a8cb555 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:32.806635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 817/1636] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:32 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:33:32.810542 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458e91d-43db-4d65-b857-cde98cd6f550 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:32.820362 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458e91d-43db-4d65-b857-cde98cd6f550 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:32.826009 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f13dd9-c2d5-498d-97e2-18bb4a57a6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:32.826622 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f13dd9-c2d5-498d-97e2-18bb4a57a6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:32.827024 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f13dd9-c2d5-498d-97e2-18bb4a57a6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:32.827314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f13dd9-c2d5-498d-97e2-18bb4a57a6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:32.827881 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f13dd9-c2d5-498d-97e2-18bb4a57a6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:32.829625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f13dd9-c2d5-498d-97e2-18bb4a57a6d0 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:32.841154 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 818/1637] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:33:32.845055 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f13dd9-c2d5-498d-97e2-18bb4a57a6d0 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:32.847680 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 820/1638] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:32 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:33:32.852666 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca9bc7-500f-4842-a3bd-e45e0a8cb555 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:32.857355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f13dd9-c2d5-498d-97e2-18bb4a57a6d0 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:32.920950 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca752a91-7c66-4842-85eb-0ab5b4f7a7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:32.921704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca752a91-7c66-4842-85eb-0ab5b4f7a7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:32.921990 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca752a91-7c66-4842-85eb-0ab5b4f7a7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:32.922262 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca752a91-7c66-4842-85eb-0ab5b4f7a7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:32.922905 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca752a91-7c66-4842-85eb-0ab5b4f7a7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:32.924523 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca752a91-7c66-4842-85eb-0ab5b4f7a7b2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:32.927402 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca9bc7-500f-4842-a3bd-e45e0a8cb555 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:32.934858 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fba7c-3fa8-44d2-93f4-36a13f590f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:32.940065 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 819/1639] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:33:32.940204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fba7c-3fa8-44d2-93f4-36a13f590f93 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:32.940204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fba7c-3fa8-44d2-93f4-36a13f590f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:32.940204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fba7c-3fa8-44d2-93f4-36a13f590f93 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:32.940204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fba7c-3fa8-44d2-93f4-36a13f590f93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:32.940936 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fba7c-3fa8-44d2-93f4-36a13f590f93 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:32.944249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca752a91-7c66-4842-85eb-0ab5b4f7a7b2 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:32.958579 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca752a91-7c66-4842-85eb-0ab5b4f7a7b2 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:32.967245 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c1397-d3f3-49ec-964f-2423950af90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:32.967245 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c1397-d3f3-49ec-964f-2423950af90d admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:32.967245 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c1397-d3f3-49ec-964f-2423950af90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:32.967245 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c1397-d3f3-49ec-964f-2423950af90d admin admin] PATH_INFO: `/v3/projects/b193112b6e694350b4c0d925906a739e/users/ec3c7ffcc4b34274a0e0e6583af747a2/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:32.977572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 821/1640] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:32 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:33:32.978615 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fba7c-3fa8-44d2-93f4-36a13f590f93 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:32.980232 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-972fba7c-3fa8-44d2-93f4-36a13f590f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:32.989878 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c1397-d3f3-49ec-964f-2423950af90d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b193112b6e694350b4c0d925906a739e, user_id=ec3c7ffcc4b34274a0e0e6583af747a2, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:32.992554 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fba7c-3fa8-44d2-93f4-36a13f590f93 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:32.993880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c1397-d3f3-49ec-964f-2423950af90d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:32.998925 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de4621-6c2c-4d59-8772-50b0197939a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:32.999652 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de4621-6c2c-4d59-8772-50b0197939a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:33.000529 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de4621-6c2c-4d59-8772-50b0197939a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:33.000529 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de4621-6c2c-4d59-8772-50b0197939a8 admin admin] PATH_INFO: `/v3/projects/196668eccf58421ebb1d54d07956cdac` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:33.001485 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de4621-6c2c-4d59-8772-50b0197939a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=196668eccf58421ebb1d54d07956cdac)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:33.003412 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de4621-6c2c-4d59-8772-50b0197939a8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:33.022136 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 820/1641] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:32 2022] PUT /identity/v3/projects/b193112b6e694350b4c0d925906a739e/users/ec3c7ffcc4b34274a0e0e6583af747a2/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:33.022136 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c1397-d3f3-49ec-964f-2423950af90d admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:33.060727 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c9de4621-6c2c-4d59-8772-50b0197939a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '196668eccf58421ebb1d54d07956cdac', 'request_id': 'req-c9de4621-6c2c-4d59-8772-50b0197939a8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:33.078550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c9de4621-6c2c-4d59-8772-50b0197939a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '196668eccf58421ebb1d54d07956cdac', 'request_id': 'req-c9de4621-6c2c-4d59-8772-50b0197939a8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:33.084716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:33.089510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c9de4621-6c2c-4d59-8772-50b0197939a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '196668eccf58421ebb1d54d07956cdac', 'request_id': 'req-c9de4621-6c2c-4d59-8772-50b0197939a8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:33.103897 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c9de4621-6c2c-4d59-8772-50b0197939a8 admin admin] The token cache is being invalidate because project 196668eccf58421ebb1d54d07956cdac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:33.104190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c9de4621-6c2c-4d59-8772-50b0197939a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:33.104856 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c9de4621-6c2c-4d59-8772-50b0197939a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:33.106402 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 822/1642] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:32 2022] DELETE /identity/v3/projects/196668eccf58421ebb1d54d07956cdac => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:33.111661 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f896dae-9cdf-488a-99e8-36edef2a5eab None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:33.111952 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f896dae-9cdf-488a-99e8-36edef2a5eab None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:33.112229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f896dae-9cdf-488a-99e8-36edef2a5eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:33.112571 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c1397-d3f3-49ec-964f-2423950af90d admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:33.144904 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6f896dae-9cdf-488a-99e8-36edef2a5eab None None] MFA Rules not processed for user `ec3c7ffcc4b34274a0e0e6583af747a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:33.146209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6f896dae-9cdf-488a-99e8-36edef2a5eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:33.172944 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:33.180391 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b4da8-fdab-4d80-a2b9-86ad4d0aed15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:33.181688 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b4da8-fdab-4d80-a2b9-86ad4d0aed15 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:33.182075 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b4da8-fdab-4d80-a2b9-86ad4d0aed15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:33.182349 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b4da8-fdab-4d80-a2b9-86ad4d0aed15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:33.183291 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b4da8-fdab-4d80-a2b9-86ad4d0aed15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:33.184879 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b4da8-fdab-4d80-a2b9-86ad4d0aed15 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:33.194932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 821/1643] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:33.196192 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454155e7-494f-4ebc-bf97-95876d4d4f65 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:33.196513 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454155e7-494f-4ebc-bf97-95876d4d4f65 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:33.196796 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454155e7-494f-4ebc-bf97-95876d4d4f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:33.214157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 823/1644] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:33.216411 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-454155e7-494f-4ebc-bf97-95876d4d4f65 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:33.217659 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-454155e7-494f-4ebc-bf97-95876d4d4f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:33.218070 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f896dae-9cdf-488a-99e8-36edef2a5eab None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:33.219375 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6f896dae-9cdf-488a-99e8-36edef2a5eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:33.228748 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 822/1645] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:33.229630 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454155e7-494f-4ebc-bf97-95876d4d4f65 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:33.230885 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-454155e7-494f-4ebc-bf97-95876d4d4f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:33.238226 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f896dae-9cdf-488a-99e8-36edef2a5eab None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:33.243243 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c5876-fd5a-48b5-a906-829e1bb975d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:33.244341 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c5876-fd5a-48b5-a906-829e1bb975d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:33.244620 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c5876-fd5a-48b5-a906-829e1bb975d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:33.244895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c5876-fd5a-48b5-a906-829e1bb975d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:33.245570 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c5876-fd5a-48b5-a906-829e1bb975d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:33.247145 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c5876-fd5a-48b5-a906-829e1bb975d4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:33.257384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 824/1646] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:33.257384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a588702-2b12-4b16-a1c0-0758993e7e33 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:33.257384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a588702-2b12-4b16-a1c0-0758993e7e33 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:33.257384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a588702-2b12-4b16-a1c0-0758993e7e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:33.278231 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3a588702-2b12-4b16-a1c0-0758993e7e33 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:33.279425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3a588702-2b12-4b16-a1c0-0758993e7e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:33.288268 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 825/1647] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:33.289569 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a588702-2b12-4b16-a1c0-0758993e7e33 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:33.292141 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454155e7-494f-4ebc-bf97-95876d4d4f65 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:33.296102 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03749f-f1bc-46ec-80ac-afc687a41a07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:33.296865 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03749f-f1bc-46ec-80ac-afc687a41a07 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:33.297077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03749f-f1bc-46ec-80ac-afc687a41a07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:33.297291 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03749f-f1bc-46ec-80ac-afc687a41a07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:33.301279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a588702-2b12-4b16-a1c0-0758993e7e33 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:33.306942 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03749f-f1bc-46ec-80ac-afc687a41a07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:33.308362 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03749f-f1bc-46ec-80ac-afc687a41a07 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:33.309349 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e5089-abd6-4387-9831-9ea61b916383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:33.310010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e5089-abd6-4387-9831-9ea61b916383 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:33.310288 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e5089-abd6-4387-9831-9ea61b916383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:33.310562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e5089-abd6-4387-9831-9ea61b916383 admin admin] PATH_INFO: `/v3/projects/535dfc394c5144dabba40dc8e02cc4a2/users/9439a51e91454af2b6a1c794b765155a/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:33.317821 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 823/1648] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:33.322830 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03749f-f1bc-46ec-80ac-afc687a41a07 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:33.338275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03749f-f1bc-46ec-80ac-afc687a41a07 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:33.339761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e5089-abd6-4387-9831-9ea61b916383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=535dfc394c5144dabba40dc8e02cc4a2, user_id=9439a51e91454af2b6a1c794b765155a, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:33.342482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e5089-abd6-4387-9831-9ea61b916383 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:33.342683 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabcff1-8dde-4ae4-8e12-5f75db087421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:33.343345 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabcff1-8dde-4ae4-8e12-5f75db087421 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:33.343777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabcff1-8dde-4ae4-8e12-5f75db087421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:33.343881 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabcff1-8dde-4ae4-8e12-5f75db087421 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:33.344515 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabcff1-8dde-4ae4-8e12-5f75db087421 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:33:33.344811 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabcff1-8dde-4ae4-8e12-5f75db087421 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:33.346466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabcff1-8dde-4ae4-8e12-5f75db087421 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:33.361396 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 824/1649] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:33:33.362397 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabcff1-8dde-4ae4-8e12-5f75db087421 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:33.366779 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1aabcff1-8dde-4ae4-8e12-5f75db087421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:33.372499 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 826/1650] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:33 2022] PUT /identity/v3/projects/535dfc394c5144dabba40dc8e02cc4a2/users/9439a51e91454af2b6a1c794b765155a/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:33.373873 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e5089-abd6-4387-9831-9ea61b916383 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:33.391454 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabcff1-8dde-4ae4-8e12-5f75db087421 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:33.458709 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153ba4b-a232-4055-be11-78cbd9b4d50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:33.459384 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153ba4b-a232-4055-be11-78cbd9b4d50c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:33.459642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153ba4b-a232-4055-be11-78cbd9b4d50c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:33.459920 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153ba4b-a232-4055-be11-78cbd9b4d50c admin admin] PATH_INFO: `/v3/users/ec3c7ffcc4b34274a0e0e6583af747a2` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:33.461098 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153ba4b-a232-4055-be11-78cbd9b4d50c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec3c7ffcc4b34274a0e0e6583af747a2)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:33.463088 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153ba4b-a232-4055-be11-78cbd9b4d50c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:33.464479 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e5089-abd6-4387-9831-9ea61b916383 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:33.469573 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:33.473943 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171d099-a2f0-4eac-9f03-b94568b02c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:33.475504 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171d099-a2f0-4eac-9f03-b94568b02c79 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:33.475942 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171d099-a2f0-4eac-9f03-b94568b02c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:33.476395 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171d099-a2f0-4eac-9f03-b94568b02c79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:33.478040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171d099-a2f0-4eac-9f03-b94568b02c79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:33.480446 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171d099-a2f0-4eac-9f03-b94568b02c79 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:33.509333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 827/1651] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:33 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:33.510647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1e601-8fa6-4818-8939-7ca38c783760 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:33.510938 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1e601-8fa6-4818-8939-7ca38c783760 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:33.511208 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1e601-8fa6-4818-8939-7ca38c783760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:33.512329 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e153ba4b-a232-4055-be11-78cbd9b4d50c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec3c7ffcc4b34274a0e0e6583af747a2'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:33.513264 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e153ba4b-a232-4055-be11-78cbd9b4d50c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec3c7ffcc4b34274a0e0e6583af747a2'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:33.514070 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e153ba4b-a232-4055-be11-78cbd9b4d50c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec3c7ffcc4b34274a0e0e6583af747a2'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:33.521476 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e153ba4b-a232-4055-be11-78cbd9b4d50c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec3c7ffcc4b34274a0e0e6583af747a2'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:33.533490 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e153ba4b-a232-4055-be11-78cbd9b4d50c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec3c7ffcc4b34274a0e0e6583af747a2'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:33.545133 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-10f1e601-8fa6-4818-8939-7ca38c783760 None None] MFA Rules not processed for user `9439a51e91454af2b6a1c794b765155a`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:33.546364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-10f1e601-8fa6-4818-8939-7ca38c783760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:33.557233 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 825/1652] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:33 2022] DELETE /identity/v3/users/ec3c7ffcc4b34274a0e0e6583af747a2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:33.560102 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153ba4b-a232-4055-be11-78cbd9b4d50c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:33.560102 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e153ba4b-a232-4055-be11-78cbd9b4d50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:33.613025 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:33.621825 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 828/1653] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:33.621825 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1e601-8fa6-4818-8939-7ca38c783760 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:33.621825 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-10f1e601-8fa6-4818-8939-7ca38c783760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:33.625965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153ba4b-a232-4055-be11-78cbd9b4d50c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:33.630615 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99324f96-1dbb-4e17-aea2-cf82741917d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:33.631226 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99324f96-1dbb-4e17-aea2-cf82741917d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:33.631572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99324f96-1dbb-4e17-aea2-cf82741917d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:33.631843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99324f96-1dbb-4e17-aea2-cf82741917d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:33.632547 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99324f96-1dbb-4e17-aea2-cf82741917d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:33.634609 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99324f96-1dbb-4e17-aea2-cf82741917d4 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:33.656603 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 826/1654] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:33 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:33.657859 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0c73c-10ff-4d36-8fce-25a7eb99c5a8 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:33.658140 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0c73c-10ff-4d36-8fce-25a7eb99c5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:33.658409 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0c73c-10ff-4d36-8fce-25a7eb99c5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:33.678304 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-52b0c73c-10ff-4d36-8fce-25a7eb99c5a8 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:33.679493 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-52b0c73c-10ff-4d36-8fce-25a7eb99c5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:33.687001 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 827/1655] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:33.687735 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0c73c-10ff-4d36-8fce-25a7eb99c5a8 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:33.688934 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-52b0c73c-10ff-4d36-8fce-25a7eb99c5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:33.698254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1e601-8fa6-4818-8939-7ca38c783760 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:33.700600 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0c73c-10ff-4d36-8fce-25a7eb99c5a8 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:33.702949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c652ea-1f0c-4f71-884e-6950300e940e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:33.703698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c652ea-1f0c-4f71-884e-6950300e940e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:33.703984 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c652ea-1f0c-4f71-884e-6950300e940e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:33.704256 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c652ea-1f0c-4f71-884e-6950300e940e admin admin] PATH_INFO: `/v3/users/3f2f3130c12f46bc9839fe85defaac13` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:33.705322 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3aead-3bf6-49ba-a7d5-fe261abe6651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:33.705458 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c652ea-1f0c-4f71-884e-6950300e940e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f2f3130c12f46bc9839fe85defaac13)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:33.705907 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3aead-3bf6-49ba-a7d5-fe261abe6651 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:33.706955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3aead-3bf6-49ba-a7d5-fe261abe6651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:33.707179 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3aead-3bf6-49ba-a7d5-fe261abe6651 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:33.707596 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c652ea-1f0c-4f71-884e-6950300e940e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:33.708217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3aead-3bf6-49ba-a7d5-fe261abe6651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:33.710458 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3aead-3bf6-49ba-a7d5-fe261abe6651 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:33.739867 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 828/1656] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:33 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:33.739867 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3aead-3bf6-49ba-a7d5-fe261abe6651 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:33.760072 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-45c652ea-1f0c-4f71-884e-6950300e940e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f2f3130c12f46bc9839fe85defaac13'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:33.767564 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-45c652ea-1f0c-4f71-884e-6950300e940e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f2f3130c12f46bc9839fe85defaac13'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:33.768229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-45c652ea-1f0c-4f71-884e-6950300e940e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f2f3130c12f46bc9839fe85defaac13'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:33.782564 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-45c652ea-1f0c-4f71-884e-6950300e940e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f2f3130c12f46bc9839fe85defaac13'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:33.789551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-45c652ea-1f0c-4f71-884e-6950300e940e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f2f3130c12f46bc9839fe85defaac13'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:33.792651 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:33.796387 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 829/1657] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:33 2022] DELETE /identity/v3/users/3f2f3130c12f46bc9839fe85defaac13 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:33.797119 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c652ea-1f0c-4f71-884e-6950300e940e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:33.798477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-45c652ea-1f0c-4f71-884e-6950300e940e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:33.811612 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3aead-3bf6-49ba-a7d5-fe261abe6651 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:33.853883 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c652ea-1f0c-4f71-884e-6950300e940e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:33.857650 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a73f6-70e2-4c08-9d7c-5ca8b2616532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:33.858186 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a73f6-70e2-4c08-9d7c-5ca8b2616532 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:33.858463 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a73f6-70e2-4c08-9d7c-5ca8b2616532 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:33.858733 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a73f6-70e2-4c08-9d7c-5ca8b2616532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:33.860480 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ea3a73f6-70e2-4c08-9d7c-5ca8b2616532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:33.869242 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e930713-f6bb-4580-8a64-95eb0953bd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:33.869934 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e930713-f6bb-4580-8a64-95eb0953bd25 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:33.870164 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e930713-f6bb-4580-8a64-95eb0953bd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:33.870832 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e930713-f6bb-4580-8a64-95eb0953bd25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:33.871116 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e930713-f6bb-4580-8a64-95eb0953bd25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:33.872701 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e930713-f6bb-4580-8a64-95eb0953bd25 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:33.882723 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 829/1658] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:33.884724 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e930713-f6bb-4580-8a64-95eb0953bd25 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:33.886869 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5e930713-f6bb-4580-8a64-95eb0953bd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:33.894062 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:33.901275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e930713-f6bb-4580-8a64-95eb0953bd25 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:33.907307 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36eebab-dea6-4f62-a473-a39554d2388b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:33.908067 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36eebab-dea6-4f62-a473-a39554d2388b admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:33.908582 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36eebab-dea6-4f62-a473-a39554d2388b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:33.908693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36eebab-dea6-4f62-a473-a39554d2388b admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:33.909382 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36eebab-dea6-4f62-a473-a39554d2388b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:33.911583 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36eebab-dea6-4f62-a473-a39554d2388b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:33.930902 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a73f6-70e2-4c08-9d7c-5ca8b2616532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:33.932463 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a73f6-70e2-4c08-9d7c-5ca8b2616532 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:33.937150 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 830/1659] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:33 2022] POST /identity/v3/users => generated 290 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:33.937726 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c75a61-9d8f-4f96-b6a6-192702d54873 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:33.938092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c75a61-9d8f-4f96-b6a6-192702d54873 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:33.938442 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c75a61-9d8f-4f96-b6a6-192702d54873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:33.947837 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 830/1660] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:33.949226 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a73f6-70e2-4c08-9d7c-5ca8b2616532 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:33.950628 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ea3a73f6-70e2-4c08-9d7c-5ca8b2616532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:33.959255 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-76c75a61-9d8f-4f96-b6a6-192702d54873 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:33.960648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-76c75a61-9d8f-4f96-b6a6-192702d54873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:33.964054 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a73f6-70e2-4c08-9d7c-5ca8b2616532 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:33.969018 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 831/1661] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:33.969863 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c75a61-9d8f-4f96-b6a6-192702d54873 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:33.981640 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602eda87-0143-46fd-9d7d-9b4a81138302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:33.982304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602eda87-0143-46fd-9d7d-9b4a81138302 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:33.983185 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602eda87-0143-46fd-9d7d-9b4a81138302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:33.983473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602eda87-0143-46fd-9d7d-9b4a81138302 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:33.984143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602eda87-0143-46fd-9d7d-9b4a81138302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:33.985753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602eda87-0143-46fd-9d7d-9b4a81138302 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:33.990290 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c75a61-9d8f-4f96-b6a6-192702d54873 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:33.995534 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947dbc4-d0c5-441f-b860-7802e1ca08fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:33.996378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947dbc4-d0c5-441f-b860-7802e1ca08fa admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:33.996498 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947dbc4-d0c5-441f-b860-7802e1ca08fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:33.996670 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947dbc4-d0c5-441f-b860-7802e1ca08fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:33.997361 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947dbc4-d0c5-441f-b860-7802e1ca08fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:33.998950 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947dbc4-d0c5-441f-b860-7802e1ca08fa admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:34.003184 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 831/1662] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:34.004799 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602eda87-0143-46fd-9d7d-9b4a81138302 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:34.010643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 832/1663] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:34.011690 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947dbc4-d0c5-441f-b860-7802e1ca08fa admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:34.012395 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-602eda87-0143-46fd-9d7d-9b4a81138302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:34.023194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947dbc4-d0c5-441f-b860-7802e1ca08fa admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:34.030162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48805a-23e5-4d64-9761-0112b4ddac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:34.031240 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48805a-23e5-4d64-9761-0112b4ddac1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:34.031669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48805a-23e5-4d64-9761-0112b4ddac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:34.032181 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48805a-23e5-4d64-9761-0112b4ddac1b admin admin] PATH_INFO: `/v3/projects/9a8b10bcebec430e9280ec62e63b53ed/users/770dff55a0184635844f3020ae5b6839/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:34.036373 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602eda87-0143-46fd-9d7d-9b4a81138302 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:34.041568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c2aaa-65ff-4b75-b2f3-47f222170915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:34.042601 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c2aaa-65ff-4b75-b2f3-47f222170915 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:34.042907 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c2aaa-65ff-4b75-b2f3-47f222170915 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:34.043181 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c2aaa-65ff-4b75-b2f3-47f222170915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:34.052071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48805a-23e5-4d64-9761-0112b4ddac1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8b10bcebec430e9280ec62e63b53ed, user_id=770dff55a0184635844f3020ae5b6839, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:34.055110 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48805a-23e5-4d64-9761-0112b4ddac1b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:34.063616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c2aaa-65ff-4b75-b2f3-47f222170915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:34.065554 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c2aaa-65ff-4b75-b2f3-47f222170915 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:34.079987 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 832/1664] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:33:34.081330 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c2aaa-65ff-4b75-b2f3-47f222170915 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:34.093509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 833/1665] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:34 2022] PUT /identity/v3/projects/9a8b10bcebec430e9280ec62e63b53ed/users/770dff55a0184635844f3020ae5b6839/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:34.100261 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c2aaa-65ff-4b75-b2f3-47f222170915 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:34.104390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15117e69-3e07-481a-8e37-84c8e6c235d2 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:34.104751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15117e69-3e07-481a-8e37-84c8e6c235d2 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:34.105091 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15117e69-3e07-481a-8e37-84c8e6c235d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:34.143315 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-15117e69-3e07-481a-8e37-84c8e6c235d2 None None] MFA Rules not processed for user `770dff55a0184635844f3020ae5b6839`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:34.144824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-15117e69-3e07-481a-8e37-84c8e6c235d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:34.225044 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23518c0a-ccc2-4271-b3f1-761278e0950d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:34.226985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23518c0a-ccc2-4271-b3f1-761278e0950d admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:34.227374 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23518c0a-ccc2-4271-b3f1-761278e0950d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:34.228279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23518c0a-ccc2-4271-b3f1-761278e0950d admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:34.229658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23518c0a-ccc2-4271-b3f1-761278e0950d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:34.231577 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23518c0a-ccc2-4271-b3f1-761278e0950d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:34.258500 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 833/1666] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:34.262739 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23518c0a-ccc2-4271-b3f1-761278e0950d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:34.277616 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 834/1667] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:34.281036 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23518c0a-ccc2-4271-b3f1-761278e0950d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:34.290825 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15117e69-3e07-481a-8e37-84c8e6c235d2 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:34.292528 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-15117e69-3e07-481a-8e37-84c8e6c235d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:34.293647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade57474-c632-40ea-a00e-cb9f2c90c21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:34.294749 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade57474-c632-40ea-a00e-cb9f2c90c21e admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:34.295791 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade57474-c632-40ea-a00e-cb9f2c90c21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:34.296192 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade57474-c632-40ea-a00e-cb9f2c90c21e admin admin] PATH_INFO: `/v3/projects/d8a7785807484ed68dd4ca59747f2ec6/users/eba2f89ffc4b463ba3c4f3502e6de778/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:34.324272 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:34.328047 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade57474-c632-40ea-a00e-cb9f2c90c21e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a7785807484ed68dd4ca59747f2ec6, user_id=eba2f89ffc4b463ba3c4f3502e6de778, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:34.330836 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade57474-c632-40ea-a00e-cb9f2c90c21e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:34.352012 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 834/1668] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:34 2022] PUT /identity/v3/projects/d8a7785807484ed68dd4ca59747f2ec6/users/eba2f89ffc4b463ba3c4f3502e6de778/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:34.363114 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4f1f0-5968-49e1-9c2e-9820b96b2426 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:34.363572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4f1f0-5968-49e1-9c2e-9820b96b2426 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:34.363995 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4f1f0-5968-49e1-9c2e-9820b96b2426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:34.410553 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f5f4f1f0-5968-49e1-9c2e-9820b96b2426 None None] MFA Rules not processed for user `eba2f89ffc4b463ba3c4f3502e6de778`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:34.410553 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f5f4f1f0-5968-49e1-9c2e-9820b96b2426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:34.410987 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15117e69-3e07-481a-8e37-84c8e6c235d2 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:34.494487 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 835/1669] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:34.495093 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4f1f0-5968-49e1-9c2e-9820b96b2426 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:34.496473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f5f4f1f0-5968-49e1-9c2e-9820b96b2426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:34.500884 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40136571-c9f4-4881-b5b1-7d94596c2b7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:34.501605 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40136571-c9f4-4881-b5b1-7d94596c2b7a service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:34.501959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40136571-c9f4-4881-b5b1-7d94596c2b7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:34.502307 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40136571-c9f4-4881-b5b1-7d94596c2b7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:34.508076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:34.573275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40136571-c9f4-4881-b5b1-7d94596c2b7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:34.575000 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40136571-c9f4-4881-b5b1-7d94596c2b7a service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:34.577851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4f1f0-5968-49e1-9c2e-9820b96b2426 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:34.583801 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53c74c-489b-42d3-8ed6-7bc76e7c0a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:34.584449 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53c74c-489b-42d3-8ed6-7bc76e7c0a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:34.584732 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53c74c-489b-42d3-8ed6-7bc76e7c0a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:34.585015 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53c74c-489b-42d3-8ed6-7bc76e7c0a69 admin admin] PATH_INFO: `/v3/projects/b193112b6e694350b4c0d925906a739e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:34.585776 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 835/1670] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:33:34.586358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53c74c-489b-42d3-8ed6-7bc76e7c0a69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b193112b6e694350b4c0d925906a739e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:34.586469 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40136571-c9f4-4881-b5b1-7d94596c2b7a service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:34.588786 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53c74c-489b-42d3-8ed6-7bc76e7c0a69 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:34.600443 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40136571-c9f4-4881-b5b1-7d94596c2b7a service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:34.606390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8d0aa-e190-412c-bd91-4fa1f81e2876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:34.606966 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8d0aa-e190-412c-bd91-4fa1f81e2876 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:34.607306 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8d0aa-e190-412c-bd91-4fa1f81e2876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:34.607815 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8d0aa-e190-412c-bd91-4fa1f81e2876 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:34.608815 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8d0aa-e190-412c-bd91-4fa1f81e2876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:34.611044 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8d0aa-e190-412c-bd91-4fa1f81e2876 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:34.644642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 836/1671] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:34 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:34.647372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6a53c74c-489b-42d3-8ed6-7bc76e7c0a69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b193112b6e694350b4c0d925906a739e', 'request_id': 'req-6a53c74c-489b-42d3-8ed6-7bc76e7c0a69'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:34.648882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8d0aa-e190-412c-bd91-4fa1f81e2876 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:34.659110 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6a53c74c-489b-42d3-8ed6-7bc76e7c0a69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b193112b6e694350b4c0d925906a739e', 'request_id': 'req-6a53c74c-489b-42d3-8ed6-7bc76e7c0a69'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:34.668092 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6a53c74c-489b-42d3-8ed6-7bc76e7c0a69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b193112b6e694350b4c0d925906a739e', 'request_id': 'req-6a53c74c-489b-42d3-8ed6-7bc76e7c0a69'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:34.689420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6a53c74c-489b-42d3-8ed6-7bc76e7c0a69 admin admin] The token cache is being invalidate because project b193112b6e694350b4c0d925906a739e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:34.689420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6a53c74c-489b-42d3-8ed6-7bc76e7c0a69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:34.689420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6a53c74c-489b-42d3-8ed6-7bc76e7c0a69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:34.689420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 836/1672] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:34 2022] DELETE /identity/v3/projects/b193112b6e694350b4c0d925906a739e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:34.692179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fb472-74cd-4e70-810a-04eb7ddc0bd7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:34.692649 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fb472-74cd-4e70-810a-04eb7ddc0bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:34.693452 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fb472-74cd-4e70-810a-04eb7ddc0bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:34.723641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-816fb472-74cd-4e70-810a-04eb7ddc0bd7 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:34.725674 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-816fb472-74cd-4e70-810a-04eb7ddc0bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:34.735740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 837/1673] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:34.739213 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8d0aa-e190-412c-bd91-4fa1f81e2876 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:34.744736 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2279d-34b0-486c-b8af-daf058331668 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:34.744960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2279d-34b0-486c-b8af-daf058331668 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:34.745369 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2279d-34b0-486c-b8af-daf058331668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:34.746565 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35306048-5bb7-4427-8c8c-d78678a483e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:34.747329 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35306048-5bb7-4427-8c8c-d78678a483e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:34.747717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35306048-5bb7-4427-8c8c-d78678a483e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:34.748092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35306048-5bb7-4427-8c8c-d78678a483e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:34.748947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35306048-5bb7-4427-8c8c-d78678a483e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:34.755731 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35306048-5bb7-4427-8c8c-d78678a483e2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:34.778424 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-78e2279d-34b0-486c-b8af-daf058331668 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:34.779658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-78e2279d-34b0-486c-b8af-daf058331668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:34.791754 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:34.795200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 838/1674] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:34.796531 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2279d-34b0-486c-b8af-daf058331668 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:34.813489 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 837/1675] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:34 2022] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:34.814867 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35306048-5bb7-4427-8c8c-d78678a483e2 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:34.817738 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-35306048-5bb7-4427-8c8c-d78678a483e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:34.818072 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2279d-34b0-486c-b8af-daf058331668 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:34.832496 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4b75b-62d8-4edc-97d8-2cb95c8464bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:34.833157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4b75b-62d8-4edc-97d8-2cb95c8464bf admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:34.833442 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4b75b-62d8-4edc-97d8-2cb95c8464bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:34.833715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4b75b-62d8-4edc-97d8-2cb95c8464bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:34.834516 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35306048-5bb7-4427-8c8c-d78678a483e2 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:34.834632 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4b75b-62d8-4edc-97d8-2cb95c8464bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:33:34.834927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4b75b-62d8-4edc-97d8-2cb95c8464bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:34.837723 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4b75b-62d8-4edc-97d8-2cb95c8464bf admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:34.841760 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de06b3-a3bb-4e52-89eb-49e9312bf7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:34.842527 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de06b3-a3bb-4e52-89eb-49e9312bf7df admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:34.842907 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de06b3-a3bb-4e52-89eb-49e9312bf7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:34.844100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de06b3-a3bb-4e52-89eb-49e9312bf7df admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:34.844884 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de06b3-a3bb-4e52-89eb-49e9312bf7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:34.847017 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de06b3-a3bb-4e52-89eb-49e9312bf7df admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:34.862964 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 839/1676] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:33:34.866088 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4b75b-62d8-4edc-97d8-2cb95c8464bf admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:34.885138 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 838/1677] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:34.887303 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de06b3-a3bb-4e52-89eb-49e9312bf7df admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:34.891007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4b75b-62d8-4edc-97d8-2cb95c8464bf admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:34.905854 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de06b3-a3bb-4e52-89eb-49e9312bf7df admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:34.907783 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26dfe3-a3b1-4fd4-9e7e-d5565b891ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:34.908841 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26dfe3-a3b1-4fd4-9e7e-d5565b891ffa admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:34.910072 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26dfe3-a3b1-4fd4-9e7e-d5565b891ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:34.910584 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26dfe3-a3b1-4fd4-9e7e-d5565b891ffa admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:34.911333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26dfe3-a3b1-4fd4-9e7e-d5565b891ffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:34.913036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e2418-41bd-4ec3-bae5-825f698d38ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:34.914652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e2418-41bd-4ec3-bae5-825f698d38ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:34.915614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e2418-41bd-4ec3-bae5-825f698d38ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:34.915904 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e2418-41bd-4ec3-bae5-825f698d38ac admin admin] PATH_INFO: `/v3/projects/6372f7cf73f7408eaa113e1ba2ed1721/users/cae4bbae93b945d5991a539ac099bf38/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:34.916595 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26dfe3-a3b1-4fd4-9e7e-d5565b891ffa admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:34.945532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e2418-41bd-4ec3-bae5-825f698d38ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6372f7cf73f7408eaa113e1ba2ed1721, user_id=cae4bbae93b945d5991a539ac099bf38, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:34.952683 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e2418-41bd-4ec3-bae5-825f698d38ac admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:34.974215 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 839/1678] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:34 2022] PUT /identity/v3/projects/6372f7cf73f7408eaa113e1ba2ed1721/users/cae4bbae93b945d5991a539ac099bf38/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:34.980897 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 840/1679] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:34 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:34.981880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e2418-41bd-4ec3-bae5-825f698d38ac admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:34.982080 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26dfe3-a3b1-4fd4-9e7e-d5565b891ffa admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:35.136462 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:35.161675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26dfe3-a3b1-4fd4-9e7e-d5565b891ffa admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:35.170935 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e2418-41bd-4ec3-bae5-825f698d38ac admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:35.172526 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8aaf2-d4f9-42a1-8f07-464164a508f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:35.174807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8aaf2-d4f9-42a1-8f07-464164a508f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:35.175195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8aaf2-d4f9-42a1-8f07-464164a508f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:35.175525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8aaf2-d4f9-42a1-8f07-464164a508f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:35.176432 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8aaf2-d4f9-42a1-8f07-464164a508f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:35.177176 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605ac78-6cea-4c0f-a342-39e022a9dbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:35.177804 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605ac78-6cea-4c0f-a342-39e022a9dbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:35.178680 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605ac78-6cea-4c0f-a342-39e022a9dbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:35.178963 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605ac78-6cea-4c0f-a342-39e022a9dbd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:35.179626 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605ac78-6cea-4c0f-a342-39e022a9dbd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:35.181890 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605ac78-6cea-4c0f-a342-39e022a9dbd9 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:35.183729 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8aaf2-d4f9-42a1-8f07-464164a508f8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:35.196158 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 840/1680] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:35.197708 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605ac78-6cea-4c0f-a342-39e022a9dbd9 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:35.204492 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9605ac78-6cea-4c0f-a342-39e022a9dbd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:35.220536 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 841/1681] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:34 2022] POST /identity/v3/users => generated 285 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:35.220536 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8aaf2-d4f9-42a1-8f07-464164a508f8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:35.223671 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605ac78-6cea-4c0f-a342-39e022a9dbd9 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:35.230951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5240b-22ff-4cfb-b6c7-0d5c17f6ea71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:35.231561 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5240b-22ff-4cfb-b6c7-0d5c17f6ea71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:35.231922 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5240b-22ff-4cfb-b6c7-0d5c17f6ea71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:35.232175 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5240b-22ff-4cfb-b6c7-0d5c17f6ea71 admin admin] PATH_INFO: `/v3/projects/937e901075f0415b87229c806fdf221c` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:35.232278 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8aaf2-d4f9-42a1-8f07-464164a508f8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:35.234279 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5240b-22ff-4cfb-b6c7-0d5c17f6ea71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=937e901075f0415b87229c806fdf221c)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:35.238607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73620a6f-4013-40da-beea-29ff93ba6c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:35.239548 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73620a6f-4013-40da-beea-29ff93ba6c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:35.240026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73620a6f-4013-40da-beea-29ff93ba6c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:35.240502 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73620a6f-4013-40da-beea-29ff93ba6c4e admin admin] PATH_INFO: `/v3/projects/6372f7cf73f7408eaa113e1ba2ed1721/users/cae4bbae93b945d5991a539ac099bf38/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:35.242485 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5240b-22ff-4cfb-b6c7-0d5c17f6ea71 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:35.244435 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73620a6f-4013-40da-beea-29ff93ba6c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6372f7cf73f7408eaa113e1ba2ed1721, user_id=cae4bbae93b945d5991a539ac099bf38, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:35.248402 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73620a6f-4013-40da-beea-29ff93ba6c4e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:35.268548 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 842/1682] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:35 2022] PUT /identity/v3/projects/6372f7cf73f7408eaa113e1ba2ed1721/users/cae4bbae93b945d5991a539ac099bf38/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:35.269821 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73620a6f-4013-40da-beea-29ff93ba6c4e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:35.326884 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a6e5240b-22ff-4cfb-b6c7-0d5c17f6ea71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '937e901075f0415b87229c806fdf221c', 'request_id': 'req-a6e5240b-22ff-4cfb-b6c7-0d5c17f6ea71'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:35.335713 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a6e5240b-22ff-4cfb-b6c7-0d5c17f6ea71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '937e901075f0415b87229c806fdf221c', 'request_id': 'req-a6e5240b-22ff-4cfb-b6c7-0d5c17f6ea71'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:35.345909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a6e5240b-22ff-4cfb-b6c7-0d5c17f6ea71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '937e901075f0415b87229c806fdf221c', 'request_id': 'req-a6e5240b-22ff-4cfb-b6c7-0d5c17f6ea71'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:35.361643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a6e5240b-22ff-4cfb-b6c7-0d5c17f6ea71 admin admin] The token cache is being invalidate because project 937e901075f0415b87229c806fdf221c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:35.362308 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a6e5240b-22ff-4cfb-b6c7-0d5c17f6ea71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:35.362917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a6e5240b-22ff-4cfb-b6c7-0d5c17f6ea71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:35.364507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 841/1683] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:35 2022] DELETE /identity/v3/projects/937e901075f0415b87229c806fdf221c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:35.365775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd652e1-553d-4ed3-8ab5-56c0e5287ba8 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:35.366111 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd652e1-553d-4ed3-8ab5-56c0e5287ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:35.366345 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd652e1-553d-4ed3-8ab5-56c0e5287ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:35.373459 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73620a6f-4013-40da-beea-29ff93ba6c4e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:35.397516 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3bd652e1-553d-4ed3-8ab5-56c0e5287ba8 None None] MFA Rules not processed for user `cae4bbae93b945d5991a539ac099bf38`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:35.398736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3bd652e1-553d-4ed3-8ab5-56c0e5287ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:35.433208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:35.459264 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0654c74-842c-42f6-b85c-60642d4ea47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:35.460173 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0654c74-842c-42f6-b85c-60642d4ea47f admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:35.460536 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0654c74-842c-42f6-b85c-60642d4ea47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:35.460867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0654c74-842c-42f6-b85c-60642d4ea47f admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:35.462337 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0654c74-842c-42f6-b85c-60642d4ea47f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:35.464616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0654c74-842c-42f6-b85c-60642d4ea47f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:35.476641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 843/1684] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:35.477395 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0654c74-842c-42f6-b85c-60642d4ea47f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:35.481764 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e0654c74-842c-42f6-b85c-60642d4ea47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:35.502572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0654c74-842c-42f6-b85c-60642d4ea47f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:35.502869 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 842/1685] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:35.503926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd652e1-553d-4ed3-8ab5-56c0e5287ba8 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:35.505568 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3bd652e1-553d-4ed3-8ab5-56c0e5287ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:35.512985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d3865-1ef5-4a6a-bf76-0df9045ac6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:35.513761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d3865-1ef5-4a6a-bf76-0df9045ac6ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:35.514048 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d3865-1ef5-4a6a-bf76-0df9045ac6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:35.514326 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d3865-1ef5-4a6a-bf76-0df9045ac6ea admin admin] PATH_INFO: `/v3/users/641ce3a822e5481ba12b7e0fceef0c56` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:35.515578 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d3865-1ef5-4a6a-bf76-0df9045ac6ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=641ce3a822e5481ba12b7e0fceef0c56)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:35.519212 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d3865-1ef5-4a6a-bf76-0df9045ac6ea admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:35.522534 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd652e1-553d-4ed3-8ab5-56c0e5287ba8 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:35.528032 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3daa8-37ad-49d3-a004-eaaad9778deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:35.528747 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3daa8-37ad-49d3-a004-eaaad9778deb admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:35.529026 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3daa8-37ad-49d3-a004-eaaad9778deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:35.529662 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3daa8-37ad-49d3-a004-eaaad9778deb admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:35.530334 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3daa8-37ad-49d3-a004-eaaad9778deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:35.532033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3daa8-37ad-49d3-a004-eaaad9778deb admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:35.545132 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 843/1686] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:35.546430 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3daa8-37ad-49d3-a004-eaaad9778deb admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:35.548510 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d9d3daa8-37ad-49d3-a004-eaaad9778deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:35.582763 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d3d3865-1ef5-4a6a-bf76-0df9045ac6ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '641ce3a822e5481ba12b7e0fceef0c56'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:35.596292 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d3d3865-1ef5-4a6a-bf76-0df9045ac6ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '641ce3a822e5481ba12b7e0fceef0c56'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:35.597413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d3d3865-1ef5-4a6a-bf76-0df9045ac6ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '641ce3a822e5481ba12b7e0fceef0c56'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:35.629335 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d3d3865-1ef5-4a6a-bf76-0df9045ac6ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '641ce3a822e5481ba12b7e0fceef0c56'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:35.631343 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:35.645236 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d3d3865-1ef5-4a6a-bf76-0df9045ac6ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '641ce3a822e5481ba12b7e0fceef0c56'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:35.648523 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3daa8-37ad-49d3-a004-eaaad9778deb admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:35.653989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591009d-8180-4dc7-8f40-bff17e458cfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:35.654710 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591009d-8180-4dc7-8f40-bff17e458cfc service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:35.654988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591009d-8180-4dc7-8f40-bff17e458cfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:35.655264 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591009d-8180-4dc7-8f40-bff17e458cfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:35.657033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d591009d-8180-4dc7-8f40-bff17e458cfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:35.657346 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 844/1687] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:35 2022] DELETE /identity/v3/users/641ce3a822e5481ba12b7e0fceef0c56 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:35.661624 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d3865-1ef5-4a6a-bf76-0df9045ac6ea admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:35.663208 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5d3d3865-1ef5-4a6a-bf76-0df9045ac6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:35.691746 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591009d-8180-4dc7-8f40-bff17e458cfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:35.694119 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591009d-8180-4dc7-8f40-bff17e458cfc service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:35.719301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 844/1688] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:35.760835 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d3865-1ef5-4a6a-bf76-0df9045ac6ea admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:35.780559 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2206040-5a2f-4944-bc55-b2654b3dc4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:35.780712 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591009d-8180-4dc7-8f40-bff17e458cfc service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:35.782095 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d591009d-8180-4dc7-8f40-bff17e458cfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:35.782207 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2206040-5a2f-4944-bc55-b2654b3dc4f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:35.782549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2206040-5a2f-4944-bc55-b2654b3dc4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:35.782818 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2206040-5a2f-4944-bc55-b2654b3dc4f1 admin admin] PATH_INFO: `/v3/projects/0fd70951249e4a8f8907accbb110b7cd/users/ae356d73ebc044a3a9d1c8b0f2a97d33/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:35.795442 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591009d-8180-4dc7-8f40-bff17e458cfc service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:35.802401 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2206040-5a2f-4944-bc55-b2654b3dc4f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd70951249e4a8f8907accbb110b7cd, user_id=ae356d73ebc044a3a9d1c8b0f2a97d33, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:35.810167 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2206040-5a2f-4944-bc55-b2654b3dc4f1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:35.828441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 845/1689] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:35 2022] PUT /identity/v3/projects/0fd70951249e4a8f8907accbb110b7cd/users/ae356d73ebc044a3a9d1c8b0f2a97d33/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:35.839655 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fa431-f2d8-4e95-a027-199e065ae842 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:35.840105 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fa431-f2d8-4e95-a027-199e065ae842 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:35.840479 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fa431-f2d8-4e95-a027-199e065ae842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:35.853652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689158c6-3e4e-4ef1-a029-2b64eee404bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:35.854650 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689158c6-3e4e-4ef1-a029-2b64eee404bf service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:35.855157 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689158c6-3e4e-4ef1-a029-2b64eee404bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:35.855630 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689158c6-3e4e-4ef1-a029-2b64eee404bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:35.857745 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-689158c6-3e4e-4ef1-a029-2b64eee404bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:35.873834 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-735fa431-f2d8-4e95-a027-199e065ae842 None None] MFA Rules not processed for user `ae356d73ebc044a3a9d1c8b0f2a97d33`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:35.875626 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-735fa431-f2d8-4e95-a027-199e065ae842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:35.940518 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689158c6-3e4e-4ef1-a029-2b64eee404bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:35.942510 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689158c6-3e4e-4ef1-a029-2b64eee404bf service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:35.954805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 845/1690] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:33:35.967185 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 846/1691] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:35.982991 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689158c6-3e4e-4ef1-a029-2b64eee404bf service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:35.985355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-689158c6-3e4e-4ef1-a029-2b64eee404bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:36.006487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:36.045769 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fa431-f2d8-4e95-a027-199e065ae842 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:36.047239 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-735fa431-f2d8-4e95-a027-199e065ae842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:36.134510 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689158c6-3e4e-4ef1-a029-2b64eee404bf service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:36.157613 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:36.177536 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fa431-f2d8-4e95-a027-199e065ae842 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:36.189725 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b77b9-a641-4429-a517-89337b0f8753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:36.190416 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b77b9-a641-4429-a517-89337b0f8753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:36.190686 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b77b9-a641-4429-a517-89337b0f8753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:36.190955 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b77b9-a641-4429-a517-89337b0f8753 admin admin] PATH_INFO: `/v3/projects/734ed786b2a94d57bef2dbd70663503d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:36.192843 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b77b9-a641-4429-a517-89337b0f8753 admin admin] RBAC: Authorizing `identity:delete_project(project_id=734ed786b2a94d57bef2dbd70663503d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:36.194781 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b77b9-a641-4429-a517-89337b0f8753 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:36.223827 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c0a67-70e9-403d-a80b-0181a7fecaf9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c6b6b1cdc649dda3a9caa8d9713569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:36.224815 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c0a67-70e9-403d-a80b-0181a7fecaf9 service glance] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:36.225525 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c0a67-70e9-403d-a80b-0181a7fecaf9 service glance] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:36.225525 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c0a67-70e9-403d-a80b-0181a7fecaf9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:36.237082 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c0a67-70e9-403d-a80b-0181a7fecaf9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:36.238452 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c0a67-70e9-403d-a80b-0181a7fecaf9 service glance] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:36.253380 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 846/1692] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:36.269165 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d43b77b9-a641-4429-a517-89337b0f8753 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '734ed786b2a94d57bef2dbd70663503d', 'request_id': 'req-d43b77b9-a641-4429-a517-89337b0f8753'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:36.283978 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d43b77b9-a641-4429-a517-89337b0f8753 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '734ed786b2a94d57bef2dbd70663503d', 'request_id': 'req-d43b77b9-a641-4429-a517-89337b0f8753'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:36.290849 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d43b77b9-a641-4429-a517-89337b0f8753 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '734ed786b2a94d57bef2dbd70663503d', 'request_id': 'req-d43b77b9-a641-4429-a517-89337b0f8753'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:36.304319 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d43b77b9-a641-4429-a517-89337b0f8753 admin admin] The token cache is being invalidate because project 734ed786b2a94d57bef2dbd70663503d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:36.304701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d43b77b9-a641-4429-a517-89337b0f8753 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:36.305496 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d43b77b9-a641-4429-a517-89337b0f8753 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:36.307308 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 847/1693] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:36 2022] DELETE /identity/v3/projects/734ed786b2a94d57bef2dbd70663503d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:36.312312 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a30ed-f074-4bbf-8bd1-5c6dba50d2c3 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:36.312604 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a30ed-f074-4bbf-8bd1-5c6dba50d2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:36.312878 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a30ed-f074-4bbf-8bd1-5c6dba50d2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:36.355708 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f31a30ed-f074-4bbf-8bd1-5c6dba50d2c3 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:36.359756 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f31a30ed-f074-4bbf-8bd1-5c6dba50d2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:36.527895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 847/1694] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:36.536970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf8c07-22d6-4100-a38b-1b3126075d06 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:36.537538 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf8c07-22d6-4100-a38b-1b3126075d06 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:36.538029 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf8c07-22d6-4100-a38b-1b3126075d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:36.564356 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-bbdf8c07-22d6-4100-a38b-1b3126075d06 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:36.565721 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bbdf8c07-22d6-4100-a38b-1b3126075d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:36.587173 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 848/1695] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:36.588176 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a30ed-f074-4bbf-8bd1-5c6dba50d2c3 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:36.599093 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a30ed-f074-4bbf-8bd1-5c6dba50d2c3 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:36.614446 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f26c17-248a-413e-814d-67c64b95f6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:36.615163 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26c17-248a-413e-814d-67c64b95f6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:36.615524 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26c17-248a-413e-814d-67c64b95f6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:36.615896 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26c17-248a-413e-814d-67c64b95f6a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:36.616635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f26c17-248a-413e-814d-67c64b95f6a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:33:36.617014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f26c17-248a-413e-814d-67c64b95f6a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:36.622654 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f26c17-248a-413e-814d-67c64b95f6a7 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:36.642269 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 848/1696] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:33:36.644879 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf8c07-22d6-4100-a38b-1b3126075d06 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:36.657221 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf8c07-22d6-4100-a38b-1b3126075d06 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:36.665665 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a1260-ae58-4f15-bd28-b50ff4ea7b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:36.667197 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a1260-ae58-4f15-bd28-b50ff4ea7b40 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:36.667626 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a1260-ae58-4f15-bd28-b50ff4ea7b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:36.668563 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a1260-ae58-4f15-bd28-b50ff4ea7b40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:36.670180 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a1260-ae58-4f15-bd28-b50ff4ea7b40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:36.673684 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a1260-ae58-4f15-bd28-b50ff4ea7b40 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:36.737227 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 849/1697] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:36 2022] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:33:36.741620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f26c17-248a-413e-814d-67c64b95f6a7 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:36.767226 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f26c17-248a-413e-814d-67c64b95f6a7 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:36.832579 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:36.857973 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a1650-c823-4bea-8095-0553d21ce236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:36.858998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a1650-c823-4bea-8095-0553d21ce236 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:36.859649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a1650-c823-4bea-8095-0553d21ce236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:36.860034 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a1650-c823-4bea-8095-0553d21ce236 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:36.860613 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a1650-c823-4bea-8095-0553d21ce236 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:36.862781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a1650-c823-4bea-8095-0553d21ce236 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:36.900756 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 849/1698] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:36 2022] POST /identity/v3/users => generated 284 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:36.902850 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a1260-ae58-4f15-bd28-b50ff4ea7b40 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:36.914564 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a1260-ae58-4f15-bd28-b50ff4ea7b40 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:36.920987 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed8ca9-7968-4a7b-a00b-ae58b6b3cb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:36.921816 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed8ca9-7968-4a7b-a00b-ae58b6b3cb02 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:36.922108 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed8ca9-7968-4a7b-a00b-ae58b6b3cb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:36.922388 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed8ca9-7968-4a7b-a00b-ae58b6b3cb02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:36.923269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed8ca9-7968-4a7b-a00b-ae58b6b3cb02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:36.925023 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed8ca9-7968-4a7b-a00b-ae58b6b3cb02 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:36.938244 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 850/1699] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:36.942050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a1650-c823-4bea-8095-0553d21ce236 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:36.956819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a1650-c823-4bea-8095-0553d21ce236 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:36.968357 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f31d86-49c8-4ff3-96b8-e58b8d8f13ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:36.969471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f31d86-49c8-4ff3-96b8-e58b8d8f13ae admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:36.969758 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f31d86-49c8-4ff3-96b8-e58b8d8f13ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:36.970308 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f31d86-49c8-4ff3-96b8-e58b8d8f13ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:36.970976 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f31d86-49c8-4ff3-96b8-e58b8d8f13ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:36.972804 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f31d86-49c8-4ff3-96b8-e58b8d8f13ae admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:36.987669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 850/1700] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:36.992262 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed8ca9-7968-4a7b-a00b-ae58b6b3cb02 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:37.007364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed8ca9-7968-4a7b-a00b-ae58b6b3cb02 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:37.022545 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b26e00-229e-42f2-9dcd-4f72af78824d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:37.023496 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b26e00-229e-42f2-9dcd-4f72af78824d admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:37.024172 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b26e00-229e-42f2-9dcd-4f72af78824d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:37.025273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b26e00-229e-42f2-9dcd-4f72af78824d admin admin] PATH_INFO: `/v3/projects/dfa730e6fb414147b4bac521218ed889/users/c9d745ed2a564d2f8075fc9f608edf4b/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:37.043878 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b26e00-229e-42f2-9dcd-4f72af78824d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa730e6fb414147b4bac521218ed889, user_id=c9d745ed2a564d2f8075fc9f608edf4b, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:37.047201 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b26e00-229e-42f2-9dcd-4f72af78824d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:37.080497 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 851/1701] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:36 2022] PUT /identity/v3/projects/dfa730e6fb414147b4bac521218ed889/users/c9d745ed2a564d2f8075fc9f608edf4b/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:37.084966 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b212b5b-9358-40f0-9290-ee50787fc4e4 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:37.086680 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b212b5b-9358-40f0-9290-ee50787fc4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:37.087553 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b212b5b-9358-40f0-9290-ee50787fc4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:37.121587 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-1b212b5b-9358-40f0-9290-ee50787fc4e4 None None] MFA Rules not processed for user `c9d745ed2a564d2f8075fc9f608edf4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:37.123396 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1b212b5b-9358-40f0-9290-ee50787fc4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:37.201242 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 851/1702] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:37.205821 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b26e00-229e-42f2-9dcd-4f72af78824d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:37.278710 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b26e00-229e-42f2-9dcd-4f72af78824d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:37.284491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebe7d9-e1dc-4dfd-bbe0-a1568d1de329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:37.285289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebe7d9-e1dc-4dfd-bbe0-a1568d1de329 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:37.285748 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebe7d9-e1dc-4dfd-bbe0-a1568d1de329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:37.286128 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebe7d9-e1dc-4dfd-bbe0-a1568d1de329 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:37.286874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cebe7d9-e1dc-4dfd-bbe0-a1568d1de329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:37.289162 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cebe7d9-e1dc-4dfd-bbe0-a1568d1de329 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:37.324529 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 852/1703] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:37 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:37.326609 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b212b5b-9358-40f0-9290-ee50787fc4e4 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:37.339167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b212b5b-9358-40f0-9290-ee50787fc4e4 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:37.403900 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d28089-2b90-42ea-82fb-52bd89b58d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:37.404540 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d28089-2b90-42ea-82fb-52bd89b58d4c admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:37.405000 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d28089-2b90-42ea-82fb-52bd89b58d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:37.405147 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d28089-2b90-42ea-82fb-52bd89b58d4c admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:37.405683 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d28089-2b90-42ea-82fb-52bd89b58d4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:37.407575 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d28089-2b90-42ea-82fb-52bd89b58d4c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:37.437613 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 852/1704] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:37 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:37.442163 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebe7d9-e1dc-4dfd-bbe0-a1568d1de329 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:37.452595 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:37.456670 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebe7d9-e1dc-4dfd-bbe0-a1568d1de329 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:37.463940 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e9f69-935e-4467-bb5a-a69624f99cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:37.464737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e9f69-935e-4467-bb5a-a69624f99cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:37.465146 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e9f69-935e-4467-bb5a-a69624f99cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:37.465564 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e9f69-935e-4467-bb5a-a69624f99cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:37.469272 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e9f69-935e-4467-bb5a-a69624f99cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:37.469272 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e9f69-935e-4467-bb5a-a69624f99cc0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:37.481159 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 853/1705] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:37.483457 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d28089-2b90-42ea-82fb-52bd89b58d4c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:37.494944 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d28089-2b90-42ea-82fb-52bd89b58d4c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:37.500441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbab416-b22e-4ab5-aac8-252507cb5157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:37.501150 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbab416-b22e-4ab5-aac8-252507cb5157 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:37.501435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbab416-b22e-4ab5-aac8-252507cb5157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:37.501710 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbab416-b22e-4ab5-aac8-252507cb5157 admin admin] PATH_INFO: `/v3/projects/3c4439a847074b8dbebfa2a78ecde1ce/users/43d8bb9225ce4f6fb9dbd2d38f0832ce/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:37.517050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbab416-b22e-4ab5-aac8-252507cb5157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4439a847074b8dbebfa2a78ecde1ce, user_id=43d8bb9225ce4f6fb9dbd2d38f0832ce, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:37.519771 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbab416-b22e-4ab5-aac8-252507cb5157 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:37.533545 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 853/1706] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:37 2022] PUT /identity/v3/projects/3c4439a847074b8dbebfa2a78ecde1ce/users/43d8bb9225ce4f6fb9dbd2d38f0832ce/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:33:37.537766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e9f69-935e-4467-bb5a-a69624f99cc0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:37.548922 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e9f69-935e-4467-bb5a-a69624f99cc0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:37.622021 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512d004-15cf-4806-a437-afc7c3c1be38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:37.622656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512d004-15cf-4806-a437-afc7c3c1be38 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:37.622938 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512d004-15cf-4806-a437-afc7c3c1be38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:37.623203 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512d004-15cf-4806-a437-afc7c3c1be38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:37.623919 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512d004-15cf-4806-a437-afc7c3c1be38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:37.625891 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512d004-15cf-4806-a437-afc7c3c1be38 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:37.637676 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 854/1707] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:33:37.642249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbab416-b22e-4ab5-aac8-252507cb5157 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:37.655180 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbab416-b22e-4ab5-aac8-252507cb5157 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:37.660244 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c56231-4fb7-4392-92e1-334ff9f33720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:37.660912 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c56231-4fb7-4392-92e1-334ff9f33720 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:37.661276 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c56231-4fb7-4392-92e1-334ff9f33720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:37.661533 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c56231-4fb7-4392-92e1-334ff9f33720 admin admin] PATH_INFO: `/v3/projects/3c4439a847074b8dbebfa2a78ecde1ce/users/43d8bb9225ce4f6fb9dbd2d38f0832ce/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:37.663979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c56231-4fb7-4392-92e1-334ff9f33720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4439a847074b8dbebfa2a78ecde1ce, user_id=43d8bb9225ce4f6fb9dbd2d38f0832ce, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:37.668053 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c56231-4fb7-4392-92e1-334ff9f33720 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:37.679356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:37.685833 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 854/1708] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:37 2022] PUT /identity/v3/projects/3c4439a847074b8dbebfa2a78ecde1ce/users/43d8bb9225ce4f6fb9dbd2d38f0832ce/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:33:37.696313 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089bb62-5dd7-4f65-93ff-9c0cd5c841aa None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:37.696949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089bb62-5dd7-4f65-93ff-9c0cd5c841aa None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:37.696949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089bb62-5dd7-4f65-93ff-9c0cd5c841aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:37.732713 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0089bb62-5dd7-4f65-93ff-9c0cd5c841aa None None] MFA Rules not processed for user `43d8bb9225ce4f6fb9dbd2d38f0832ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:37.734231 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0089bb62-5dd7-4f65-93ff-9c0cd5c841aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:37.819381 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 855/1709] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:37.831579 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c56231-4fb7-4392-92e1-334ff9f33720 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:37.833327 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-72c56231-4fb7-4392-92e1-334ff9f33720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:37.908557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c56231-4fb7-4392-92e1-334ff9f33720 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:37.912238 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb5359-605c-4024-ba27-e18ad19ef4dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:37.912851 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb5359-605c-4024-ba27-e18ad19ef4dc service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:37.913159 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb5359-605c-4024-ba27-e18ad19ef4dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:37.913446 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb5359-605c-4024-ba27-e18ad19ef4dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:37.923627 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb5359-605c-4024-ba27-e18ad19ef4dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:37.925056 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb5359-605c-4024-ba27-e18ad19ef4dc service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:37.940733 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 855/1710] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:38.058239 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089bb62-5dd7-4f65-93ff-9c0cd5c841aa None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:38.073963 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089bb62-5dd7-4f65-93ff-9c0cd5c841aa None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:38.078688 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376349c5-39e6-4bd3-bc98-efabd2d1e53a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:38.079304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376349c5-39e6-4bd3-bc98-efabd2d1e53a service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:38.079585 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376349c5-39e6-4bd3-bc98-efabd2d1e53a service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:38.079868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376349c5-39e6-4bd3-bc98-efabd2d1e53a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:38.143789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376349c5-39e6-4bd3-bc98-efabd2d1e53a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:38.145314 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376349c5-39e6-4bd3-bc98-efabd2d1e53a service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:38.155129 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 856/1711] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:39.268663 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb5359-605c-4024-ba27-e18ad19ef4dc service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:39.270216 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-eecb5359-605c-4024-ba27-e18ad19ef4dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:39.335402 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb5359-605c-4024-ba27-e18ad19ef4dc service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:39.340504 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d810258-0841-49a7-ac1a-bc1eda51316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:39.341228 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d810258-0841-49a7-ac1a-bc1eda51316c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:39.341438 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d810258-0841-49a7-ac1a-bc1eda51316c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:39.341711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d810258-0841-49a7-ac1a-bc1eda51316c admin admin] PATH_INFO: `/v3/users/9439a51e91454af2b6a1c794b765155a` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:39.342977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d810258-0841-49a7-ac1a-bc1eda51316c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9439a51e91454af2b6a1c794b765155a)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:39.344827 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d810258-0841-49a7-ac1a-bc1eda51316c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:39.400104 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7d810258-0841-49a7-ac1a-bc1eda51316c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9439a51e91454af2b6a1c794b765155a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:39.400770 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7d810258-0841-49a7-ac1a-bc1eda51316c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9439a51e91454af2b6a1c794b765155a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:39.401407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7d810258-0841-49a7-ac1a-bc1eda51316c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9439a51e91454af2b6a1c794b765155a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:39.409876 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7d810258-0841-49a7-ac1a-bc1eda51316c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9439a51e91454af2b6a1c794b765155a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:39.417829 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7d810258-0841-49a7-ac1a-bc1eda51316c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9439a51e91454af2b6a1c794b765155a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:39.435823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 856/1712] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:39 2022] DELETE /identity/v3/users/9439a51e91454af2b6a1c794b765155a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:39.440141 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87db62-f70a-4378-9626-4d210b670dd1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:39.441002 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87db62-f70a-4378-9626-4d210b670dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:39.441377 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87db62-f70a-4378-9626-4d210b670dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:39.464209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ae87db62-f70a-4378-9626-4d210b670dd1 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:39.465508 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ae87db62-f70a-4378-9626-4d210b670dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:39.474206 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:39.537250 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 857/1713] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:39.548637 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d810258-0841-49a7-ac1a-bc1eda51316c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:39.550081 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7d810258-0841-49a7-ac1a-bc1eda51316c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:39.589003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:39.644433 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d810258-0841-49a7-ac1a-bc1eda51316c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:39.648090 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469a444-13a1-4d89-ab8f-0043901b425a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:39.648722 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469a444-13a1-4d89-ab8f-0043901b425a service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:39.649098 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469a444-13a1-4d89-ab8f-0043901b425a service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:39.649425 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469a444-13a1-4d89-ab8f-0043901b425a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:39.673358 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469a444-13a1-4d89-ab8f-0043901b425a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:39.675643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469a444-13a1-4d89-ab8f-0043901b425a service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:39.698018 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 857/1714] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:40.577733 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87db62-f70a-4378-9626-4d210b670dd1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:40.579855 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ae87db62-f70a-4378-9626-4d210b670dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:40.604556 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87db62-f70a-4378-9626-4d210b670dd1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:40.617419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4c845-5ed0-42ff-96c7-519856ddb3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:40.620645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4c845-5ed0-42ff-96c7-519856ddb3d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:40.622000 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4c845-5ed0-42ff-96c7-519856ddb3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:40.622435 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4c845-5ed0-42ff-96c7-519856ddb3d7 admin admin] PATH_INFO: `/v3/projects/535dfc394c5144dabba40dc8e02cc4a2` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:40.637182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4c845-5ed0-42ff-96c7-519856ddb3d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=535dfc394c5144dabba40dc8e02cc4a2)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:40.637182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4c845-5ed0-42ff-96c7-519856ddb3d7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:40.727071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c5f4c845-5ed0-42ff-96c7-519856ddb3d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '535dfc394c5144dabba40dc8e02cc4a2', 'request_id': 'req-c5f4c845-5ed0-42ff-96c7-519856ddb3d7'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:40.741745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c5f4c845-5ed0-42ff-96c7-519856ddb3d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '535dfc394c5144dabba40dc8e02cc4a2', 'request_id': 'req-c5f4c845-5ed0-42ff-96c7-519856ddb3d7'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:40.766517 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c5f4c845-5ed0-42ff-96c7-519856ddb3d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '535dfc394c5144dabba40dc8e02cc4a2', 'request_id': 'req-c5f4c845-5ed0-42ff-96c7-519856ddb3d7'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:40.795360 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c5f4c845-5ed0-42ff-96c7-519856ddb3d7 admin admin] The token cache is being invalidate because project 535dfc394c5144dabba40dc8e02cc4a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:40.795662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c5f4c845-5ed0-42ff-96c7-519856ddb3d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:40.797071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c5f4c845-5ed0-42ff-96c7-519856ddb3d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:40.802150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 858/1715] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:40 2022] DELETE /identity/v3/projects/535dfc394c5144dabba40dc8e02cc4a2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:40.806513 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469a444-13a1-4d89-ab8f-0043901b425a service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:40.819107 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469a444-13a1-4d89-ab8f-0043901b425a service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:40.923892 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ba56b-def1-4587-8133-35d7cfbbd343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:40.924792 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ba56b-def1-4587-8133-35d7cfbbd343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:40.925544 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ba56b-def1-4587-8133-35d7cfbbd343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:40.925866 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ba56b-def1-4587-8133-35d7cfbbd343 admin admin] PATH_INFO: `/v3/users/eba2f89ffc4b463ba3c4f3502e6de778` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:40.933295 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ba56b-def1-4587-8133-35d7cfbbd343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eba2f89ffc4b463ba3c4f3502e6de778)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:40.937806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ba56b-def1-4587-8133-35d7cfbbd343 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:41.044349 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-777ba56b-def1-4587-8133-35d7cfbbd343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eba2f89ffc4b463ba3c4f3502e6de778'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:41.050285 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-777ba56b-def1-4587-8133-35d7cfbbd343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eba2f89ffc4b463ba3c4f3502e6de778'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:41.051033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-777ba56b-def1-4587-8133-35d7cfbbd343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eba2f89ffc4b463ba3c4f3502e6de778'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:41.066853 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-777ba56b-def1-4587-8133-35d7cfbbd343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eba2f89ffc4b463ba3c4f3502e6de778'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:41.084045 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-777ba56b-def1-4587-8133-35d7cfbbd343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eba2f89ffc4b463ba3c4f3502e6de778'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:41.115040 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 858/1716] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:40 2022] DELETE /identity/v3/users/eba2f89ffc4b463ba3c4f3502e6de778 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:41.640730 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4c845-5ed0-42ff-96c7-519856ddb3d7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:41.643408 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c5f4c845-5ed0-42ff-96c7-519856ddb3d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:41.701925 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4c845-5ed0-42ff-96c7-519856ddb3d7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:41.822012 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13857978-d7c6-498c-a2c4-90d8ace5c593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:41.822993 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13857978-d7c6-498c-a2c4-90d8ace5c593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:41.823472 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13857978-d7c6-498c-a2c4-90d8ace5c593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:41.823931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13857978-d7c6-498c-a2c4-90d8ace5c593 admin admin] PATH_INFO: `/v3/projects/d8a7785807484ed68dd4ca59747f2ec6` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:41.825385 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13857978-d7c6-498c-a2c4-90d8ace5c593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8a7785807484ed68dd4ca59747f2ec6)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:41.828162 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13857978-d7c6-498c-a2c4-90d8ace5c593 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:41.898328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:41.918328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-13857978-d7c6-498c-a2c4-90d8ace5c593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8a7785807484ed68dd4ca59747f2ec6', 'request_id': 'req-13857978-d7c6-498c-a2c4-90d8ace5c593'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:41.934602 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-13857978-d7c6-498c-a2c4-90d8ace5c593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8a7785807484ed68dd4ca59747f2ec6', 'request_id': 'req-13857978-d7c6-498c-a2c4-90d8ace5c593'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:41.943754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-13857978-d7c6-498c-a2c4-90d8ace5c593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8a7785807484ed68dd4ca59747f2ec6', 'request_id': 'req-13857978-d7c6-498c-a2c4-90d8ace5c593'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:41.968707 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-13857978-d7c6-498c-a2c4-90d8ace5c593 admin admin] The token cache is being invalidate because project d8a7785807484ed68dd4ca59747f2ec6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:41.969006 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-13857978-d7c6-498c-a2c4-90d8ace5c593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:41.970072 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-13857978-d7c6-498c-a2c4-90d8ace5c593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:41.987471 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 859/1717] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:41 2022] DELETE /identity/v3/projects/d8a7785807484ed68dd4ca59747f2ec6 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:41.992452 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ba56b-def1-4587-8133-35d7cfbbd343 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:41.994461 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-777ba56b-def1-4587-8133-35d7cfbbd343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:42.031754 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ba56b-def1-4587-8133-35d7cfbbd343 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:42.130987 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:42.153670 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b3f3f-7945-4dab-9571-074e05f73518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:42.154423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b3f3f-7945-4dab-9571-074e05f73518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:42.155174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b3f3f-7945-4dab-9571-074e05f73518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:42.155297 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b3f3f-7945-4dab-9571-074e05f73518 admin admin] PATH_INFO: `/v3/users/cae4bbae93b945d5991a539ac099bf38` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:42.156505 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b3f3f-7945-4dab-9571-074e05f73518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cae4bbae93b945d5991a539ac099bf38)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:42.159160 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b3f3f-7945-4dab-9571-074e05f73518 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:42.256007 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-885b3f3f-7945-4dab-9571-074e05f73518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cae4bbae93b945d5991a539ac099bf38'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:42.257080 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-885b3f3f-7945-4dab-9571-074e05f73518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cae4bbae93b945d5991a539ac099bf38'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:42.257762 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-885b3f3f-7945-4dab-9571-074e05f73518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cae4bbae93b945d5991a539ac099bf38'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:42.273281 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-885b3f3f-7945-4dab-9571-074e05f73518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cae4bbae93b945d5991a539ac099bf38'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:42.287037 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-885b3f3f-7945-4dab-9571-074e05f73518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cae4bbae93b945d5991a539ac099bf38'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:42.310566 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 859/1718] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:41 2022] DELETE /identity/v3/users/cae4bbae93b945d5991a539ac099bf38 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:42.376134 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13857978-d7c6-498c-a2c4-90d8ace5c593 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:42.377968 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-13857978-d7c6-498c-a2c4-90d8ace5c593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:42.402996 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13857978-d7c6-498c-a2c4-90d8ace5c593 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:42.535908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49344f-3404-4153-8aff-06ab30b7bd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:42.536799 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49344f-3404-4153-8aff-06ab30b7bd63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:42.537091 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49344f-3404-4153-8aff-06ab30b7bd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:42.537529 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49344f-3404-4153-8aff-06ab30b7bd63 admin admin] PATH_INFO: `/v3/users/c9d745ed2a564d2f8075fc9f608edf4b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:42.539061 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49344f-3404-4153-8aff-06ab30b7bd63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9d745ed2a564d2f8075fc9f608edf4b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:42.541875 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49344f-3404-4153-8aff-06ab30b7bd63 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:42.658129 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da49344f-3404-4153-8aff-06ab30b7bd63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d745ed2a564d2f8075fc9f608edf4b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:42.670741 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da49344f-3404-4153-8aff-06ab30b7bd63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d745ed2a564d2f8075fc9f608edf4b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:42.671598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da49344f-3404-4153-8aff-06ab30b7bd63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d745ed2a564d2f8075fc9f608edf4b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:42.707890 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da49344f-3404-4153-8aff-06ab30b7bd63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d745ed2a564d2f8075fc9f608edf4b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:42.724229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da49344f-3404-4153-8aff-06ab30b7bd63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d745ed2a564d2f8075fc9f608edf4b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:42.739467 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 860/1719] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:42 2022] DELETE /identity/v3/users/c9d745ed2a564d2f8075fc9f608edf4b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:42.741603 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d7c9d-cf8d-40f2-a245-3769a53fb87a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:42.742058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d7c9d-cf8d-40f2-a245-3769a53fb87a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:42.742337 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d7c9d-cf8d-40f2-a245-3769a53fb87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:42.778358 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-026d7c9d-cf8d-40f2-a245-3769a53fb87a None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:42.779983 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-026d7c9d-cf8d-40f2-a245-3769a53fb87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:42.829329 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49344f-3404-4153-8aff-06ab30b7bd63 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:42.831498 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-da49344f-3404-4153-8aff-06ab30b7bd63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:42.903184 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 860/1720] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:42.915834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d7c9d-cf8d-40f2-a245-3769a53fb87a None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:42.917645 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-026d7c9d-cf8d-40f2-a245-3769a53fb87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:42.945436 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:42.979014 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49344f-3404-4153-8aff-06ab30b7bd63 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:43.017932 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef863e45-859b-4c97-a188-64245503e9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:43.018595 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef863e45-859b-4c97-a188-64245503e9b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:43.019190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef863e45-859b-4c97-a188-64245503e9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:43.019190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef863e45-859b-4c97-a188-64245503e9b6 admin admin] PATH_INFO: `/v3/projects/6372f7cf73f7408eaa113e1ba2ed1721` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:43.020436 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef863e45-859b-4c97-a188-64245503e9b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6372f7cf73f7408eaa113e1ba2ed1721)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:43.023203 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef863e45-859b-4c97-a188-64245503e9b6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:43.052319 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d7c9d-cf8d-40f2-a245-3769a53fb87a None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:43.059977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb50d98-77cb-4af9-b0a4-c769c5d2f8a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:43.061028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb50d98-77cb-4af9-b0a4-c769c5d2f8a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:43.061559 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb50d98-77cb-4af9-b0a4-c769c5d2f8a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:43.062057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb50d98-77cb-4af9-b0a4-c769c5d2f8a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:43.090838 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb50d98-77cb-4af9-b0a4-c769c5d2f8a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:43.094774 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb50d98-77cb-4af9-b0a4-c769c5d2f8a0 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:43.132529 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 861/1721] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:43.192435 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ef863e45-859b-4c97-a188-64245503e9b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6372f7cf73f7408eaa113e1ba2ed1721', 'request_id': 'req-ef863e45-859b-4c97-a188-64245503e9b6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:43.203501 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ef863e45-859b-4c97-a188-64245503e9b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6372f7cf73f7408eaa113e1ba2ed1721', 'request_id': 'req-ef863e45-859b-4c97-a188-64245503e9b6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:43.215205 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ef863e45-859b-4c97-a188-64245503e9b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6372f7cf73f7408eaa113e1ba2ed1721', 'request_id': 'req-ef863e45-859b-4c97-a188-64245503e9b6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:43.235004 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ef863e45-859b-4c97-a188-64245503e9b6 admin admin] The token cache is being invalidate because project 6372f7cf73f7408eaa113e1ba2ed1721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:43.235600 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ef863e45-859b-4c97-a188-64245503e9b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:43.236879 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ef863e45-859b-4c97-a188-64245503e9b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:43.240089 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 861/1722] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:42 2022] DELETE /identity/v3/projects/6372f7cf73f7408eaa113e1ba2ed1721 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:33:43.253884 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91b7aa-ec05-4277-8fe1-d1f3bd6c5151 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:43.254101 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91b7aa-ec05-4277-8fe1-d1f3bd6c5151 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:43.254380 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91b7aa-ec05-4277-8fe1-d1f3bd6c5151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:43.302193 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:43.325040 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-fe91b7aa-ec05-4277-8fe1-d1f3bd6c5151 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:43.327486 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-fe91b7aa-ec05-4277-8fe1-d1f3bd6c5151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:43.455434 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 862/1723] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:43.459266 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90045d-0fb4-476a-97e4-db1832b1b422 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:43.459581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90045d-0fb4-476a-97e4-db1832b1b422 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:43.460624 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90045d-0fb4-476a-97e4-db1832b1b422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:43.491547 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ab90045d-0fb4-476a-97e4-db1832b1b422 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:43.494742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ab90045d-0fb4-476a-97e4-db1832b1b422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:43.509200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 862/1724] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:43.512371 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91b7aa-ec05-4277-8fe1-d1f3bd6c5151 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:43.529532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91b7aa-ec05-4277-8fe1-d1f3bd6c5151 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:43.534928 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077cb2b-cc0c-48f9-9bc9-28a2e8251264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:43.535741 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077cb2b-cc0c-48f9-9bc9-28a2e8251264 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:43.536544 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077cb2b-cc0c-48f9-9bc9-28a2e8251264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:43.536544 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077cb2b-cc0c-48f9-9bc9-28a2e8251264 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:43.537143 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077cb2b-cc0c-48f9-9bc9-28a2e8251264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:33:43.537458 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077cb2b-cc0c-48f9-9bc9-28a2e8251264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:43.539313 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077cb2b-cc0c-48f9-9bc9-28a2e8251264 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:43.555263 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 863/1725] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:33:43.560375 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90045d-0fb4-476a-97e4-db1832b1b422 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:43.570058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90045d-0fb4-476a-97e4-db1832b1b422 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:43.574936 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077cb2b-cc0c-48f9-9bc9-28a2e8251264 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:43.575766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450311c-57f3-4e0f-9d03-fd33a2dabb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:43.576518 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450311c-57f3-4e0f-9d03-fd33a2dabb0f admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:43.576866 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450311c-57f3-4e0f-9d03-fd33a2dabb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:43.577285 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450311c-57f3-4e0f-9d03-fd33a2dabb0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:43.577469 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a077cb2b-cc0c-48f9-9bc9-28a2e8251264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:43.578063 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450311c-57f3-4e0f-9d03-fd33a2dabb0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:43.580075 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450311c-57f3-4e0f-9d03-fd33a2dabb0f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:43.601568 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077cb2b-cc0c-48f9-9bc9-28a2e8251264 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:43.614364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 863/1726] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:43 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:33:43.615320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450311c-57f3-4e0f-9d03-fd33a2dabb0f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:43.617209 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884dd5b3-03fc-4946-8f66-2c22505a824d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:43.617847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884dd5b3-03fc-4946-8f66-2c22505a824d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:43.618737 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884dd5b3-03fc-4946-8f66-2c22505a824d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:43.619128 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884dd5b3-03fc-4946-8f66-2c22505a824d admin admin] PATH_INFO: `/v3/projects/dfa730e6fb414147b4bac521218ed889` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:43.620457 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884dd5b3-03fc-4946-8f66-2c22505a824d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfa730e6fb414147b4bac521218ed889)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:43.622597 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884dd5b3-03fc-4946-8f66-2c22505a824d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:43.689389 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450311c-57f3-4e0f-9d03-fd33a2dabb0f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:43.703005 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-884dd5b3-03fc-4946-8f66-2c22505a824d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfa730e6fb414147b4bac521218ed889', 'request_id': 'req-884dd5b3-03fc-4946-8f66-2c22505a824d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:43.713321 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-884dd5b3-03fc-4946-8f66-2c22505a824d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfa730e6fb414147b4bac521218ed889', 'request_id': 'req-884dd5b3-03fc-4946-8f66-2c22505a824d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:43.726281 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-884dd5b3-03fc-4946-8f66-2c22505a824d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfa730e6fb414147b4bac521218ed889', 'request_id': 'req-884dd5b3-03fc-4946-8f66-2c22505a824d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:43.742084 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-884dd5b3-03fc-4946-8f66-2c22505a824d admin admin] The token cache is being invalidate because project dfa730e6fb414147b4bac521218ed889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:43.742630 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-884dd5b3-03fc-4946-8f66-2c22505a824d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:43.744225 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-884dd5b3-03fc-4946-8f66-2c22505a824d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:43.746753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 864/1727] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:43 2022] DELETE /identity/v3/projects/dfa730e6fb414147b4bac521218ed889 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:33:43.748464 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb51ad-85ba-4c99-b3f1-12d25eabb6ec None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:43.749154 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb51ad-85ba-4c99-b3f1-12d25eabb6ec None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:43.749638 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb51ad-85ba-4c99-b3f1-12d25eabb6ec None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:43.751111 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 865/1728] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 31 12:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:33:43.752031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb51ad-85ba-4c99-b3f1-12d25eabb6ec None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:43.753957 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:43.758792 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-02bb51ad-85ba-4c99-b3f1-12d25eabb6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:43.781558 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e5007-7e12-4795-a08d-b18103eec0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:43.781558 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e5007-7e12-4795-a08d-b18103eec0c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:43.781558 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e5007-7e12-4795-a08d-b18103eec0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:43.781558 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e5007-7e12-4795-a08d-b18103eec0c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:43.781945 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e5007-7e12-4795-a08d-b18103eec0c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:43.781945 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e5007-7e12-4795-a08d-b18103eec0c2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:43.792577 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb51ad-85ba-4c99-b3f1-12d25eabb6ec None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:43.798213 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b19dd4-80b4-42d3-ad87-0906adf50974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:43.798789 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b19dd4-80b4-42d3-ad87-0906adf50974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:43.799079 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b19dd4-80b4-42d3-ad87-0906adf50974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:43.799492 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b19dd4-80b4-42d3-ad87-0906adf50974 admin admin] PATH_INFO: `/v3/users/43d8bb9225ce4f6fb9dbd2d38f0832ce` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:43.800657 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b19dd4-80b4-42d3-ad87-0906adf50974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43d8bb9225ce4f6fb9dbd2d38f0832ce)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:43.802850 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b19dd4-80b4-42d3-ad87-0906adf50974 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:43.804494 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 864/1729] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:43 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:43.806129 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e5007-7e12-4795-a08d-b18103eec0c2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:43.807916 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4a8e5007-7e12-4795-a08d-b18103eec0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:43.820241 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e5007-7e12-4795-a08d-b18103eec0c2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:43.825298 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb95148-f9b2-437c-9487-8c0112ce72de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:43.826011 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb95148-f9b2-437c-9487-8c0112ce72de admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:43.826362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb95148-f9b2-437c-9487-8c0112ce72de admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:43.826734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb95148-f9b2-437c-9487-8c0112ce72de admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:43.827468 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb95148-f9b2-437c-9487-8c0112ce72de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:43.829203 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb95148-f9b2-437c-9487-8c0112ce72de admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:43.841387 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 865/1730] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:33:43.845558 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb95148-f9b2-437c-9487-8c0112ce72de admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:43.857987 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb95148-f9b2-437c-9487-8c0112ce72de admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:43.860839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-11b19dd4-80b4-42d3-ad87-0906adf50974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43d8bb9225ce4f6fb9dbd2d38f0832ce'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:43.861586 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-11b19dd4-80b4-42d3-ad87-0906adf50974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43d8bb9225ce4f6fb9dbd2d38f0832ce'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:43.862224 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-11b19dd4-80b4-42d3-ad87-0906adf50974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43d8bb9225ce4f6fb9dbd2d38f0832ce'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:43.873208 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4dee57-62d3-45ff-8351-10d64bdfbd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:43.873208 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dee57-62d3-45ff-8351-10d64bdfbd10 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:43.873208 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dee57-62d3-45ff-8351-10d64bdfbd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:43.873208 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dee57-62d3-45ff-8351-10d64bdfbd10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:43.873669 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4dee57-62d3-45ff-8351-10d64bdfbd10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:43.873669 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4dee57-62d3-45ff-8351-10d64bdfbd10 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:43.879928 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-11b19dd4-80b4-42d3-ad87-0906adf50974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43d8bb9225ce4f6fb9dbd2d38f0832ce'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:43.889546 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 866/1731] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:43.889747 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-11b19dd4-80b4-42d3-ad87-0906adf50974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43d8bb9225ce4f6fb9dbd2d38f0832ce'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:43.891142 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4dee57-62d3-45ff-8351-10d64bdfbd10 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:43.893073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9a4dee57-62d3-45ff-8351-10d64bdfbd10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:43.899071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:43.908378 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4dee57-62d3-45ff-8351-10d64bdfbd10 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:43.913159 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 866/1732] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:43 2022] DELETE /identity/v3/users/43d8bb9225ce4f6fb9dbd2d38f0832ce => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:43.914473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944277d7-9931-4ba5-a9aa-d83cc020121a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:43.915679 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944277d7-9931-4ba5-a9aa-d83cc020121a admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:43.915986 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944277d7-9931-4ba5-a9aa-d83cc020121a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:43.916339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944277d7-9931-4ba5-a9aa-d83cc020121a admin admin] PATH_INFO: `/v3/projects/5d37bb88199948849a9b5a6c87366eda/users/5f1d1542254441bab49f8a630158c6f4/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:43.934329 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944277d7-9931-4ba5-a9aa-d83cc020121a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d37bb88199948849a9b5a6c87366eda, user_id=5f1d1542254441bab49f8a630158c6f4, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:43.937064 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944277d7-9931-4ba5-a9aa-d83cc020121a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:43.956776 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 867/1733] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:43 2022] PUT /identity/v3/projects/5d37bb88199948849a9b5a6c87366eda/users/5f1d1542254441bab49f8a630158c6f4/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:33:43.969013 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f6ce0-f454-4669-8888-4a3460918790 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:43.969504 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f6ce0-f454-4669-8888-4a3460918790 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:43.970210 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f6ce0-f454-4669-8888-4a3460918790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:44.004594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-a12f6ce0-f454-4669-8888-4a3460918790 None None] MFA Rules not processed for user `5f1d1542254441bab49f8a630158c6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:44.006689 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a12f6ce0-f454-4669-8888-4a3460918790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:44.010099 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378ebeb-9bdf-46ee-8ea3-73bf9bd9ad3b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:44.010477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378ebeb-9bdf-46ee-8ea3-73bf9bd9ad3b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:44.010880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378ebeb-9bdf-46ee-8ea3-73bf9bd9ad3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:44.056352 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a378ebeb-9bdf-46ee-8ea3-73bf9bd9ad3b None None] MFA Rules not processed for user `18c015b8317b4517911f69bef21a0573`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:44.058319 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a378ebeb-9bdf-46ee-8ea3-73bf9bd9ad3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:44.097690 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 867/1734] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:44.098828 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f6ce0-f454-4669-8888-4a3460918790 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:44.105148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a12f6ce0-f454-4669-8888-4a3460918790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:44.141548 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 868/1735] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 31 12:33:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:44.142121 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378ebeb-9bdf-46ee-8ea3-73bf9bd9ad3b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:44.184224 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f6ce0-f454-4669-8888-4a3460918790 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:44.189162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a8107-f984-4fa9-a2cf-1ada5e8fe029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:44.189798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a8107-f984-4fa9-a2cf-1ada5e8fe029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:44.190075 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a8107-f984-4fa9-a2cf-1ada5e8fe029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:44.190349 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a8107-f984-4fa9-a2cf-1ada5e8fe029 admin admin] PATH_INFO: `/v3/users/495f60d6b5c74627b42e98bc867723c1` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:44.191499 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a8107-f984-4fa9-a2cf-1ada5e8fe029 admin admin] RBAC: Authorizing `identity:delete_user(user_id=495f60d6b5c74627b42e98bc867723c1)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:44.193516 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a8107-f984-4fa9-a2cf-1ada5e8fe029 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:44.222953 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378ebeb-9bdf-46ee-8ea3-73bf9bd9ad3b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:44.230604 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976d261-7d1b-45cf-903d-c3d4b7e7e855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:44.231815 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976d261-7d1b-45cf-903d-c3d4b7e7e855 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:44.232130 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976d261-7d1b-45cf-903d-c3d4b7e7e855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:44.232738 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976d261-7d1b-45cf-903d-c3d4b7e7e855 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:44.233563 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976d261-7d1b-45cf-903d-c3d4b7e7e855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:44.236108 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976d261-7d1b-45cf-903d-c3d4b7e7e855 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:44.245991 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dd9a8107-f984-4fa9-a2cf-1ada5e8fe029 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '495f60d6b5c74627b42e98bc867723c1'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:44.246867 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dd9a8107-f984-4fa9-a2cf-1ada5e8fe029 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '495f60d6b5c74627b42e98bc867723c1'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:44.247748 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dd9a8107-f984-4fa9-a2cf-1ada5e8fe029 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '495f60d6b5c74627b42e98bc867723c1'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:44.259718 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dd9a8107-f984-4fa9-a2cf-1ada5e8fe029 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '495f60d6b5c74627b42e98bc867723c1'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:44.267139 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dd9a8107-f984-4fa9-a2cf-1ada5e8fe029 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '495f60d6b5c74627b42e98bc867723c1'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:44.275338 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 869/1736] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:44 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:44.276433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976d261-7d1b-45cf-903d-c3d4b7e7e855 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:44.278370 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9976d261-7d1b-45cf-903d-c3d4b7e7e855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:44.285361 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:44.295803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 868/1737] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:44 2022] DELETE /identity/v3/users/495f60d6b5c74627b42e98bc867723c1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:44.296710 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a8107-f984-4fa9-a2cf-1ada5e8fe029 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:44.298944 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-dd9a8107-f984-4fa9-a2cf-1ada5e8fe029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:44.305905 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:44.375178 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a8107-f984-4fa9-a2cf-1ada5e8fe029 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:44.380611 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27ef2f-94aa-482a-aa83-a954540dd64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:44.381984 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27ef2f-94aa-482a-aa83-a954540dd64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:44.382270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27ef2f-94aa-482a-aa83-a954540dd64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:44.382555 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27ef2f-94aa-482a-aa83-a954540dd64c admin admin] PATH_INFO: `/v3/projects/3c4439a847074b8dbebfa2a78ecde1ce` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:44.384545 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27ef2f-94aa-482a-aa83-a954540dd64c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c4439a847074b8dbebfa2a78ecde1ce)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:44.387163 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27ef2f-94aa-482a-aa83-a954540dd64c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:44.391046 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976d261-7d1b-45cf-903d-c3d4b7e7e855 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:44.460805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-eb27ef2f-94aa-482a-aa83-a954540dd64c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c4439a847074b8dbebfa2a78ecde1ce', 'request_id': 'req-eb27ef2f-94aa-482a-aa83-a954540dd64c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:44.469977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-eb27ef2f-94aa-482a-aa83-a954540dd64c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c4439a847074b8dbebfa2a78ecde1ce', 'request_id': 'req-eb27ef2f-94aa-482a-aa83-a954540dd64c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:44.474417 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb58811-289e-4daf-84d3-c690b1374b5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18c015b8317b4517911f69bef21a0573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:44.475054 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb58811-289e-4daf-84d3-c690b1374b5c service placement] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:44.475335 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb58811-289e-4daf-84d3-c690b1374b5c service placement] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:44.475636 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb58811-289e-4daf-84d3-c690b1374b5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:44.477463 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ecb58811-289e-4daf-84d3-c690b1374b5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:44.477936 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-eb27ef2f-94aa-482a-aa83-a954540dd64c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c4439a847074b8dbebfa2a78ecde1ce', 'request_id': 'req-eb27ef2f-94aa-482a-aa83-a954540dd64c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:44.493331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-eb27ef2f-94aa-482a-aa83-a954540dd64c admin admin] The token cache is being invalidate because project 3c4439a847074b8dbebfa2a78ecde1ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:44.494048 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-eb27ef2f-94aa-482a-aa83-a954540dd64c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:44.494402 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-eb27ef2f-94aa-482a-aa83-a954540dd64c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:44.495933 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 869/1738] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:44 2022] DELETE /identity/v3/projects/3c4439a847074b8dbebfa2a78ecde1ce => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:44.499694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27ef2f-94aa-482a-aa83-a954540dd64c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:44.499694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-eb27ef2f-94aa-482a-aa83-a954540dd64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:44.499878 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb58811-289e-4daf-84d3-c690b1374b5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:44.501517 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb58811-289e-4daf-84d3-c690b1374b5c service placement] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:44.515212 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 870/1739] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:44.516558 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5285ad4-dbc1-4968-a254-2fc5a82db05b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:44.516845 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5285ad4-dbc1-4968-a254-2fc5a82db05b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:44.517231 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5285ad4-dbc1-4968-a254-2fc5a82db05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:44.542270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b5285ad4-dbc1-4968-a254-2fc5a82db05b None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:44.543474 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b5285ad4-dbc1-4968-a254-2fc5a82db05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:44.623954 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27ef2f-94aa-482a-aa83-a954540dd64c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:44.629207 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ffb3e-8038-47d5-8469-61e4ec6fc46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:44.629821 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ffb3e-8038-47d5-8469-61e4ec6fc46a admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:44.630101 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ffb3e-8038-47d5-8469-61e4ec6fc46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:44.630372 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ffb3e-8038-47d5-8469-61e4ec6fc46a admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:44.631012 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ffb3e-8038-47d5-8469-61e4ec6fc46a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:44.634101 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ffb3e-8038-47d5-8469-61e4ec6fc46a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:44.650405 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 871/1740] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:44.651260 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5285ad4-dbc1-4968-a254-2fc5a82db05b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:44.652681 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b5285ad4-dbc1-4968-a254-2fc5a82db05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:44.672763 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5285ad4-dbc1-4968-a254-2fc5a82db05b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:44.672919 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 870/1741] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:44 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:44.672919 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c8805-6ed9-455a-b338-ef9192997d08 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:44.672919 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c8805-6ed9-455a-b338-ef9192997d08 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:44.672919 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c8805-6ed9-455a-b338-ef9192997d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:44.677285 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c48011-9dad-40b7-85cd-3304df3c5a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:44.678032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c48011-9dad-40b7-85cd-3304df3c5a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:44.678317 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c48011-9dad-40b7-85cd-3304df3c5a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:44.678593 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c48011-9dad-40b7-85cd-3304df3c5a85 admin admin] PATH_INFO: `/v3/projects/df7a234ee92f4cc2b367cfbe296b5216` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:44.679748 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c48011-9dad-40b7-85cd-3304df3c5a85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df7a234ee92f4cc2b367cfbe296b5216)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:44.681806 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c48011-9dad-40b7-85cd-3304df3c5a85 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:44.692933 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-a35c8805-6ed9-455a-b338-ef9192997d08 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:44.694332 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a35c8805-6ed9-455a-b338-ef9192997d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:44.703171 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 871/1742] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:44.703949 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c8805-6ed9-455a-b338-ef9192997d08 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:44.715380 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c8805-6ed9-455a-b338-ef9192997d08 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:44.720601 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69870923-ab36-42d5-9cd5-603876ed0a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:44.721242 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69870923-ab36-42d5-9cd5-603876ed0a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:44.721551 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69870923-ab36-42d5-9cd5-603876ed0a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:44.721824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69870923-ab36-42d5-9cd5-603876ed0a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:44.722475 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69870923-ab36-42d5-9cd5-603876ed0a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:44.724155 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69870923-ab36-42d5-9cd5-603876ed0a43 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:44.735146 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:44.735366 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 872/1743] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:44.736859 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69870923-ab36-42d5-9cd5-603876ed0a43 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:44.741631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:44.743979 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-97c48011-9dad-40b7-85cd-3304df3c5a85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df7a234ee92f4cc2b367cfbe296b5216', 'request_id': 'req-97c48011-9dad-40b7-85cd-3304df3c5a85'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:44.747801 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69870923-ab36-42d5-9cd5-603876ed0a43 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:44.752700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-97c48011-9dad-40b7-85cd-3304df3c5a85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df7a234ee92f4cc2b367cfbe296b5216', 'request_id': 'req-97c48011-9dad-40b7-85cd-3304df3c5a85'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:44.759660 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-97c48011-9dad-40b7-85cd-3304df3c5a85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df7a234ee92f4cc2b367cfbe296b5216', 'request_id': 'req-97c48011-9dad-40b7-85cd-3304df3c5a85'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:44.772328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-97c48011-9dad-40b7-85cd-3304df3c5a85 admin admin] The token cache is being invalidate because project df7a234ee92f4cc2b367cfbe296b5216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:44.772628 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-97c48011-9dad-40b7-85cd-3304df3c5a85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:44.773340 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-97c48011-9dad-40b7-85cd-3304df3c5a85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:44.774879 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 872/1744] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:44 2022] DELETE /identity/v3/projects/df7a234ee92f4cc2b367cfbe296b5216 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:44.775766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c48011-9dad-40b7-85cd-3304df3c5a85 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:44.777155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-97c48011-9dad-40b7-85cd-3304df3c5a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:44.817894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6bbb4-4463-44a6-a710-2d3a4b2eef12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:44.818496 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6bbb4-4463-44a6-a710-2d3a4b2eef12 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:44.818915 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6bbb4-4463-44a6-a710-2d3a4b2eef12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:44.819202 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6bbb4-4463-44a6-a710-2d3a4b2eef12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:44.819886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6bbb4-4463-44a6-a710-2d3a4b2eef12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:33:44.820203 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6bbb4-4463-44a6-a710-2d3a4b2eef12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:44.822402 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6bbb4-4463-44a6-a710-2d3a4b2eef12 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:44.837660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 873/1745] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:33:44.839024 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a33ff-4801-41ed-89eb-58825547c1aa None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:44.839428 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a33ff-4801-41ed-89eb-58825547c1aa None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:44.839709 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a33ff-4801-41ed-89eb-58825547c1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:44.858870 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c48011-9dad-40b7-85cd-3304df3c5a85 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:44.862131 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-383a33ff-4801-41ed-89eb-58825547c1aa None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:44.863328 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-383a33ff-4801-41ed-89eb-58825547c1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:44.864728 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089a197-a5fb-4130-b788-0a48366cf4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:44.865385 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089a197-a5fb-4130-b788-0a48366cf4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:44.865666 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089a197-a5fb-4130-b788-0a48366cf4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:44.866323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089a197-a5fb-4130-b788-0a48366cf4f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:44.866652 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089a197-a5fb-4130-b788-0a48366cf4f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:44.868855 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089a197-a5fb-4130-b788-0a48366cf4f6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:44.880965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 874/1746] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:44.880965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a33ff-4801-41ed-89eb-58825547c1aa None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:44.882596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-383a33ff-4801-41ed-89eb-58825547c1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:44.890873 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 873/1747] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:44.890873 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232a8fc-2b13-42cf-a84c-0fa60ff79df2 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:44.890873 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232a8fc-2b13-42cf-a84c-0fa60ff79df2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:44.890873 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232a8fc-2b13-42cf-a84c-0fa60ff79df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:44.895800 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a33ff-4801-41ed-89eb-58825547c1aa None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:44.901361 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483262a9-190d-4e1f-a553-980afa17fcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:44.901972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483262a9-190d-4e1f-a553-980afa17fcfd admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:44.902247 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483262a9-190d-4e1f-a553-980afa17fcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:44.902518 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483262a9-190d-4e1f-a553-980afa17fcfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:44.903169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483262a9-190d-4e1f-a553-980afa17fcfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:44.905076 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483262a9-190d-4e1f-a553-980afa17fcfd admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:44.912485 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f232a8fc-2b13-42cf-a84c-0fa60ff79df2 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:44.913727 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f232a8fc-2b13-42cf-a84c-0fa60ff79df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:44.922338 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 874/1748] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:44.923039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232a8fc-2b13-42cf-a84c-0fa60ff79df2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:44.934143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232a8fc-2b13-42cf-a84c-0fa60ff79df2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:44.945844 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4dc113-3179-4835-bb61-0a9ae93d46e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:44.948195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dc113-3179-4835-bb61-0a9ae93d46e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:44.948195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dc113-3179-4835-bb61-0a9ae93d46e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:44.948461 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dc113-3179-4835-bb61-0a9ae93d46e5 admin admin] PATH_INFO: `/v3/projects/70245bff7f364b1b9065459fad0e5ed7/users/895e345b6fcc4b368ccc1d8ea89c62d7/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:44.950463 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 875/1749] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:44 2022] POST /identity/v3/projects => generated 401 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:44.951624 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483262a9-190d-4e1f-a553-980afa17fcfd admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:44.967936 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4dc113-3179-4835-bb61-0a9ae93d46e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70245bff7f364b1b9065459fad0e5ed7, user_id=895e345b6fcc4b368ccc1d8ea89c62d7, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:44.970643 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4dc113-3179-4835-bb61-0a9ae93d46e5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:44.985814 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 875/1750] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:44 2022] PUT /identity/v3/projects/70245bff7f364b1b9065459fad0e5ed7/users/895e345b6fcc4b368ccc1d8ea89c62d7/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:44.986508 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4dc113-3179-4835-bb61-0a9ae93d46e5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:45.035112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483262a9-190d-4e1f-a553-980afa17fcfd admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:45.056483 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4dc113-3179-4835-bb61-0a9ae93d46e5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:45.064864 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41c687-8b1e-4391-ba2b-68d257c4ac70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:45.064864 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41c687-8b1e-4391-ba2b-68d257c4ac70 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:45.064864 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41c687-8b1e-4391-ba2b-68d257c4ac70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:45.064864 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41c687-8b1e-4391-ba2b-68d257c4ac70 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:45.065319 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41c687-8b1e-4391-ba2b-68d257c4ac70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:45.067158 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41c687-8b1e-4391-ba2b-68d257c4ac70 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:45.091041 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 876/1751] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:44 2022] POST /identity/v3/users => generated 301 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:45.092204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05878764-9449-47a4-ba01-15dd3a5018af None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:45.092500 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05878764-9449-47a4-ba01-15dd3a5018af None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:45.092763 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05878764-9449-47a4-ba01-15dd3a5018af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:45.103435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d248e-b520-4cfd-ba69-ff020e97d139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:45.104051 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d248e-b520-4cfd-ba69-ff020e97d139 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:45.104334 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d248e-b520-4cfd-ba69-ff020e97d139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:45.104613 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d248e-b520-4cfd-ba69-ff020e97d139 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:45.105299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d248e-b520-4cfd-ba69-ff020e97d139 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:33:45.105605 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d248e-b520-4cfd-ba69-ff020e97d139 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:45.107230 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d248e-b520-4cfd-ba69-ff020e97d139 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:45.118965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 876/1752] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:33:45.122001 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d248e-b520-4cfd-ba69-ff020e97d139 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:45.123482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-05878764-9449-47a4-ba01-15dd3a5018af None None] MFA Rules not processed for user `895e345b6fcc4b368ccc1d8ea89c62d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:45.124698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-05878764-9449-47a4-ba01-15dd3a5018af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:45.132721 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d248e-b520-4cfd-ba69-ff020e97d139 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:45.137932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bccc8af-6c48-4aeb-bd38-c6a4869b8294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:45.138530 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccc8af-6c48-4aeb-bd38-c6a4869b8294 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:45.138814 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccc8af-6c48-4aeb-bd38-c6a4869b8294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:45.139089 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccc8af-6c48-4aeb-bd38-c6a4869b8294 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:45.139734 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bccc8af-6c48-4aeb-bd38-c6a4869b8294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:45.141350 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bccc8af-6c48-4aeb-bd38-c6a4869b8294 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:45.142606 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:45.143222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:45.157714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 877/1753] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:45.157714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bccc8af-6c48-4aeb-bd38-c6a4869b8294 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:45.167438 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bccc8af-6c48-4aeb-bd38-c6a4869b8294 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:45.176910 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca231d-3f5e-4825-bff5-f0f2490c0639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:45.177488 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca231d-3f5e-4825-bff5-f0f2490c0639 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:45.177773 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca231d-3f5e-4825-bff5-f0f2490c0639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:45.178049 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca231d-3f5e-4825-bff5-f0f2490c0639 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:45.178696 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca231d-3f5e-4825-bff5-f0f2490c0639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:45.180656 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca231d-3f5e-4825-bff5-f0f2490c0639 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:45.192751 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 877/1754] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:45.193576 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05878764-9449-47a4-ba01-15dd3a5018af None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:45.204541 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05878764-9449-47a4-ba01-15dd3a5018af None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:45.209294 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65111334-6271-4ece-a66b-3c7eaffacc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:45.209933 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65111334-6271-4ece-a66b-3c7eaffacc1c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:45.210219 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65111334-6271-4ece-a66b-3c7eaffacc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:45.210495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65111334-6271-4ece-a66b-3c7eaffacc1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:45.211168 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65111334-6271-4ece-a66b-3c7eaffacc1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:45.212541 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 878/1755] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:45 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:45.213329 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65111334-6271-4ece-a66b-3c7eaffacc1c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:45.213439 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca231d-3f5e-4825-bff5-f0f2490c0639 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:45.224737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 878/1756] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:45.224737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65111334-6271-4ece-a66b-3c7eaffacc1c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:45.233725 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65111334-6271-4ece-a66b-3c7eaffacc1c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:45.279496 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca231d-3f5e-4825-bff5-f0f2490c0639 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:45.284354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6dd48-c39a-488b-83fe-cc9e861ecd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:45.284963 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6dd48-c39a-488b-83fe-cc9e861ecd76 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:45.285277 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6dd48-c39a-488b-83fe-cc9e861ecd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:45.285558 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6dd48-c39a-488b-83fe-cc9e861ecd76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:45.286301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6dd48-c39a-488b-83fe-cc9e861ecd76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:45.288207 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6dd48-c39a-488b-83fe-cc9e861ecd76 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:45.292352 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553e7da-646a-4d78-b8c0-31f333a4638f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:45.292966 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553e7da-646a-4d78-b8c0-31f333a4638f admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:45.293279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553e7da-646a-4d78-b8c0-31f333a4638f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:45.293557 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553e7da-646a-4d78-b8c0-31f333a4638f admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:45.294195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553e7da-646a-4d78-b8c0-31f333a4638f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:45.296094 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553e7da-646a-4d78-b8c0-31f333a4638f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:45.322141 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 879/1757] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:45 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:45.322336 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 879/1758] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:45 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:45.322645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553e7da-646a-4d78-b8c0-31f333a4638f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:45.323279 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6dd48-c39a-488b-83fe-cc9e861ecd76 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:45.332232 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553e7da-646a-4d78-b8c0-31f333a4638f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:45.388942 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6dd48-c39a-488b-83fe-cc9e861ecd76 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:45.390395 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e7a60-769a-4c5f-9648-7ad075923bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:45.391062 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e7a60-769a-4c5f-9648-7ad075923bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:45.391347 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e7a60-769a-4c5f-9648-7ad075923bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:45.391625 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e7a60-769a-4c5f-9648-7ad075923bfb admin admin] PATH_INFO: `/v3/projects/f8de7f5b29e04270b4a210a97cada822/users/0f8c3d66333843f793f66e73912baf1c/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:45.393887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52834c-fcb5-4cde-8312-d79e61d12d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:45.394489 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52834c-fcb5-4cde-8312-d79e61d12d61 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:45.394774 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52834c-fcb5-4cde-8312-d79e61d12d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:45.395045 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52834c-fcb5-4cde-8312-d79e61d12d61 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:45.395675 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52834c-fcb5-4cde-8312-d79e61d12d61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:45.397611 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52834c-fcb5-4cde-8312-d79e61d12d61 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:45.406706 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e7a60-769a-4c5f-9648-7ad075923bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8de7f5b29e04270b4a210a97cada822, user_id=0f8c3d66333843f793f66e73912baf1c, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:45.409651 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e7a60-769a-4c5f-9648-7ad075923bfb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:45.419137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 880/1759] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:45 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:33:45.420099 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52834c-fcb5-4cde-8312-d79e61d12d61 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:45.423281 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 880/1760] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:45 2022] PUT /identity/v3/projects/f8de7f5b29e04270b4a210a97cada822/users/0f8c3d66333843f793f66e73912baf1c/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:45.424351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e7a60-769a-4c5f-9648-7ad075923bfb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:45.431842 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52834c-fcb5-4cde-8312-d79e61d12d61 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:45.451712 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:45.482381 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:45.489667 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e7a60-769a-4c5f-9648-7ad075923bfb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:45.494863 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f784b2-fe66-4e13-91ae-8b919d88f8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:45.495464 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f784b2-fe66-4e13-91ae-8b919d88f8ad admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:45.495746 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f784b2-fe66-4e13-91ae-8b919d88f8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:45.496038 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f784b2-fe66-4e13-91ae-8b919d88f8ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:45.496387 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bb630-c539-40d8-ae02-ea1765fac751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:45.496657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f784b2-fe66-4e13-91ae-8b919d88f8ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:45.497002 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bb630-c539-40d8-ae02-ea1765fac751 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:45.497320 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bb630-c539-40d8-ae02-ea1765fac751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:45.497597 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bb630-c539-40d8-ae02-ea1765fac751 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:45.498245 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bb630-c539-40d8-ae02-ea1765fac751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:45.498341 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f784b2-fe66-4e13-91ae-8b919d88f8ad admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:45.499851 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bb630-c539-40d8-ae02-ea1765fac751 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:45.508081 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 881/1761] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:45.509697 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833f3ed-7d04-4e63-b347-2d097200b32c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:45.509979 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833f3ed-7d04-4e63-b347-2d097200b32c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:45.510247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833f3ed-7d04-4e63-b347-2d097200b32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:45.510548 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 881/1762] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:45.512972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bb630-c539-40d8-ae02-ea1765fac751 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:45.523747 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bb630-c539-40d8-ae02-ea1765fac751 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:45.528561 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1c369-1f58-4ace-849f-0766ef150947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:45.529290 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1c369-1f58-4ace-849f-0766ef150947 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:45.529575 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1c369-1f58-4ace-849f-0766ef150947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:45.529851 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1c369-1f58-4ace-849f-0766ef150947 admin admin] PATH_INFO: `/v3/projects/17c47883908043e3a3bf4a25b4ea965d/users/c817e5ff770d45dc9f9f96951fd3b2df/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:45.541733 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f833f3ed-7d04-4e63-b347-2d097200b32c None None] MFA Rules not processed for user `0f8c3d66333843f793f66e73912baf1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:45.542947 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f833f3ed-7d04-4e63-b347-2d097200b32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:45.545358 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1c369-1f58-4ace-849f-0766ef150947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c47883908043e3a3bf4a25b4ea965d, user_id=c817e5ff770d45dc9f9f96951fd3b2df, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:45.548218 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1c369-1f58-4ace-849f-0766ef150947 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:45.563123 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 882/1763] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:45 2022] PUT /identity/v3/projects/17c47883908043e3a3bf4a25b4ea965d/users/c817e5ff770d45dc9f9f96951fd3b2df/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:45.564001 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1c369-1f58-4ace-849f-0766ef150947 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:45.614492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 882/1764] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:45 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:45.615703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833f3ed-7d04-4e63-b347-2d097200b32c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:45.626479 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833f3ed-7d04-4e63-b347-2d097200b32c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:45.629028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1c369-1f58-4ace-849f-0766ef150947 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:45.638097 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ae535-9eae-4bc3-a0de-53dd781df6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:45.638732 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ae535-9eae-4bc3-a0de-53dd781df6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:45.639013 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ae535-9eae-4bc3-a0de-53dd781df6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:45.639288 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ae535-9eae-4bc3-a0de-53dd781df6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:45.640077 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ae535-9eae-4bc3-a0de-53dd781df6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:45.640836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591458f8-195c-4b47-96c2-25dcd2adc7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:45.641742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ae535-9eae-4bc3-a0de-53dd781df6f5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:45.642461 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591458f8-195c-4b47-96c2-25dcd2adc7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:45.642745 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591458f8-195c-4b47-96c2-25dcd2adc7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:45.643025 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591458f8-195c-4b47-96c2-25dcd2adc7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:45.645839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591458f8-195c-4b47-96c2-25dcd2adc7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:45.647477 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591458f8-195c-4b47-96c2-25dcd2adc7b2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:45.656768 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 883/1765] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:45.656768 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ae535-9eae-4bc3-a0de-53dd781df6f5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:45.659283 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 883/1766] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:45.660097 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591458f8-195c-4b47-96c2-25dcd2adc7b2 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:45.668995 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ae535-9eae-4bc3-a0de-53dd781df6f5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:45.670743 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591458f8-195c-4b47-96c2-25dcd2adc7b2 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:45.675149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5dfd5a-2a32-404e-a55b-ee72f22adf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:45.675379 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1c30f-b99b-499d-aa40-2c74f4759485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:45.675947 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dfd5a-2a32-404e-a55b-ee72f22adf67 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:45.676023 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1c30f-b99b-499d-aa40-2c74f4759485 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:45.676199 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dfd5a-2a32-404e-a55b-ee72f22adf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:45.676292 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1c30f-b99b-499d-aa40-2c74f4759485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:45.676452 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5dfd5a-2a32-404e-a55b-ee72f22adf67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:45.676547 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1c30f-b99b-499d-aa40-2c74f4759485 admin admin] PATH_INFO: `/v3/projects/17c47883908043e3a3bf4a25b4ea965d/users/c817e5ff770d45dc9f9f96951fd3b2df/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:45.677234 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5dfd5a-2a32-404e-a55b-ee72f22adf67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:45.679698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1c30f-b99b-499d-aa40-2c74f4759485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c47883908043e3a3bf4a25b4ea965d, user_id=c817e5ff770d45dc9f9f96951fd3b2df, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:45.681951 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5dfd5a-2a32-404e-a55b-ee72f22adf67 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:45.682360 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1c30f-b99b-499d-aa40-2c74f4759485 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:45.698108 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 884/1767] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:45 2022] PUT /identity/v3/projects/17c47883908043e3a3bf4a25b4ea965d/users/c817e5ff770d45dc9f9f96951fd3b2df/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:45.698801 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1c30f-b99b-499d-aa40-2c74f4759485 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:45.737872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 884/1768] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:45 2022] POST /identity/v3/projects => generated 399 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:45.739409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ce7cf-b98f-4f93-9754-12edd1853141 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:45.739703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ce7cf-b98f-4f93-9754-12edd1853141 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:45.739994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ce7cf-b98f-4f93-9754-12edd1853141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:45.777570 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1c30f-b99b-499d-aa40-2c74f4759485 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:45.779672 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ae5ce7cf-b98f-4f93-9754-12edd1853141 None None] MFA Rules not processed for user `c817e5ff770d45dc9f9f96951fd3b2df`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:45.781798 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ae5ce7cf-b98f-4f93-9754-12edd1853141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:45.838560 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:45.851181 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c1a3d-2ad5-48c7-a078-f1d82312ed8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:45.851865 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c1a3d-2ad5-48c7-a078-f1d82312ed8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:45.852142 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c1a3d-2ad5-48c7-a078-f1d82312ed8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:45.852984 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c1a3d-2ad5-48c7-a078-f1d82312ed8c admin admin] PATH_INFO: `/v3/projects/06bea92f08c64a62b8aa6bbe5f6bd993/users/0f78135e514d431fb72a649613e0e6b5/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:45.867135 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:45.869902 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c1a3d-2ad5-48c7-a078-f1d82312ed8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=06bea92f08c64a62b8aa6bbe5f6bd993, user_id=0f78135e514d431fb72a649613e0e6b5, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:45.875692 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 885/1769] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:45.875692 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ce7cf-b98f-4f93-9754-12edd1853141 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:45.875928 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c1a3d-2ad5-48c7-a078-f1d82312ed8c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:45.897854 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ce7cf-b98f-4f93-9754-12edd1853141 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:45.903813 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 885/1770] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:45 2022] PUT /identity/v3/projects/06bea92f08c64a62b8aa6bbe5f6bd993/users/0f78135e514d431fb72a649613e0e6b5/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:45.904700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c1a3d-2ad5-48c7-a078-f1d82312ed8c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:45.909826 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-615c1a3d-2ad5-48c7-a078-f1d82312ed8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:46.013629 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1663b-c0d0-4ff9-9732-3ee4e26a737b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:46.014150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1663b-c0d0-4ff9-9732-3ee4e26a737b admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:46.014426 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1663b-c0d0-4ff9-9732-3ee4e26a737b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:46.014712 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1663b-c0d0-4ff9-9732-3ee4e26a737b admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:46.015329 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1663b-c0d0-4ff9-9732-3ee4e26a737b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:46.018816 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1663b-c0d0-4ff9-9732-3ee4e26a737b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:46.018944 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c1a3d-2ad5-48c7-a078-f1d82312ed8c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:46.026502 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c2e05-3a40-4f69-bd81-e0aa84ac4ae2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:46.027179 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c2e05-3a40-4f69-bd81-e0aa84ac4ae2 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:46.027453 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c2e05-3a40-4f69-bd81-e0aa84ac4ae2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:46.028662 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c2e05-3a40-4f69-bd81-e0aa84ac4ae2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:46.030998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b20c2e05-3a40-4f69-bd81-e0aa84ac4ae2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:46.072638 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 886/1771] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:45 2022] POST /identity/v3/users => generated 306 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:46.073818 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb973c12-1161-463b-baef-f4b834226b6d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:46.074110 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb973c12-1161-463b-baef-f4b834226b6d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:46.074384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb973c12-1161-463b-baef-f4b834226b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:46.134227 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c2e05-3a40-4f69-bd81-e0aa84ac4ae2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:46.136853 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c2e05-3a40-4f69-bd81-e0aa84ac4ae2 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:46.144628 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-eb973c12-1161-463b-baef-f4b834226b6d None None] MFA Rules not processed for user `0f78135e514d431fb72a649613e0e6b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:46.145942 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-eb973c12-1161-463b-baef-f4b834226b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:46.148799 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 886/1772] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:46.149856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c2e05-3a40-4f69-bd81-e0aa84ac4ae2 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:46.171248 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c2e05-3a40-4f69-bd81-e0aa84ac4ae2 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:46.186444 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee768bc-af69-4a08-8c0b-1d5bc6bab78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:46.187490 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee768bc-af69-4a08-8c0b-1d5bc6bab78b admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:46.187490 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee768bc-af69-4a08-8c0b-1d5bc6bab78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:46.189857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee768bc-af69-4a08-8c0b-1d5bc6bab78b admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:46.191128 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee768bc-af69-4a08-8c0b-1d5bc6bab78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:46.197734 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee768bc-af69-4a08-8c0b-1d5bc6bab78b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:46.225557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 887/1773] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:46.232770 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee768bc-af69-4a08-8c0b-1d5bc6bab78b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:46.259815 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee768bc-af69-4a08-8c0b-1d5bc6bab78b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:46.272584 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df07bd-f3c6-4837-91c6-ccb8ccff2bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:46.277014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df07bd-f3c6-4837-91c6-ccb8ccff2bba admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:46.277316 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df07bd-f3c6-4837-91c6-ccb8ccff2bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:46.277614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df07bd-f3c6-4837-91c6-ccb8ccff2bba admin admin] PATH_INFO: `/v3/projects/134d9bc46d604eef812075e45b9ede8e/users/d7b4da9f887945d3a7c5d09fe9e20813/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:46.298860 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df07bd-f3c6-4837-91c6-ccb8ccff2bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=134d9bc46d604eef812075e45b9ede8e, user_id=d7b4da9f887945d3a7c5d09fe9e20813, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:46.300148 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 887/1774] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:46.302190 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df07bd-f3c6-4837-91c6-ccb8ccff2bba admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:46.316415 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb973c12-1161-463b-baef-f4b834226b6d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:46.318218 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-eb973c12-1161-463b-baef-f4b834226b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:46.330235 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 888/1775] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:46 2022] PUT /identity/v3/projects/134d9bc46d604eef812075e45b9ede8e/users/d7b4da9f887945d3a7c5d09fe9e20813/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:46.331358 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df07bd-f3c6-4837-91c6-ccb8ccff2bba admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:46.335323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb973c12-1161-463b-baef-f4b834226b6d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:46.412543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902aaab9-20d3-41c4-9355-ec1d5090d6a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:46.413210 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902aaab9-20d3-41c4-9355-ec1d5090d6a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:46.413496 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902aaab9-20d3-41c4-9355-ec1d5090d6a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:46.414029 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902aaab9-20d3-41c4-9355-ec1d5090d6a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:46.424435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:46.439603 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df07bd-f3c6-4837-91c6-ccb8ccff2bba admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:46.448049 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f692545-0a8e-488d-a4ca-d86d3df8d58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:46.448753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f692545-0a8e-488d-a4ca-d86d3df8d58f admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:46.449221 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f692545-0a8e-488d-a4ca-d86d3df8d58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:46.449684 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f692545-0a8e-488d-a4ca-d86d3df8d58f admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:46.450806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f692545-0a8e-488d-a4ca-d86d3df8d58f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:46.453638 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f692545-0a8e-488d-a4ca-d86d3df8d58f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:46.454411 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:46.466048 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 889/1776] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:33:46.469999 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f692545-0a8e-488d-a4ca-d86d3df8d58f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:46.484171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902aaab9-20d3-41c4-9355-ec1d5090d6a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:46.485795 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902aaab9-20d3-41c4-9355-ec1d5090d6a7 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:46.488459 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f692545-0a8e-488d-a4ca-d86d3df8d58f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:46.496208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6855530-fdbf-4bc2-b9d5-ef830e8e58d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:46.496973 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 888/1777] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:46.497432 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6855530-fdbf-4bc2-b9d5-ef830e8e58d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:46.497890 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6855530-fdbf-4bc2-b9d5-ef830e8e58d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:46.498348 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6855530-fdbf-4bc2-b9d5-ef830e8e58d2 admin admin] PATH_INFO: `/v3/projects/134d9bc46d604eef812075e45b9ede8e/users/d7b4da9f887945d3a7c5d09fe9e20813/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:46.500643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6855530-fdbf-4bc2-b9d5-ef830e8e58d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=134d9bc46d604eef812075e45b9ede8e, user_id=d7b4da9f887945d3a7c5d09fe9e20813, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:46.503307 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6855530-fdbf-4bc2-b9d5-ef830e8e58d2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:46.524673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 890/1778] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:46 2022] PUT /identity/v3/projects/134d9bc46d604eef812075e45b9ede8e/users/d7b4da9f887945d3a7c5d09fe9e20813/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:46.526114 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d293c5-08de-4287-a8d2-a2c0dfdada57 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:46.526350 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d293c5-08de-4287-a8d2-a2c0dfdada57 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:46.526629 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d293c5-08de-4287-a8d2-a2c0dfdada57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:46.574111 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c4d293c5-08de-4287-a8d2-a2c0dfdada57 None None] MFA Rules not processed for user `d7b4da9f887945d3a7c5d09fe9e20813`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:46.575449 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c4d293c5-08de-4287-a8d2-a2c0dfdada57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:46.661684 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 889/1779] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:46 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:46.673158 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6855530-fdbf-4bc2-b9d5-ef830e8e58d2 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:46.733288 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6855530-fdbf-4bc2-b9d5-ef830e8e58d2 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:46.736958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7837a-45aa-484a-b372-7d86f2f3d0fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:46.737596 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7837a-45aa-484a-b372-7d86f2f3d0fc service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:46.737874 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7837a-45aa-484a-b372-7d86f2f3d0fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:46.738144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7837a-45aa-484a-b372-7d86f2f3d0fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:46.748508 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7837a-45aa-484a-b372-7d86f2f3d0fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:46.749977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7837a-45aa-484a-b372-7d86f2f3d0fc service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:46.761688 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 891/1780] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:46 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:46.856730 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d293c5-08de-4287-a8d2-a2c0dfdada57 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:46.866482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d293c5-08de-4287-a8d2-a2c0dfdada57 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:46.870215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7530e-ac6d-40b7-8301-aa2998e3b4c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:46.870829 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7530e-ac6d-40b7-8301-aa2998e3b4c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:46.871092 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7530e-ac6d-40b7-8301-aa2998e3b4c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:46.871366 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7530e-ac6d-40b7-8301-aa2998e3b4c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:46.929260 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7530e-ac6d-40b7-8301-aa2998e3b4c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:46.930718 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7530e-ac6d-40b7-8301-aa2998e3b4c6 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:46.939467 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 890/1781] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:46 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:47.085923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7837a-45aa-484a-b372-7d86f2f3d0fc service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:47.087529 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1ef7837a-45aa-484a-b372-7d86f2f3d0fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:47.167469 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7837a-45aa-484a-b372-7d86f2f3d0fc service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:47.173055 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5cef7-8507-46a4-882e-c93f74635aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:47.173723 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5cef7-8507-46a4-882e-c93f74635aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:47.174004 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5cef7-8507-46a4-882e-c93f74635aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:47.174281 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5cef7-8507-46a4-882e-c93f74635aff admin admin] PATH_INFO: `/v3/users/770dff55a0184635844f3020ae5b6839` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:47.175575 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d5cef7-8507-46a4-882e-c93f74635aff admin admin] RBAC: Authorizing `identity:delete_user(user_id=770dff55a0184635844f3020ae5b6839)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:47.189433 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d5cef7-8507-46a4-882e-c93f74635aff admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:47.237347 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d5d5cef7-8507-46a4-882e-c93f74635aff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '770dff55a0184635844f3020ae5b6839'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:47.238200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d5d5cef7-8507-46a4-882e-c93f74635aff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '770dff55a0184635844f3020ae5b6839'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:47.238966 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d5d5cef7-8507-46a4-882e-c93f74635aff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '770dff55a0184635844f3020ae5b6839'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:47.247903 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d5d5cef7-8507-46a4-882e-c93f74635aff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '770dff55a0184635844f3020ae5b6839'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:47.257597 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d5d5cef7-8507-46a4-882e-c93f74635aff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '770dff55a0184635844f3020ae5b6839'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:47.271169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:47.277682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 892/1782] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:47 2022] DELETE /identity/v3/users/770dff55a0184635844f3020ae5b6839 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:47.282102 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589180f7-11f2-452e-b9c6-60234824c913 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:47.282829 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589180f7-11f2-452e-b9c6-60234824c913 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:47.282829 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589180f7-11f2-452e-b9c6-60234824c913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:47.302264 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-589180f7-11f2-452e-b9c6-60234824c913 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:47.303565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-589180f7-11f2-452e-b9c6-60234824c913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:47.353642 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:47.363136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 891/1783] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:47.373254 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5cef7-8507-46a4-882e-c93f74635aff admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:47.374625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d5d5cef7-8507-46a4-882e-c93f74635aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:47.433157 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5cef7-8507-46a4-882e-c93f74635aff admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:47.436863 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacf2b7-59f7-4b09-bb01-cd5a3e83dd04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:47.437497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacf2b7-59f7-4b09-bb01-cd5a3e83dd04 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:47.437789 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacf2b7-59f7-4b09-bb01-cd5a3e83dd04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:47.438081 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacf2b7-59f7-4b09-bb01-cd5a3e83dd04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:47.447288 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eacf2b7-59f7-4b09-bb01-cd5a3e83dd04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:47.448755 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eacf2b7-59f7-4b09-bb01-cd5a3e83dd04 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:47.459467 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 893/1784] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:33:47.752758 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589180f7-11f2-452e-b9c6-60234824c913 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:47.754307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-589180f7-11f2-452e-b9c6-60234824c913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:47.766325 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589180f7-11f2-452e-b9c6-60234824c913 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:47.771997 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ce956-2a88-4993-81fe-abc922aa7f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:47.772538 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ce956-2a88-4993-81fe-abc922aa7f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:47.773029 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ce956-2a88-4993-81fe-abc922aa7f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:47.773344 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ce956-2a88-4993-81fe-abc922aa7f61 admin admin] PATH_INFO: `/v3/projects/9a8b10bcebec430e9280ec62e63b53ed` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:47.775006 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ce956-2a88-4993-81fe-abc922aa7f61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a8b10bcebec430e9280ec62e63b53ed)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:47.777064 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ce956-2a88-4993-81fe-abc922aa7f61 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:47.840973 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1c0ce956-2a88-4993-81fe-abc922aa7f61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a8b10bcebec430e9280ec62e63b53ed', 'request_id': 'req-1c0ce956-2a88-4993-81fe-abc922aa7f61'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:47.848788 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacf2b7-59f7-4b09-bb01-cd5a3e83dd04 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:47.850270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0eacf2b7-59f7-4b09-bb01-cd5a3e83dd04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:47.850843 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1c0ce956-2a88-4993-81fe-abc922aa7f61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a8b10bcebec430e9280ec62e63b53ed', 'request_id': 'req-1c0ce956-2a88-4993-81fe-abc922aa7f61'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:47.858149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1c0ce956-2a88-4993-81fe-abc922aa7f61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a8b10bcebec430e9280ec62e63b53ed', 'request_id': 'req-1c0ce956-2a88-4993-81fe-abc922aa7f61'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:47.881134 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1c0ce956-2a88-4993-81fe-abc922aa7f61 admin admin] The token cache is being invalidate because project 9a8b10bcebec430e9280ec62e63b53ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:47.881557 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1c0ce956-2a88-4993-81fe-abc922aa7f61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:47.882224 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1c0ce956-2a88-4993-81fe-abc922aa7f61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:47.883957 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 892/1785] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:47 2022] DELETE /identity/v3/projects/9a8b10bcebec430e9280ec62e63b53ed => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:47.889047 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a25c5-5188-4a00-a6db-ec46997844e8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:47.889519 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a25c5-5188-4a00-a6db-ec46997844e8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:47.890165 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a25c5-5188-4a00-a6db-ec46997844e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:47.913241 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a65a25c5-5188-4a00-a6db-ec46997844e8 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:47.925469 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a65a25c5-5188-4a00-a6db-ec46997844e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:47.942744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacf2b7-59f7-4b09-bb01-cd5a3e83dd04 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:47.982350 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 893/1786] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:47.993642 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89359876-efe4-4d39-927b-59a8715f7beb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:47.993927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89359876-efe4-4d39-927b-59a8715f7beb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:47.994198 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89359876-efe4-4d39-927b-59a8715f7beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:48.002747 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb6f2d-fe1e-4187-aba2-e0168d86f58d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:48.003502 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb6f2d-fe1e-4187-aba2-e0168d86f58d service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:48.003851 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb6f2d-fe1e-4187-aba2-e0168d86f58d service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:48.004135 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb6f2d-fe1e-4187-aba2-e0168d86f58d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:48.006049 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-27fb6f2d-fe1e-4187-aba2-e0168d86f58d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:48.014035 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-89359876-efe4-4d39-927b-59a8715f7beb None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:48.015218 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-89359876-efe4-4d39-927b-59a8715f7beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:48.023605 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 894/1787] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:48.028668 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89359876-efe4-4d39-927b-59a8715f7beb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:48.038331 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89359876-efe4-4d39-927b-59a8715f7beb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:48.044221 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9768c8-88f9-4145-b294-8fe246723bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:48.044827 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9768c8-88f9-4145-b294-8fe246723bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:48.045154 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9768c8-88f9-4145-b294-8fe246723bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:48.045401 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9768c8-88f9-4145-b294-8fe246723bd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:48.046049 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9768c8-88f9-4145-b294-8fe246723bd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:33:48.046354 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9768c8-88f9-4145-b294-8fe246723bd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:48.048048 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9768c8-88f9-4145-b294-8fe246723bd3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:48.067214 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 895/1788] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:33:48.072031 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9768c8-88f9-4145-b294-8fe246723bd3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:48.085587 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb6f2d-fe1e-4187-aba2-e0168d86f58d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:48.087582 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb6f2d-fe1e-4187-aba2-e0168d86f58d service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:48.087888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9768c8-88f9-4145-b294-8fe246723bd3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:48.093676 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27ca1b-d8b4-45ab-aad4-12c2996c31c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:48.094563 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27ca1b-d8b4-45ab-aad4-12c2996c31c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:48.094841 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27ca1b-d8b4-45ab-aad4-12c2996c31c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:48.095110 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27ca1b-d8b4-45ab-aad4-12c2996c31c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:48.095836 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27ca1b-d8b4-45ab-aad4-12c2996c31c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:48.097579 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 894/1789] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:33:48.097700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27ca1b-d8b4-45ab-aad4-12c2996c31c8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:48.132259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 896/1790] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:48 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:48.137144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb6f2d-fe1e-4187-aba2-e0168d86f58d service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:48.151448 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb6f2d-fe1e-4187-aba2-e0168d86f58d service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:48.162151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:48.228007 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5bffc-886a-41e9-aa43-aff00e6bdcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:48.228790 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5bffc-886a-41e9-aa43-aff00e6bdcb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:48.228872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5bffc-886a-41e9-aa43-aff00e6bdcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:48.229162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5bffc-886a-41e9-aa43-aff00e6bdcb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:48.229796 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5bffc-886a-41e9-aa43-aff00e6bdcb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:48.231695 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5bffc-886a-41e9-aa43-aff00e6bdcb0 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:48.267155 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 895/1791] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:48 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:48.272408 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27ca1b-d8b4-45ab-aad4-12c2996c31c8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:48.286599 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27ca1b-d8b4-45ab-aad4-12c2996c31c8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:48.292652 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1ef2a-dbbb-4259-b744-579fc292f70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:48.293714 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1ef2a-dbbb-4259-b744-579fc292f70c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:48.294331 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1ef2a-dbbb-4259-b744-579fc292f70c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:48.294972 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1ef2a-dbbb-4259-b744-579fc292f70c admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:48.295818 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1ef2a-dbbb-4259-b744-579fc292f70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:48.297840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1ef2a-dbbb-4259-b744-579fc292f70c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:48.312450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 897/1792] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:48.313557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5bffc-886a-41e9-aa43-aff00e6bdcb0 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:48.327254 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5bffc-886a-41e9-aa43-aff00e6bdcb0 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:48.332872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa477950-964e-49ce-8576-5eb5b9920069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:48.333522 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa477950-964e-49ce-8576-5eb5b9920069 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:48.335014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa477950-964e-49ce-8576-5eb5b9920069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:48.335014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa477950-964e-49ce-8576-5eb5b9920069 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:48.335210 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa477950-964e-49ce-8576-5eb5b9920069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:48.339068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa477950-964e-49ce-8576-5eb5b9920069 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:48.358061 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1ef2a-dbbb-4259-b744-579fc292f70c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:48.365012 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 896/1793] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:48.371499 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1ef2a-dbbb-4259-b744-579fc292f70c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:48.377869 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4920185-2d4d-4a82-9abb-20e418f9dc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:48.378596 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4920185-2d4d-4a82-9abb-20e418f9dc38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:48.379067 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4920185-2d4d-4a82-9abb-20e418f9dc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:48.379366 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4920185-2d4d-4a82-9abb-20e418f9dc38 admin admin] PATH_INFO: `/v3/projects/f72796dfb00148c29f1a31eb4c61c61c/users/05a15a786fda4c7bb0a840f58d5b4a66/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:48.399193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4920185-2d4d-4a82-9abb-20e418f9dc38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f72796dfb00148c29f1a31eb4c61c61c, user_id=05a15a786fda4c7bb0a840f58d5b4a66, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:48.402779 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4920185-2d4d-4a82-9abb-20e418f9dc38 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:48.421716 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 898/1794] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:48 2022] PUT /identity/v3/projects/f72796dfb00148c29f1a31eb4c61c61c/users/05a15a786fda4c7bb0a840f58d5b4a66/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:33:48.426632 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7fbcb-b1e4-44b1-85f0-6019d5fe5de6 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:48.426920 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7fbcb-b1e4-44b1-85f0-6019d5fe5de6 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:48.427207 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7fbcb-b1e4-44b1-85f0-6019d5fe5de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:48.451844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-b2f7fbcb-b1e4-44b1-85f0-6019d5fe5de6 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:48.453067 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b2f7fbcb-b1e4-44b1-85f0-6019d5fe5de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:48.516964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 897/1795] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:48.526664 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4920185-2d4d-4a82-9abb-20e418f9dc38 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:48.529354 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b4920185-2d4d-4a82-9abb-20e418f9dc38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:48.536748 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:48.639595 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4920185-2d4d-4a82-9abb-20e418f9dc38 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:48.647482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11ccd9-0f19-4bb2-b95a-21b54dacc3d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:48.648776 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11ccd9-0f19-4bb2-b95a-21b54dacc3d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:48.649595 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11ccd9-0f19-4bb2-b95a-21b54dacc3d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:48.650171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11ccd9-0f19-4bb2-b95a-21b54dacc3d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:48.671137 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11ccd9-0f19-4bb2-b95a-21b54dacc3d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:48.674941 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11ccd9-0f19-4bb2-b95a-21b54dacc3d5 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:48.701139 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 899/1796] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:48.933326 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7fbcb-b1e4-44b1-85f0-6019d5fe5de6 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:48.934827 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b2f7fbcb-b1e4-44b1-85f0-6019d5fe5de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:49.007844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7fbcb-b1e4-44b1-85f0-6019d5fe5de6 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:49.011853 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f2448-42d7-4607-a18f-91d2041f6bd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:49.012469 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f2448-42d7-4607-a18f-91d2041f6bd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:49.012744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f2448-42d7-4607-a18f-91d2041f6bd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:49.013010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f2448-42d7-4607-a18f-91d2041f6bd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:49.015032 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f65f2448-42d7-4607-a18f-91d2041f6bd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:49.083549 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:49.110726 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f2448-42d7-4607-a18f-91d2041f6bd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:49.112188 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f2448-42d7-4607-a18f-91d2041f6bd2 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:49.122262 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 898/1797] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:51.457325 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11ccd9-0f19-4bb2-b95a-21b54dacc3d5 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:51.458824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6a11ccd9-0f19-4bb2-b95a-21b54dacc3d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:51.478215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11ccd9-0f19-4bb2-b95a-21b54dacc3d5 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:51.501631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a6aa1-ec40-495f-a1e5-00173587cbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:51.503402 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a6aa1-ec40-495f-a1e5-00173587cbc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:51.503918 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a6aa1-ec40-495f-a1e5-00173587cbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:51.504782 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a6aa1-ec40-495f-a1e5-00173587cbc0 admin admin] PATH_INFO: `/v3/users/0f8c3d66333843f793f66e73912baf1c` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:51.507053 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a6aa1-ec40-495f-a1e5-00173587cbc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f8c3d66333843f793f66e73912baf1c)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:51.511026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a6aa1-ec40-495f-a1e5-00173587cbc0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:51.578549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d38a6aa1-ec40-495f-a1e5-00173587cbc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f8c3d66333843f793f66e73912baf1c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:51.588667 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d38a6aa1-ec40-495f-a1e5-00173587cbc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f8c3d66333843f793f66e73912baf1c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:51.589493 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d38a6aa1-ec40-495f-a1e5-00173587cbc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f8c3d66333843f793f66e73912baf1c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:51.626406 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d38a6aa1-ec40-495f-a1e5-00173587cbc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f8c3d66333843f793f66e73912baf1c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:51.693271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d38a6aa1-ec40-495f-a1e5-00173587cbc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f8c3d66333843f793f66e73912baf1c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:51.716466 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 900/1798] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:51 2022] DELETE /identity/v3/users/0f8c3d66333843f793f66e73912baf1c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:51.717684 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ea9f7-4456-4959-a057-3c7f786350db None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:51.718137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ea9f7-4456-4959-a057-3c7f786350db None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:51.718215 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ea9f7-4456-4959-a057-3c7f786350db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:51.752545 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ed6ea9f7-4456-4959-a057-3c7f786350db None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:51.756842 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ed6ea9f7-4456-4959-a057-3c7f786350db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:51.870875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 899/1799] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:51.880614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a6aa1-ec40-495f-a1e5-00173587cbc0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:51.882093 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d38a6aa1-ec40-495f-a1e5-00173587cbc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:52.006136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a6aa1-ec40-495f-a1e5-00173587cbc0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:52.014208 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb74c9-6b28-4b04-a366-9c3262ba8741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:52.016221 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb74c9-6b28-4b04-a366-9c3262ba8741 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:52.016918 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb74c9-6b28-4b04-a366-9c3262ba8741 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:52.016918 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb74c9-6b28-4b04-a366-9c3262ba8741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:52.054559 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb74c9-6b28-4b04-a366-9c3262ba8741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:52.056775 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb74c9-6b28-4b04-a366-9c3262ba8741 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:52.094348 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 901/1800] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:52.913158 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ea9f7-4456-4959-a057-3c7f786350db None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:52.915040 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ed6ea9f7-4456-4959-a057-3c7f786350db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:52.935262 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ea9f7-4456-4959-a057-3c7f786350db None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:52.941257 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb02fee-0127-490c-833b-3f5a9a120d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:52.942273 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb02fee-0127-490c-833b-3f5a9a120d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:52.942555 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb02fee-0127-490c-833b-3f5a9a120d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:52.942986 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb02fee-0127-490c-833b-3f5a9a120d9d admin admin] PATH_INFO: `/v3/projects/f8de7f5b29e04270b4a210a97cada822` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:52.944278 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb02fee-0127-490c-833b-3f5a9a120d9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8de7f5b29e04270b4a210a97cada822)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:52.947530 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb02fee-0127-490c-833b-3f5a9a120d9d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:53.014181 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3cb02fee-0127-490c-833b-3f5a9a120d9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8de7f5b29e04270b4a210a97cada822', 'request_id': 'req-3cb02fee-0127-490c-833b-3f5a9a120d9d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:53.021089 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3cb02fee-0127-490c-833b-3f5a9a120d9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8de7f5b29e04270b4a210a97cada822', 'request_id': 'req-3cb02fee-0127-490c-833b-3f5a9a120d9d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:53.028276 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3cb02fee-0127-490c-833b-3f5a9a120d9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8de7f5b29e04270b4a210a97cada822', 'request_id': 'req-3cb02fee-0127-490c-833b-3f5a9a120d9d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:53.049037 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3cb02fee-0127-490c-833b-3f5a9a120d9d admin admin] The token cache is being invalidate because project f8de7f5b29e04270b4a210a97cada822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:53.049623 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3cb02fee-0127-490c-833b-3f5a9a120d9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:53.050537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3cb02fee-0127-490c-833b-3f5a9a120d9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:53.057398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 900/1801] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:52 2022] DELETE /identity/v3/projects/f8de7f5b29e04270b4a210a97cada822 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:53.057938 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb74c9-6b28-4b04-a366-9c3262ba8741 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:53.068548 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb74c9-6b28-4b04-a366-9c3262ba8741 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:53.093173 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:53.140279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be86fe-3688-40fb-8155-9263058b263a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:53.141148 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be86fe-3688-40fb-8155-9263058b263a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:53.141403 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be86fe-3688-40fb-8155-9263058b263a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:53.141740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be86fe-3688-40fb-8155-9263058b263a admin admin] PATH_INFO: `/v3/users/d7b4da9f887945d3a7c5d09fe9e20813` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:53.143190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be86fe-3688-40fb-8155-9263058b263a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7b4da9f887945d3a7c5d09fe9e20813)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:53.145345 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be86fe-3688-40fb-8155-9263058b263a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:53.228475 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-84be86fe-3688-40fb-8155-9263058b263a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7b4da9f887945d3a7c5d09fe9e20813'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:53.239741 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-84be86fe-3688-40fb-8155-9263058b263a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7b4da9f887945d3a7c5d09fe9e20813'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:53.240701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-84be86fe-3688-40fb-8155-9263058b263a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7b4da9f887945d3a7c5d09fe9e20813'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:53.278548 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-84be86fe-3688-40fb-8155-9263058b263a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7b4da9f887945d3a7c5d09fe9e20813'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:53.286467 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-84be86fe-3688-40fb-8155-9263058b263a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7b4da9f887945d3a7c5d09fe9e20813'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:53.298562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 902/1802] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:53 2022] DELETE /identity/v3/users/d7b4da9f887945d3a7c5d09fe9e20813 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:53.484843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb02fee-0127-490c-833b-3f5a9a120d9d admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:53.489429 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3cb02fee-0127-490c-833b-3f5a9a120d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:53.511105 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb02fee-0127-490c-833b-3f5a9a120d9d admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:53.536289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7184049-c9ae-4f5f-af0a-822e2a7c3bbb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:53.536289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7184049-c9ae-4f5f-af0a-822e2a7c3bbb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:53.536516 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7184049-c9ae-4f5f-af0a-822e2a7c3bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:53.574648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a7184049-c9ae-4f5f-af0a-822e2a7c3bbb None None] MFA Rules not processed for user `05a15a786fda4c7bb0a840f58d5b4a66`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:53.576148 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a7184049-c9ae-4f5f-af0a-822e2a7c3bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:53.615301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4cd35-5bb3-42da-b73a-989e511f54f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:53.615955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4cd35-5bb3-42da-b73a-989e511f54f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:53.616237 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4cd35-5bb3-42da-b73a-989e511f54f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:53.616521 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4cd35-5bb3-42da-b73a-989e511f54f0 admin admin] PATH_INFO: `/v3/users/5f1d1542254441bab49f8a630158c6f4` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:53.618791 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4cd35-5bb3-42da-b73a-989e511f54f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f1d1542254441bab49f8a630158c6f4)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:53.621753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4cd35-5bb3-42da-b73a-989e511f54f0 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:53.627961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:53.694285 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 903/1803] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:53.699776 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-93a4cd35-5bb3-42da-b73a-989e511f54f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f1d1542254441bab49f8a630158c6f4'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:53.700492 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-93a4cd35-5bb3-42da-b73a-989e511f54f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f1d1542254441bab49f8a630158c6f4'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:53.701236 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-93a4cd35-5bb3-42da-b73a-989e511f54f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f1d1542254441bab49f8a630158c6f4'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:53.703880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7184049-c9ae-4f5f-af0a-822e2a7c3bbb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:53.706134 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a7184049-c9ae-4f5f-af0a-822e2a7c3bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:53.712458 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-93a4cd35-5bb3-42da-b73a-989e511f54f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f1d1542254441bab49f8a630158c6f4'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:53.725282 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-93a4cd35-5bb3-42da-b73a-989e511f54f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f1d1542254441bab49f8a630158c6f4'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:53.750914 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7184049-c9ae-4f5f-af0a-822e2a7c3bbb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:53.763152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 901/1804] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:53 2022] DELETE /identity/v3/users/5f1d1542254441bab49f8a630158c6f4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:53.769734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df6298-2e32-44e5-acf0-637640b4fe7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:53.770728 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df6298-2e32-44e5-acf0-637640b4fe7c admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:53.770820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9aa83-77fa-4db6-957f-31d398a32fac None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:53.770912 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df6298-2e32-44e5-acf0-637640b4fe7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:53.771132 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9aa83-77fa-4db6-957f-31d398a32fac None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:53.771358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df6298-2e32-44e5-acf0-637640b4fe7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:53.771527 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9aa83-77fa-4db6-957f-31d398a32fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:53.772101 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df6298-2e32-44e5-acf0-637640b4fe7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:53.776748 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df6298-2e32-44e5-acf0-637640b4fe7c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:53.803587 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ecc9aa83-77fa-4db6-957f-31d398a32fac None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:53.805020 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ecc9aa83-77fa-4db6-957f-31d398a32fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:53.810937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 904/1805] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:53 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:53.811819 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df6298-2e32-44e5-acf0-637640b4fe7c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:53.813830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e8df6298-2e32-44e5-acf0-637640b4fe7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:53.828516 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:53.877751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 902/1806] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:53.882679 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9aa83-77fa-4db6-957f-31d398a32fac None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:53.884656 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ecc9aa83-77fa-4db6-957f-31d398a32fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:53.898748 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9aa83-77fa-4db6-957f-31d398a32fac None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:53.900635 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df6298-2e32-44e5-acf0-637640b4fe7c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:53.908593 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaeeff0-f578-4d32-a9f9-b39da02ba03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:53.909314 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeeff0-f578-4d32-a9f9-b39da02ba03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:53.909602 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeeff0-f578-4d32-a9f9-b39da02ba03d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:53.909880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeeff0-f578-4d32-a9f9-b39da02ba03d admin admin] PATH_INFO: `/v3/projects/134d9bc46d604eef812075e45b9ede8e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:53.911047 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaeeff0-f578-4d32-a9f9-b39da02ba03d admin admin] RBAC: Authorizing `identity:delete_project(project_id=134d9bc46d604eef812075e45b9ede8e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:53.912963 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaeeff0-f578-4d32-a9f9-b39da02ba03d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:53.914140 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf172d-e496-4026-9bce-371fde803efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:53.915628 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf172d-e496-4026-9bce-371fde803efc admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:53.921278 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf172d-e496-4026-9bce-371fde803efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:53.921821 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf172d-e496-4026-9bce-371fde803efc admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:53.923189 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf172d-e496-4026-9bce-371fde803efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:53.926553 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf172d-e496-4026-9bce-371fde803efc admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:53.968147 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 903/1807] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:53 2022] POST /identity/v3/users => generated 298 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:53.969357 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf172d-e496-4026-9bce-371fde803efc admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:53.971054 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a8cf172d-e496-4026-9bce-371fde803efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:54.005649 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0aaeeff0-f578-4d32-a9f9-b39da02ba03d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '134d9bc46d604eef812075e45b9ede8e', 'request_id': 'req-0aaeeff0-f578-4d32-a9f9-b39da02ba03d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:54.016427 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0aaeeff0-f578-4d32-a9f9-b39da02ba03d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '134d9bc46d604eef812075e45b9ede8e', 'request_id': 'req-0aaeeff0-f578-4d32-a9f9-b39da02ba03d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:54.024776 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0aaeeff0-f578-4d32-a9f9-b39da02ba03d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '134d9bc46d604eef812075e45b9ede8e', 'request_id': 'req-0aaeeff0-f578-4d32-a9f9-b39da02ba03d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:54.038525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0aaeeff0-f578-4d32-a9f9-b39da02ba03d admin admin] The token cache is being invalidate because project 134d9bc46d604eef812075e45b9ede8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:54.038795 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0aaeeff0-f578-4d32-a9f9-b39da02ba03d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:54.039948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0aaeeff0-f578-4d32-a9f9-b39da02ba03d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:54.042882 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 905/1808] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:53 2022] DELETE /identity/v3/projects/134d9bc46d604eef812075e45b9ede8e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:54.044017 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaeeff0-f578-4d32-a9f9-b39da02ba03d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:54.045530 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0aaeeff0-f578-4d32-a9f9-b39da02ba03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:54.058977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf172d-e496-4026-9bce-371fde803efc admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:54.094723 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:54.144165 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1e422-d2bf-41a6-b763-d2d94d785f0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:54.144891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1e422-d2bf-41a6-b763-d2d94d785f0f service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:54.145269 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1e422-d2bf-41a6-b763-d2d94d785f0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:54.145606 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1e422-d2bf-41a6-b763-d2d94d785f0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:54.147453 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-daa1e422-d2bf-41a6-b763-d2d94d785f0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:54.165594 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaeeff0-f578-4d32-a9f9-b39da02ba03d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:54.170898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47dfcc-e815-481a-8d9e-b95ad3fc8dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:54.171460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47dfcc-e815-481a-8d9e-b95ad3fc8dee admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:54.171744 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47dfcc-e815-481a-8d9e-b95ad3fc8dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:54.172019 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47dfcc-e815-481a-8d9e-b95ad3fc8dee admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:54.172680 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47dfcc-e815-481a-8d9e-b95ad3fc8dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:54.174331 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47dfcc-e815-481a-8d9e-b95ad3fc8dee admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:54.185662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 906/1809] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:54.187085 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae9815-e3fc-4e8e-bfeb-f0a1927f8d8a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:54.187377 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae9815-e3fc-4e8e-bfeb-f0a1927f8d8a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:54.187653 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae9815-e3fc-4e8e-bfeb-f0a1927f8d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:54.208266 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-11ae9815-e3fc-4e8e-bfeb-f0a1927f8d8a None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:54.209529 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-11ae9815-e3fc-4e8e-bfeb-f0a1927f8d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:54.218493 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 907/1810] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:54.222208 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae9815-e3fc-4e8e-bfeb-f0a1927f8d8a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:54.226918 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1e422-d2bf-41a6-b763-d2d94d785f0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:54.228417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1e422-d2bf-41a6-b763-d2d94d785f0f service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:54.234300 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae9815-e3fc-4e8e-bfeb-f0a1927f8d8a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:54.240447 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 904/1811] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:54.241328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac8c2c-192c-4e24-a1b3-27afca225698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:54.241740 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59119680-46af-40de-abf9-eb27a5054258 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:54.242026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac8c2c-192c-4e24-a1b3-27afca225698 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:54.242151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59119680-46af-40de-abf9-eb27a5054258 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:54.242311 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac8c2c-192c-4e24-a1b3-27afca225698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:54.242407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59119680-46af-40de-abf9-eb27a5054258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:54.242586 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac8c2c-192c-4e24-a1b3-27afca225698 admin admin] PATH_INFO: `/v3/projects/84c368e06f684fffb69a2bccc3834c68/users/ceeacedb9ea5485c8cdd7d6531b7d54e/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:54.260607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac8c2c-192c-4e24-a1b3-27afca225698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c368e06f684fffb69a2bccc3834c68, user_id=ceeacedb9ea5485c8cdd7d6531b7d54e, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:54.263650 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac8c2c-192c-4e24-a1b3-27afca225698 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:54.270260 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-59119680-46af-40de-abf9-eb27a5054258 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:54.270260 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-59119680-46af-40de-abf9-eb27a5054258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:54.284308 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 908/1812] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:54 2022] PUT /identity/v3/projects/84c368e06f684fffb69a2bccc3834c68/users/ceeacedb9ea5485c8cdd7d6531b7d54e/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:54.288035 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac8c2c-192c-4e24-a1b3-27afca225698 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:54.295437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:54.374583 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 905/1813] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:54.380117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59119680-46af-40de-abf9-eb27a5054258 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:54.394120 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59119680-46af-40de-abf9-eb27a5054258 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:54.398473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac8c2c-192c-4e24-a1b3-27afca225698 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:54.404495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86484074-41d6-4a89-a1e6-dc04496faf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:54.405267 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86484074-41d6-4a89-a1e6-dc04496faf71 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:54.405525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86484074-41d6-4a89-a1e6-dc04496faf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:54.405804 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86484074-41d6-4a89-a1e6-dc04496faf71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:54.406559 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86484074-41d6-4a89-a1e6-dc04496faf71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:54.408176 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86484074-41d6-4a89-a1e6-dc04496faf71 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:54.409195 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f6465-fe94-4a89-9924-1caebbb44753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:54.410060 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f6465-fe94-4a89-9924-1caebbb44753 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:54.410559 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f6465-fe94-4a89-9924-1caebbb44753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:54.411069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f6465-fe94-4a89-9924-1caebbb44753 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:54.411786 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f6465-fe94-4a89-9924-1caebbb44753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:33:54.412381 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f6465-fe94-4a89-9924-1caebbb44753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:54.414450 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f6465-fe94-4a89-9924-1caebbb44753 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:54.429202 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 909/1814] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:33:54.433903 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 906/1815] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:33:54.438161 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86484074-41d6-4a89-a1e6-dc04496faf71 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:54.438542 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f6465-fe94-4a89-9924-1caebbb44753 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:54.451432 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86484074-41d6-4a89-a1e6-dc04496faf71 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:54.456965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af4bc1-23d7-4b66-936c-13d4cae5f544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:54.457570 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af4bc1-23d7-4b66-936c-13d4cae5f544 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:54.457799 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af4bc1-23d7-4b66-936c-13d4cae5f544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:54.458082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af4bc1-23d7-4b66-936c-13d4cae5f544 admin admin] PATH_INFO: `/v3/projects/84c368e06f684fffb69a2bccc3834c68/users/ceeacedb9ea5485c8cdd7d6531b7d54e/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:54.460852 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af4bc1-23d7-4b66-936c-13d4cae5f544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c368e06f684fffb69a2bccc3834c68, user_id=ceeacedb9ea5485c8cdd7d6531b7d54e, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:54.470839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f6465-fe94-4a89-9924-1caebbb44753 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:54.475884 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2f744-c777-4e48-b662-31cbe1f229ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:54.476645 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2f744-c777-4e48-b662-31cbe1f229ca admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:54.476903 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2f744-c777-4e48-b662-31cbe1f229ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:54.477314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2f744-c777-4e48-b662-31cbe1f229ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:54.477998 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2f744-c777-4e48-b662-31cbe1f229ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:54.485892 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2f744-c777-4e48-b662-31cbe1f229ca admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:54.499842 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af4bc1-23d7-4b66-936c-13d4cae5f544 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:54.512934 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 910/1816] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:54 2022] PUT /identity/v3/projects/84c368e06f684fffb69a2bccc3834c68/users/ceeacedb9ea5485c8cdd7d6531b7d54e/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:54.527895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 907/1817] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:54 2022] POST /identity/v3/projects => generated 381 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:54.530358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af4bc1-23d7-4b66-936c-13d4cae5f544 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:54.665218 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af4bc1-23d7-4b66-936c-13d4cae5f544 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:54.739201 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2f744-c777-4e48-b662-31cbe1f229ca admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:54.741129 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6fa2f744-c777-4e48-b662-31cbe1f229ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:54.801571 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affb3a7-1c15-454a-9606-2b90bf9ae49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:54.803777 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affb3a7-1c15-454a-9606-2b90bf9ae49f admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:54.804094 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affb3a7-1c15-454a-9606-2b90bf9ae49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:54.804380 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affb3a7-1c15-454a-9606-2b90bf9ae49f admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:54.806232 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0affb3a7-1c15-454a-9606-2b90bf9ae49f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:54.808520 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0affb3a7-1c15-454a-9606-2b90bf9ae49f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:54.851263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 911/1818] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:54 2022] POST /identity/v3/users => generated 291 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:54.855456 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:54.857606 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affb3a7-1c15-454a-9606-2b90bf9ae49f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:54.872289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affb3a7-1c15-454a-9606-2b90bf9ae49f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:54.880395 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021791b8-59ef-4d42-b8f6-0e67429ad6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:54.881429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021791b8-59ef-4d42-b8f6-0e67429ad6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:54.881870 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021791b8-59ef-4d42-b8f6-0e67429ad6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:54.882558 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021791b8-59ef-4d42-b8f6-0e67429ad6c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:54.884255 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021791b8-59ef-4d42-b8f6-0e67429ad6c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:54.886403 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021791b8-59ef-4d42-b8f6-0e67429ad6c1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:54.899417 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 912/1819] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:54.907051 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021791b8-59ef-4d42-b8f6-0e67429ad6c1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:54.916836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2f744-c777-4e48-b662-31cbe1f229ca admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:54.925784 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021791b8-59ef-4d42-b8f6-0e67429ad6c1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:54.932329 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79b9bc-ed59-4a20-8ee8-b4aa4a975765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:54.932969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79b9bc-ed59-4a20-8ee8-b4aa4a975765 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:54.933732 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79b9bc-ed59-4a20-8ee8-b4aa4a975765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:54.933855 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f82300-d33e-47df-a287-63569dc8b984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:54.934398 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79b9bc-ed59-4a20-8ee8-b4aa4a975765 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:54.934509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f82300-d33e-47df-a287-63569dc8b984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:54.934691 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79b9bc-ed59-4a20-8ee8-b4aa4a975765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:54.934790 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f82300-d33e-47df-a287-63569dc8b984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:54.935084 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f82300-d33e-47df-a287-63569dc8b984 admin admin] PATH_INFO: `/v3/projects/5d37bb88199948849a9b5a6c87366eda` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:54.936305 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f82300-d33e-47df-a287-63569dc8b984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d37bb88199948849a9b5a6c87366eda)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:54.936748 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79b9bc-ed59-4a20-8ee8-b4aa4a975765 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:54.938588 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f82300-d33e-47df-a287-63569dc8b984 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:54.953395 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 913/1820] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:54.954506 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79b9bc-ed59-4a20-8ee8-b4aa4a975765 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:54.966842 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:54.972342 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79b9bc-ed59-4a20-8ee8-b4aa4a975765 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:54.986932 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a580d-c8bf-4f68-ab4d-327a2c478304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:54.988591 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a580d-c8bf-4f68-ab4d-327a2c478304 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:54.988882 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a580d-c8bf-4f68-ab4d-327a2c478304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:54.989222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a580d-c8bf-4f68-ab4d-327a2c478304 admin admin] PATH_INFO: `/v3/projects/45f126e4185442768ff89ae8e1109e08/users/e691a4a9d905492ca80887f0e955e9d3/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:55.007797 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a580d-c8bf-4f68-ab4d-327a2c478304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f126e4185442768ff89ae8e1109e08, user_id=e691a4a9d905492ca80887f0e955e9d3, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:55.011154 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a580d-c8bf-4f68-ab4d-327a2c478304 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:55.039418 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 914/1821] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:54 2022] PUT /identity/v3/projects/45f126e4185442768ff89ae8e1109e08/users/e691a4a9d905492ca80887f0e955e9d3/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:55.040150 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-98f82300-d33e-47df-a287-63569dc8b984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d37bb88199948849a9b5a6c87366eda', 'request_id': 'req-98f82300-d33e-47df-a287-63569dc8b984'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:55.042123 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721030c-96f3-4757-a1fb-0dff6fafddeb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:55.042242 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721030c-96f3-4757-a1fb-0dff6fafddeb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:55.042513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721030c-96f3-4757-a1fb-0dff6fafddeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:55.046763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-98f82300-d33e-47df-a287-63569dc8b984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d37bb88199948849a9b5a6c87366eda', 'request_id': 'req-98f82300-d33e-47df-a287-63569dc8b984'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:55.058548 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-98f82300-d33e-47df-a287-63569dc8b984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d37bb88199948849a9b5a6c87366eda', 'request_id': 'req-98f82300-d33e-47df-a287-63569dc8b984'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:55.068558 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7721030c-96f3-4757-a1fb-0dff6fafddeb None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:55.069803 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7721030c-96f3-4757-a1fb-0dff6fafddeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:55.086691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-98f82300-d33e-47df-a287-63569dc8b984 admin admin] The token cache is being invalidate because project 5d37bb88199948849a9b5a6c87366eda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:55.086691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-98f82300-d33e-47df-a287-63569dc8b984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:55.088909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-98f82300-d33e-47df-a287-63569dc8b984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:55.095892 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 908/1822] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:54 2022] DELETE /identity/v3/projects/5d37bb88199948849a9b5a6c87366eda => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:55.100091 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f82300-d33e-47df-a287-63569dc8b984 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:55.103467 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-98f82300-d33e-47df-a287-63569dc8b984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:55.188173 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 915/1823] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:55.201580 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721030c-96f3-4757-a1fb-0dff6fafddeb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:55.205960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7721030c-96f3-4757-a1fb-0dff6fafddeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:55.268108 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f82300-d33e-47df-a287-63569dc8b984 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:55.273727 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0128cf1-4ed3-4e7d-9bb8-d00b1417b3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:55.274669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0128cf1-4ed3-4e7d-9bb8-d00b1417b3c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:55.274948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0128cf1-4ed3-4e7d-9bb8-d00b1417b3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:55.275828 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0128cf1-4ed3-4e7d-9bb8-d00b1417b3c2 admin admin] PATH_INFO: `/v3/users/895e345b6fcc4b368ccc1d8ea89c62d7` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:55.277291 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0128cf1-4ed3-4e7d-9bb8-d00b1417b3c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=895e345b6fcc4b368ccc1d8ea89c62d7)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:55.279316 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0128cf1-4ed3-4e7d-9bb8-d00b1417b3c2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:55.296535 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721030c-96f3-4757-a1fb-0dff6fafddeb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:55.301331 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27239c-f253-4550-aa3b-80cc1cd5df1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:55.302674 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27239c-f253-4550-aa3b-80cc1cd5df1b service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:55.303157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27239c-f253-4550-aa3b-80cc1cd5df1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:55.303618 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27239c-f253-4550-aa3b-80cc1cd5df1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:55.315243 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27239c-f253-4550-aa3b-80cc1cd5df1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:55.317094 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27239c-f253-4550-aa3b-80cc1cd5df1b service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:55.330083 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 916/1824] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:55.367208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e0128cf1-4ed3-4e7d-9bb8-d00b1417b3c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '895e345b6fcc4b368ccc1d8ea89c62d7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:55.368201 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e0128cf1-4ed3-4e7d-9bb8-d00b1417b3c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '895e345b6fcc4b368ccc1d8ea89c62d7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:55.368949 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e0128cf1-4ed3-4e7d-9bb8-d00b1417b3c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '895e345b6fcc4b368ccc1d8ea89c62d7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:55.383000 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e0128cf1-4ed3-4e7d-9bb8-d00b1417b3c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '895e345b6fcc4b368ccc1d8ea89c62d7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:55.395511 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e0128cf1-4ed3-4e7d-9bb8-d00b1417b3c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '895e345b6fcc4b368ccc1d8ea89c62d7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:55.407028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:55.443014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 909/1825] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:55 2022] DELETE /identity/v3/users/895e345b6fcc4b368ccc1d8ea89c62d7 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:56.023265 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27239c-f253-4550-aa3b-80cc1cd5df1b service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:56.026644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-af27239c-f253-4550-aa3b-80cc1cd5df1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:56.070520 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27239c-f253-4550-aa3b-80cc1cd5df1b service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:56.145371 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0128cf1-4ed3-4e7d-9bb8-d00b1417b3c2 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:56.146873 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e0128cf1-4ed3-4e7d-9bb8-d00b1417b3c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:56.177324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c4626-ee9e-47d6-917d-3fc8e75b28a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:56.177983 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c4626-ee9e-47d6-917d-3fc8e75b28a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:56.178269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c4626-ee9e-47d6-917d-3fc8e75b28a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:56.178572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c4626-ee9e-47d6-917d-3fc8e75b28a9 admin admin] PATH_INFO: `/v3/users/0f78135e514d431fb72a649613e0e6b5` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:56.180910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c4626-ee9e-47d6-917d-3fc8e75b28a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f78135e514d431fb72a649613e0e6b5)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:56.183982 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c4626-ee9e-47d6-917d-3fc8e75b28a9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:56.233254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:56.303438 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b10c4626-ee9e-47d6-917d-3fc8e75b28a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f78135e514d431fb72a649613e0e6b5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:56.318514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0128cf1-4ed3-4e7d-9bb8-d00b1417b3c2 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:56.323081 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b10c4626-ee9e-47d6-917d-3fc8e75b28a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f78135e514d431fb72a649613e0e6b5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:56.324911 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b10c4626-ee9e-47d6-917d-3fc8e75b28a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f78135e514d431fb72a649613e0e6b5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:56.327001 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa1c9c-1b86-429c-b850-e1d1f53e1fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:56.327914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa1c9c-1b86-429c-b850-e1d1f53e1fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:56.328746 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa1c9c-1b86-429c-b850-e1d1f53e1fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:56.329184 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa1c9c-1b86-429c-b850-e1d1f53e1fd7 admin admin] PATH_INFO: `/v3/projects/70245bff7f364b1b9065459fad0e5ed7` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:56.331519 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa1c9c-1b86-429c-b850-e1d1f53e1fd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70245bff7f364b1b9065459fad0e5ed7)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:56.337441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa1c9c-1b86-429c-b850-e1d1f53e1fd7 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:56.343994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b10c4626-ee9e-47d6-917d-3fc8e75b28a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f78135e514d431fb72a649613e0e6b5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:56.353097 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b10c4626-ee9e-47d6-917d-3fc8e75b28a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f78135e514d431fb72a649613e0e6b5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:56.365304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 917/1826] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:56 2022] DELETE /identity/v3/users/0f78135e514d431fb72a649613e0e6b5 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:56.368832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46b8c4-730e-4f60-a75c-ab29b5f610a5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:56.369341 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46b8c4-730e-4f60-a75c-ab29b5f610a5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:56.369768 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46b8c4-730e-4f60-a75c-ab29b5f610a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:56.412508 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3e46b8c4-730e-4f60-a75c-ab29b5f610a5 None None] MFA Rules not processed for user `e691a4a9d905492ca80887f0e955e9d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:56.414471 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3e46b8c4-730e-4f60-a75c-ab29b5f610a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:56.451582 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-acaa1c9c-1b86-429c-b850-e1d1f53e1fd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70245bff7f364b1b9065459fad0e5ed7', 'request_id': 'req-acaa1c9c-1b86-429c-b850-e1d1f53e1fd7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:56.466428 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-acaa1c9c-1b86-429c-b850-e1d1f53e1fd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70245bff7f364b1b9065459fad0e5ed7', 'request_id': 'req-acaa1c9c-1b86-429c-b850-e1d1f53e1fd7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:56.474910 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-acaa1c9c-1b86-429c-b850-e1d1f53e1fd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70245bff7f364b1b9065459fad0e5ed7', 'request_id': 'req-acaa1c9c-1b86-429c-b850-e1d1f53e1fd7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:56.505478 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-acaa1c9c-1b86-429c-b850-e1d1f53e1fd7 admin admin] The token cache is being invalidate because project 70245bff7f364b1b9065459fad0e5ed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:56.505991 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-acaa1c9c-1b86-429c-b850-e1d1f53e1fd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:56.506887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-acaa1c9c-1b86-429c-b850-e1d1f53e1fd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:56.510028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 910/1827] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:56 2022] DELETE /identity/v3/projects/70245bff7f364b1b9065459fad0e5ed7 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:33:56.512451 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81798ef1-09f6-4e9a-8e15-c16766f2f590 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:56.513074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81798ef1-09f6-4e9a-8e15-c16766f2f590 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:56.513399 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81798ef1-09f6-4e9a-8e15-c16766f2f590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:56.546126 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-81798ef1-09f6-4e9a-8e15-c16766f2f590 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:56.552508 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-81798ef1-09f6-4e9a-8e15-c16766f2f590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:56.566865 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 918/1828] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:56.566865 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46b8c4-730e-4f60-a75c-ab29b5f610a5 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:56.577920 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3e46b8c4-730e-4f60-a75c-ab29b5f610a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:56.651941 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 911/1829] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:56.654161 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81798ef1-09f6-4e9a-8e15-c16766f2f590 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:56.655906 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-81798ef1-09f6-4e9a-8e15-c16766f2f590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:56.700170 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:56.722808 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46b8c4-730e-4f60-a75c-ab29b5f610a5 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:56.740218 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029fca5-12ad-4d88-9340-8ae059808dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:56.740906 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029fca5-12ad-4d88-9340-8ae059808dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:56.741200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029fca5-12ad-4d88-9340-8ae059808dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:56.741493 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029fca5-12ad-4d88-9340-8ae059808dc5 admin admin] PATH_INFO: `/v3/users/c817e5ff770d45dc9f9f96951fd3b2df` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:56.743862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029fca5-12ad-4d88-9340-8ae059808dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c817e5ff770d45dc9f9f96951fd3b2df)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:56.745889 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029fca5-12ad-4d88-9340-8ae059808dc5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:56.750453 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81798ef1-09f6-4e9a-8e15-c16766f2f590 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:56.755056 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c9dfa-aa61-4931-85ff-9d64b7de31fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:56.755847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c9dfa-aa61-4931-85ff-9d64b7de31fb service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:56.756223 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c9dfa-aa61-4931-85ff-9d64b7de31fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:56.757073 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c9dfa-aa61-4931-85ff-9d64b7de31fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:56.828875 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:56.853586 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c029fca5-12ad-4d88-9340-8ae059808dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c817e5ff770d45dc9f9f96951fd3b2df'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:56.866203 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c029fca5-12ad-4d88-9340-8ae059808dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c817e5ff770d45dc9f9f96951fd3b2df'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:56.869069 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c029fca5-12ad-4d88-9340-8ae059808dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c817e5ff770d45dc9f9f96951fd3b2df'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:56.882730 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c9dfa-aa61-4931-85ff-9d64b7de31fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:56.885153 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c9dfa-aa61-4931-85ff-9d64b7de31fb service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:56.897521 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c029fca5-12ad-4d88-9340-8ae059808dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c817e5ff770d45dc9f9f96951fd3b2df'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:56.906358 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 912/1830] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:56.906847 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c029fca5-12ad-4d88-9340-8ae059808dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c817e5ff770d45dc9f9f96951fd3b2df'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:56.907804 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c9dfa-aa61-4931-85ff-9d64b7de31fb service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:56.911264 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a58c9dfa-aa61-4931-85ff-9d64b7de31fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:56.914504 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 919/1831] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:33:56 2022] DELETE /identity/v3/users/c817e5ff770d45dc9f9f96951fd3b2df => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:57.040382 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c9dfa-aa61-4931-85ff-9d64b7de31fb service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:57.170484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931626d-2d08-467e-9cc0-6be91b6ad7af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:57.171074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931626d-2d08-467e-9cc0-6be91b6ad7af service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:57.171324 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931626d-2d08-467e-9cc0-6be91b6ad7af service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:57.171694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931626d-2d08-467e-9cc0-6be91b6ad7af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:57.179665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1931626d-2d08-467e-9cc0-6be91b6ad7af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:57.335281 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:57.389778 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931626d-2d08-467e-9cc0-6be91b6ad7af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:57.392045 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931626d-2d08-467e-9cc0-6be91b6ad7af service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:57.419505 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 913/1832] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:33:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:33:57.600234 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029fca5-12ad-4d88-9340-8ae059808dc5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:57.601792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c029fca5-12ad-4d88-9340-8ae059808dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:57.632781 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029fca5-12ad-4d88-9340-8ae059808dc5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:57.646047 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13cefe-56d4-418e-add1-26181c14b31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:57.646844 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13cefe-56d4-418e-add1-26181c14b31e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:57.647229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13cefe-56d4-418e-add1-26181c14b31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:57.647510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13cefe-56d4-418e-add1-26181c14b31e admin admin] PATH_INFO: `/v3/projects/17c47883908043e3a3bf4a25b4ea965d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:57.650524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13cefe-56d4-418e-add1-26181c14b31e admin admin] RBAC: Authorizing `identity:delete_project(project_id=17c47883908043e3a3bf4a25b4ea965d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:57.652579 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13cefe-56d4-418e-add1-26181c14b31e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:57.815561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9e13cefe-56d4-418e-add1-26181c14b31e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17c47883908043e3a3bf4a25b4ea965d', 'request_id': 'req-9e13cefe-56d4-418e-add1-26181c14b31e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:57.832003 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9e13cefe-56d4-418e-add1-26181c14b31e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17c47883908043e3a3bf4a25b4ea965d', 'request_id': 'req-9e13cefe-56d4-418e-add1-26181c14b31e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:57.841989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9e13cefe-56d4-418e-add1-26181c14b31e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17c47883908043e3a3bf4a25b4ea965d', 'request_id': 'req-9e13cefe-56d4-418e-add1-26181c14b31e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:57.880821 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9e13cefe-56d4-418e-add1-26181c14b31e admin admin] The token cache is being invalidate because project 17c47883908043e3a3bf4a25b4ea965d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:57.881219 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9e13cefe-56d4-418e-add1-26181c14b31e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:57.883106 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9e13cefe-56d4-418e-add1-26181c14b31e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:57.892837 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 920/1833] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:57 2022] DELETE /identity/v3/projects/17c47883908043e3a3bf4a25b4ea965d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:57.894305 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b303b4-08d8-41c8-941e-ad9b8e98ba7b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:57.894589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b303b4-08d8-41c8-941e-ad9b8e98ba7b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:57.895303 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b303b4-08d8-41c8-941e-ad9b8e98ba7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:57.963793 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f6b303b4-08d8-41c8-941e-ad9b8e98ba7b None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:57.965036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f6b303b4-08d8-41c8-941e-ad9b8e98ba7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:58.140618 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 914/1834] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:58.152316 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0365e-51fa-4b15-91ef-a217da0f6345 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:58.152615 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0365e-51fa-4b15-91ef-a217da0f6345 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:58.152890 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0365e-51fa-4b15-91ef-a217da0f6345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:58.186872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2ec0365e-51fa-4b15-91ef-a217da0f6345 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:58.186872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2ec0365e-51fa-4b15-91ef-a217da0f6345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:58.191462 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b303b4-08d8-41c8-941e-ad9b8e98ba7b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:58.193334 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f6b303b4-08d8-41c8-941e-ad9b8e98ba7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:58.204555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 921/1835] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:58.208925 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0365e-51fa-4b15-91ef-a217da0f6345 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:58.231151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b303b4-08d8-41c8-941e-ad9b8e98ba7b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:58.239195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0365e-51fa-4b15-91ef-a217da0f6345 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:58.240880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c377bc-6bd5-465a-833c-ab7a4fbd29c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:58.241569 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c377bc-6bd5-465a-833c-ab7a4fbd29c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:58.241851 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c377bc-6bd5-465a-833c-ab7a4fbd29c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:58.242129 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c377bc-6bd5-465a-833c-ab7a4fbd29c8 admin admin] PATH_INFO: `/v3/projects/06bea92f08c64a62b8aa6bbe5f6bd993` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:58.243945 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c377bc-6bd5-465a-833c-ab7a4fbd29c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06bea92f08c64a62b8aa6bbe5f6bd993)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:58.246014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c377bc-6bd5-465a-833c-ab7a4fbd29c8 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:58.260125 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb297c-0d89-48de-b025-e9290997defc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:58.260125 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb297c-0d89-48de-b025-e9290997defc admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:58.260125 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb297c-0d89-48de-b025-e9290997defc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:58.260461 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb297c-0d89-48de-b025-e9290997defc admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:58.267169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb297c-0d89-48de-b025-e9290997defc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:33:58.271478 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb297c-0d89-48de-b025-e9290997defc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:58.276312 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb297c-0d89-48de-b025-e9290997defc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:58.324327 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 922/1836] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:33:58.325883 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb297c-0d89-48de-b025-e9290997defc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:58.343354 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb297c-0d89-48de-b025-e9290997defc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:58.355807 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-60c377bc-6bd5-465a-833c-ab7a4fbd29c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06bea92f08c64a62b8aa6bbe5f6bd993', 'request_id': 'req-60c377bc-6bd5-465a-833c-ab7a4fbd29c8'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:58.363290 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-60c377bc-6bd5-465a-833c-ab7a4fbd29c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06bea92f08c64a62b8aa6bbe5f6bd993', 'request_id': 'req-60c377bc-6bd5-465a-833c-ab7a4fbd29c8'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:58.373503 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-60c377bc-6bd5-465a-833c-ab7a4fbd29c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06bea92f08c64a62b8aa6bbe5f6bd993', 'request_id': 'req-60c377bc-6bd5-465a-833c-ab7a4fbd29c8'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:58.405336 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-60c377bc-6bd5-465a-833c-ab7a4fbd29c8 admin admin] The token cache is being invalidate because project 06bea92f08c64a62b8aa6bbe5f6bd993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:33:58.405626 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-60c377bc-6bd5-465a-833c-ab7a4fbd29c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:58.406296 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-60c377bc-6bd5-465a-833c-ab7a4fbd29c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:33:58.411395 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 915/1837] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:33:58 2022] DELETE /identity/v3/projects/06bea92f08c64a62b8aa6bbe5f6bd993 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:33:58.413294 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f00d6-02ff-4bd4-8f72-d99a24c9c9d9 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:58.413606 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f00d6-02ff-4bd4-8f72-d99a24c9c9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:58.414368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f00d6-02ff-4bd4-8f72-d99a24c9c9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:58.459299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-b74f00d6-02ff-4bd4-8f72-d99a24c9c9d9 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:58.460726 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b74f00d6-02ff-4bd4-8f72-d99a24c9c9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:58.469154 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839819b7-b284-41de-b014-758343741d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:58.469798 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839819b7-b284-41de-b014-758343741d7d admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:58.470188 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839819b7-b284-41de-b014-758343741d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:58.474857 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839819b7-b284-41de-b014-758343741d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:58.475477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839819b7-b284-41de-b014-758343741d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:58.477728 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839819b7-b284-41de-b014-758343741d7d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:58.489037 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 916/1838] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:58.497912 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ffafc-223e-4349-8bae-5528f569237e None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:58.498410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ffafc-223e-4349-8bae-5528f569237e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:58.498863 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ffafc-223e-4349-8bae-5528f569237e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:58.516416 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:58.536406 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 923/1839] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:58 2022] POST /identity/v3/projects => generated 385 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:58.542347 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839819b7-b284-41de-b014-758343741d7d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:58.545065 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-839819b7-b284-41de-b014-758343741d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:58.553989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e74ffafc-223e-4349-8bae-5528f569237e None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:58.555976 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e74ffafc-223e-4349-8bae-5528f569237e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:58.638470 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:58.661252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839819b7-b284-41de-b014-758343741d7d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:58.670767 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511b7a1-0d07-4b9d-8fe1-31c83c5a74ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:58.673078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511b7a1-0d07-4b9d-8fe1-31c83c5a74ba admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:58.673078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511b7a1-0d07-4b9d-8fe1-31c83c5a74ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:58.673078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511b7a1-0d07-4b9d-8fe1-31c83c5a74ba admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:58.673078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511b7a1-0d07-4b9d-8fe1-31c83c5a74ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:58.677065 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 917/1840] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:58.679535 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511b7a1-0d07-4b9d-8fe1-31c83c5a74ba admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:58.682608 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ffafc-223e-4349-8bae-5528f569237e None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:58.696962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ffafc-223e-4349-8bae-5528f569237e None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:58.704561 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd849e38-e8b7-40f3-a9e3-99e27057fc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:58.705565 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd849e38-e8b7-40f3-a9e3-99e27057fc63 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:58.706354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd849e38-e8b7-40f3-a9e3-99e27057fc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:58.706702 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd849e38-e8b7-40f3-a9e3-99e27057fc63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:58.707471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd849e38-e8b7-40f3-a9e3-99e27057fc63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:33:58.707847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd849e38-e8b7-40f3-a9e3-99e27057fc63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:58.722908 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd849e38-e8b7-40f3-a9e3-99e27057fc63 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:58.723947 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 924/1841] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:58 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:33:58.728657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511b7a1-0d07-4b9d-8fe1-31c83c5a74ba admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:58.745282 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511b7a1-0d07-4b9d-8fe1-31c83c5a74ba admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:58.751005 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e8e98-b395-4cd2-bcad-0cfaa0d82229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:58.751668 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e8e98-b395-4cd2-bcad-0cfaa0d82229 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:58.751950 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e8e98-b395-4cd2-bcad-0cfaa0d82229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:58.752221 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e8e98-b395-4cd2-bcad-0cfaa0d82229 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:58.752915 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e8e98-b395-4cd2-bcad-0cfaa0d82229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:58.759098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e8e98-b395-4cd2-bcad-0cfaa0d82229 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:58.761252 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 918/1842] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:33:58.773398 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 925/1843] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:33:58.779413 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd849e38-e8b7-40f3-a9e3-99e27057fc63 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:58.784716 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e8e98-b395-4cd2-bcad-0cfaa0d82229 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:58.790928 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd849e38-e8b7-40f3-a9e3-99e27057fc63 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:58.797324 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d93c2e-b9f7-4537-92c6-4bf0cfd2c2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:58.798782 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d93c2e-b9f7-4537-92c6-4bf0cfd2c2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:58.798782 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d93c2e-b9f7-4537-92c6-4bf0cfd2c2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:58.798782 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d93c2e-b9f7-4537-92c6-4bf0cfd2c2d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:58.799502 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d93c2e-b9f7-4537-92c6-4bf0cfd2c2d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:58.801662 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d93c2e-b9f7-4537-92c6-4bf0cfd2c2d8 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:58.816020 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e8e98-b395-4cd2-bcad-0cfaa0d82229 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:58.829082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51ebbd-4df1-4c7e-9912-fe14df9dbbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:58.830065 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51ebbd-4df1-4c7e-9912-fe14df9dbbad admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:58.830192 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51ebbd-4df1-4c7e-9912-fe14df9dbbad admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:58.830612 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51ebbd-4df1-4c7e-9912-fe14df9dbbad admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:58.832585 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51ebbd-4df1-4c7e-9912-fe14df9dbbad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:58.849269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51ebbd-4df1-4c7e-9912-fe14df9dbbad admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:58.860351 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 919/1844] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:58 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:58.863638 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09764720-97f9-49c1-a96a-be4124a3eda6 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:58.863638 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09764720-97f9-49c1-a96a-be4124a3eda6 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:58.863638 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09764720-97f9-49c1-a96a-be4124a3eda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:58.873887 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 926/1845] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:58.877875 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51ebbd-4df1-4c7e-9912-fe14df9dbbad admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:58.902979 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51ebbd-4df1-4c7e-9912-fe14df9dbbad admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:58.906636 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-09764720-97f9-49c1-a96a-be4124a3eda6 None None] MFA Rules not processed for user `e691a4a9d905492ca80887f0e955e9d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:58.907884 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-09764720-97f9-49c1-a96a-be4124a3eda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:59.057140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91745fdc-3431-40bd-a788-6835f13bc0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:59.059514 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91745fdc-3431-40bd-a788-6835f13bc0ee admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:59.060499 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91745fdc-3431-40bd-a788-6835f13bc0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:59.060800 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91745fdc-3431-40bd-a788-6835f13bc0ee admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:59.065004 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91745fdc-3431-40bd-a788-6835f13bc0ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:59.070268 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91745fdc-3431-40bd-a788-6835f13bc0ee admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:59.078493 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 920/1846] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:33:59.078493 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09764720-97f9-49c1-a96a-be4124a3eda6 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:59.100788 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09764720-97f9-49c1-a96a-be4124a3eda6 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:59.117499 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ce6e5-6b04-4a76-b760-d64972af04e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:59.120939 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ce6e5-6b04-4a76-b760-d64972af04e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:59.121254 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ce6e5-6b04-4a76-b760-d64972af04e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:59.121531 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ce6e5-6b04-4a76-b760-d64972af04e0 admin admin] PATH_INFO: `/v3/projects/413acfc0a64845958e93e751239ba503/users/e6470cc842a44dbaa81c6ecfdadf2993/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:59.123380 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 927/1847] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:58 2022] POST /identity/v3/users => generated 287 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:59.127522 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91745fdc-3431-40bd-a788-6835f13bc0ee admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:59.154995 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91745fdc-3431-40bd-a788-6835f13bc0ee admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:59.164303 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ce6e5-6b04-4a76-b760-d64972af04e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=413acfc0a64845958e93e751239ba503, user_id=e6470cc842a44dbaa81c6ecfdadf2993, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:59.168074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ce6e5-6b04-4a76-b760-d64972af04e0 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:59.169841 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c763323-4842-4f09-afd3-3f7f86a7f6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:59.171031 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c763323-4842-4f09-afd3-3f7f86a7f6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:59.171478 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c763323-4842-4f09-afd3-3f7f86a7f6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:59.172948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c763323-4842-4f09-afd3-3f7f86a7f6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:59.173841 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c763323-4842-4f09-afd3-3f7f86a7f6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:59.178142 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c763323-4842-4f09-afd3-3f7f86a7f6b1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:59.203256 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 921/1848] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:59 2022] PUT /identity/v3/projects/413acfc0a64845958e93e751239ba503/users/e6470cc842a44dbaa81c6ecfdadf2993/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:33:59.204202 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 928/1849] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:59.234173 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ce6e5-6b04-4a76-b760-d64972af04e0 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:59.290652 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1ea0e-e91c-4433-bbc2-109ba051d83a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:59.291183 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1ea0e-e91c-4433-bbc2-109ba051d83a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:59.291844 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1ea0e-e91c-4433-bbc2-109ba051d83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:59.353868 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ce6e5-6b04-4a76-b760-d64972af04e0 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:59.359084 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e11bca-f600-4e35-91cb-a1fd1cf318b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:59.359713 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e11bca-f600-4e35-91cb-a1fd1cf318b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:59.359997 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e11bca-f600-4e35-91cb-a1fd1cf318b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:59.360276 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e11bca-f600-4e35-91cb-a1fd1cf318b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:59.361001 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e11bca-f600-4e35-91cb-a1fd1cf318b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:59.362688 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e11bca-f600-4e35-91cb-a1fd1cf318b2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:59.375538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 922/1850] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:33:59.379488 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e11bca-f600-4e35-91cb-a1fd1cf318b2 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:59.395618 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e11bca-f600-4e35-91cb-a1fd1cf318b2 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:59.402071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c7a79-c435-4d5d-90e3-3912f7b1d815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:59.402927 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c7a79-c435-4d5d-90e3-3912f7b1d815 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:59.403515 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c7a79-c435-4d5d-90e3-3912f7b1d815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:59.404435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c7a79-c435-4d5d-90e3-3912f7b1d815 admin admin] PATH_INFO: `/v3/projects/803f081b1d284535b4e8fa551efc0110/users/45ad368e7fe042f580a7dffab752ebb2/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:59.410528 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a8f1ea0e-e91c-4433-bbc2-109ba051d83a None None] MFA Rules not processed for user `e6470cc842a44dbaa81c6ecfdadf2993`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:59.411947 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a8f1ea0e-e91c-4433-bbc2-109ba051d83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:59.427152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c7a79-c435-4d5d-90e3-3912f7b1d815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=803f081b1d284535b4e8fa551efc0110, user_id=45ad368e7fe042f580a7dffab752ebb2, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:59.432893 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c7a79-c435-4d5d-90e3-3912f7b1d815 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:59.468080 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 923/1851] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:33:59 2022] PUT /identity/v3/projects/803f081b1d284535b4e8fa551efc0110/users/45ad368e7fe042f580a7dffab752ebb2/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:33:59.480224 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b77164-e772-4361-b804-018d7f38ff01 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:59.480745 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b77164-e772-4361-b804-018d7f38ff01 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:59.481343 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b77164-e772-4361-b804-018d7f38ff01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:59.570790 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:59.583292 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:33:59.599038 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-66b77164-e772-4361-b804-018d7f38ff01 None None] MFA Rules not processed for user `45ad368e7fe042f580a7dffab752ebb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:33:59.600553 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-66b77164-e772-4361-b804-018d7f38ff01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:33:59.720780 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 929/1852] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:59.725322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1ea0e-e91c-4433-bbc2-109ba051d83a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:59.729651 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 924/1853] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:33:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:33:59.764398 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1ea0e-e91c-4433-bbc2-109ba051d83a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:33:59.845144 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb449414-b777-4d29-9738-5554db04854f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:33:59.845948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb449414-b777-4d29-9738-5554db04854f admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:33:59.846386 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb449414-b777-4d29-9738-5554db04854f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:33:59.846671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb449414-b777-4d29-9738-5554db04854f admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:33:59.847747 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb449414-b777-4d29-9738-5554db04854f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:33:59.850155 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb449414-b777-4d29-9738-5554db04854f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:33:59.896183 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b77164-e772-4361-b804-018d7f38ff01 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:33:59.915329 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 930/1854] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:33:59 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:33:59.918373 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b77164-e772-4361-b804-018d7f38ff01 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:00.054511 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a56c1-c106-405a-b8a6-229a64dfc06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:00.055682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a56c1-c106-405a-b8a6-229a64dfc06e admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:00.055977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a56c1-c106-405a-b8a6-229a64dfc06e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:00.056257 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a56c1-c106-405a-b8a6-229a64dfc06e admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:00.056906 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a56c1-c106-405a-b8a6-229a64dfc06e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:00.058929 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a56c1-c106-405a-b8a6-229a64dfc06e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:00.112250 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 925/1855] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:33:59 2022] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:34:00.116348 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb449414-b777-4d29-9738-5554db04854f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:00.129367 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb449414-b777-4d29-9738-5554db04854f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:00.157802 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f69133-9038-495f-8c76-c760dfe91c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:00.158438 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f69133-9038-495f-8c76-c760dfe91c82 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:00.158728 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f69133-9038-495f-8c76-c760dfe91c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:00.159005 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f69133-9038-495f-8c76-c760dfe91c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:00.159671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f69133-9038-495f-8c76-c760dfe91c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:00.161316 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f69133-9038-495f-8c76-c760dfe91c82 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:00.174050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a56c1-c106-405a-b8a6-229a64dfc06e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:00.177909 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-360a56c1-c106-405a-b8a6-229a64dfc06e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:00.195608 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 931/1856] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:34:00.197144 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f69133-9038-495f-8c76-c760dfe91c82 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:00.222003 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f69133-9038-495f-8c76-c760dfe91c82 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:00.238477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcd4b1-8621-41ed-97c4-d4612cbb11b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:00.240145 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcd4b1-8621-41ed-97c4-d4612cbb11b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:00.240503 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcd4b1-8621-41ed-97c4-d4612cbb11b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:00.240783 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfcd4b1-8621-41ed-97c4-d4612cbb11b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:00.241617 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcd4b1-8621-41ed-97c4-d4612cbb11b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:00.248832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfcd4b1-8621-41ed-97c4-d4612cbb11b5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:00.267000 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 932/1857] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:34:00.270875 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcd4b1-8621-41ed-97c4-d4612cbb11b5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:00.292020 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfcd4b1-8621-41ed-97c4-d4612cbb11b5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:00.298327 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ced2e-4645-4daf-b1bd-664f10648044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:00.299208 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ced2e-4645-4daf-b1bd-664f10648044 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:00.300315 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ced2e-4645-4daf-b1bd-664f10648044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:00.300729 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ced2e-4645-4daf-b1bd-664f10648044 admin admin] PATH_INFO: `/v3/projects/20b10d6ce0f843b1b3490c33683414ae/users/0df3a6e52ae546c284dad41c786c7f9c/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:00.339264 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ced2e-4645-4daf-b1bd-664f10648044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b10d6ce0f843b1b3490c33683414ae, user_id=0df3a6e52ae546c284dad41c786c7f9c, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:00.344001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ced2e-4645-4daf-b1bd-664f10648044 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:00.374239 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 933/1858] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:34:00 2022] PUT /identity/v3/projects/20b10d6ce0f843b1b3490c33683414ae/users/0df3a6e52ae546c284dad41c786c7f9c/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:34:00.374941 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a56c1-c106-405a-b8a6-229a64dfc06e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:00.376614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ecdbb-d74c-426d-8f48-28b745a307b6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:00.377031 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ecdbb-d74c-426d-8f48-28b745a307b6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:00.377519 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ecdbb-d74c-426d-8f48-28b745a307b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:00.423815 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-163ecdbb-d74c-426d-8f48-28b745a307b6 None None] MFA Rules not processed for user `0df3a6e52ae546c284dad41c786c7f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:00.425519 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-163ecdbb-d74c-426d-8f48-28b745a307b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:00.436806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:00.536754 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750340f-10f7-4341-a0b2-521ef97b38bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:00.552408 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750340f-10f7-4341-a0b2-521ef97b38bc service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:00.552734 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750340f-10f7-4341-a0b2-521ef97b38bc service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:00.552979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750340f-10f7-4341-a0b2-521ef97b38bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:00.636172 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 934/1859] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:00.641359 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ecdbb-d74c-426d-8f48-28b745a307b6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:00.655143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:00.697742 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750340f-10f7-4341-a0b2-521ef97b38bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:00.701056 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750340f-10f7-4341-a0b2-521ef97b38bc service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:00.729591 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 926/1860] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:34:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:34:00.830753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ecdbb-d74c-426d-8f48-28b745a307b6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:00.841675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b35d18-cf4d-4cf1-9518-6e935f85a959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:00.842416 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b35d18-cf4d-4cf1-9518-6e935f85a959 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:00.842724 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b35d18-cf4d-4cf1-9518-6e935f85a959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:00.843023 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b35d18-cf4d-4cf1-9518-6e935f85a959 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:00.843739 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b35d18-cf4d-4cf1-9518-6e935f85a959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:00.849176 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b35d18-cf4d-4cf1-9518-6e935f85a959 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:00.940525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 935/1861] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:34:00 2022] POST /identity/v3/projects => generated 385 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:34:00.944744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750340f-10f7-4341-a0b2-521ef97b38bc service nova] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:00.956560 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750340f-10f7-4341-a0b2-521ef97b38bc service nova] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:01.091561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b35d18-cf4d-4cf1-9518-6e935f85a959 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:01.095303 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68a5de-8952-4c9a-a1d0-cb1d9f634184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:01.096217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68a5de-8952-4c9a-a1d0-cb1d9f634184 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:01.096682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68a5de-8952-4c9a-a1d0-cb1d9f634184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:01.098736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68a5de-8952-4c9a-a1d0-cb1d9f634184 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:01.100583 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68a5de-8952-4c9a-a1d0-cb1d9f634184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:01.103684 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68a5de-8952-4c9a-a1d0-cb1d9f634184 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:01.114925 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b35d18-cf4d-4cf1-9518-6e935f85a959 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:01.125415 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2081a-1727-4bc5-a2a4-1161b0ce96ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:01.126072 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2081a-1727-4bc5-a2a4-1161b0ce96ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:01.126355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2081a-1727-4bc5-a2a4-1161b0ce96ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:01.126635 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2081a-1727-4bc5-a2a4-1161b0ce96ae admin admin] PATH_INFO: `/v3/users/45ad368e7fe042f580a7dffab752ebb2` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:01.130599 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2081a-1727-4bc5-a2a4-1161b0ce96ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ad368e7fe042f580a7dffab752ebb2)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:01.132665 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2081a-1727-4bc5-a2a4-1161b0ce96ae admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:01.148649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 927/1862] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:34:00 2022] POST /identity/v3/users => generated 299 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:34:01.151398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68a5de-8952-4c9a-a1d0-cb1d9f634184 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:01.175861 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68a5de-8952-4c9a-a1d0-cb1d9f634184 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:01.228795 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7175a-890a-4c76-8149-45cc876b66e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:01.229917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7175a-890a-4c76-8149-45cc876b66e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:01.230204 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7175a-890a-4c76-8149-45cc876b66e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:01.230488 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7175a-890a-4c76-8149-45cc876b66e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:01.231449 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7175a-890a-4c76-8149-45cc876b66e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:01.233511 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7175a-890a-4c76-8149-45cc876b66e3 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:01.239431 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-81f2081a-1727-4bc5-a2a4-1161b0ce96ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ad368e7fe042f580a7dffab752ebb2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:01.250771 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-81f2081a-1727-4bc5-a2a4-1161b0ce96ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ad368e7fe042f580a7dffab752ebb2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:01.253082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-81f2081a-1727-4bc5-a2a4-1161b0ce96ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ad368e7fe042f580a7dffab752ebb2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:01.276027 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-81f2081a-1727-4bc5-a2a4-1161b0ce96ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ad368e7fe042f580a7dffab752ebb2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:01.277539 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 928/1863] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:34:01.278508 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7175a-890a-4c76-8149-45cc876b66e3 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:01.285669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-75d7175a-890a-4c76-8149-45cc876b66e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:01.290918 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-81f2081a-1727-4bc5-a2a4-1161b0ce96ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ad368e7fe042f580a7dffab752ebb2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:01.304822 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 936/1864] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:34:01 2022] DELETE /identity/v3/users/45ad368e7fe042f580a7dffab752ebb2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:01.309919 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c89b0b-534c-4b53-986d-8bc265e4b7c8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:01.310412 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c89b0b-534c-4b53-986d-8bc265e4b7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:01.310842 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c89b0b-534c-4b53-986d-8bc265e4b7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:01.330570 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7175a-890a-4c76-8149-45cc876b66e3 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:01.353973 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c5c89b0b-534c-4b53-986d-8bc265e4b7c8 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:01.355528 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c5c89b0b-534c-4b53-986d-8bc265e4b7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:01.404887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:01.427659 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a70a63-cfb7-4186-a028-1e140ac21dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:01.428617 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a70a63-cfb7-4186-a028-1e140ac21dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:01.428966 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a70a63-cfb7-4186-a028-1e140ac21dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:01.429424 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a70a63-cfb7-4186-a028-1e140ac21dc9 admin admin] PATH_INFO: `/v3/projects/fdc53aae1ddd4c32abd4191dc0d6014d/users/5de4ff239b064994828b72a50bcbcd0b/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:01.454150 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a70a63-cfb7-4186-a028-1e140ac21dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc53aae1ddd4c32abd4191dc0d6014d, user_id=5de4ff239b064994828b72a50bcbcd0b, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:01.457530 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a70a63-cfb7-4186-a028-1e140ac21dc9 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:01.482265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 929/1865] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:34:01 2022] PUT /identity/v3/projects/fdc53aae1ddd4c32abd4191dc0d6014d/users/5de4ff239b064994828b72a50bcbcd0b/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:01.483821 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a70a63-cfb7-4186-a028-1e140ac21dc9 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:01.485759 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:01.513214 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 937/1866] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:01.527483 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c89b0b-534c-4b53-986d-8bc265e4b7c8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:01.532500 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c5c89b0b-534c-4b53-986d-8bc265e4b7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:01.662580 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c89b0b-534c-4b53-986d-8bc265e4b7c8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:01.701302 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a70a63-cfb7-4186-a028-1e140ac21dc9 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:01.719520 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948cddd-ff4f-4077-b2da-a31e6170a11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:01.721187 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948cddd-ff4f-4077-b2da-a31e6170a11f admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:01.722857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948cddd-ff4f-4077-b2da-a31e6170a11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:01.723354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948cddd-ff4f-4077-b2da-a31e6170a11f admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:01.724903 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948cddd-ff4f-4077-b2da-a31e6170a11f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:01.734485 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948cddd-ff4f-4077-b2da-a31e6170a11f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:01.765531 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 930/1867] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:34:01.770051 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948cddd-ff4f-4077-b2da-a31e6170a11f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:01.794324 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2aa67-98f8-41fc-bd73-e1bda156be51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:01.795233 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2aa67-98f8-41fc-bd73-e1bda156be51 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:01.795723 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2aa67-98f8-41fc-bd73-e1bda156be51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:01.796224 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2aa67-98f8-41fc-bd73-e1bda156be51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:01.798496 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948cddd-ff4f-4077-b2da-a31e6170a11f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:01.809767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5b7a3-fbbd-4351-8d18-70a5da8c8947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:01.812150 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5b7a3-fbbd-4351-8d18-70a5da8c8947 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:01.812484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5b7a3-fbbd-4351-8d18-70a5da8c8947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:01.812791 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5b7a3-fbbd-4351-8d18-70a5da8c8947 admin admin] PATH_INFO: `/v3/projects/fdc53aae1ddd4c32abd4191dc0d6014d/users/5de4ff239b064994828b72a50bcbcd0b/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:01.818663 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5b7a3-fbbd-4351-8d18-70a5da8c8947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc53aae1ddd4c32abd4191dc0d6014d, user_id=5de4ff239b064994828b72a50bcbcd0b, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:01.826113 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5b7a3-fbbd-4351-8d18-70a5da8c8947 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:01.838320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2aa67-98f8-41fc-bd73-e1bda156be51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:01.841588 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2aa67-98f8-41fc-bd73-e1bda156be51 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:01.853947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 931/1868] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:34:01 2022] PUT /identity/v3/projects/fdc53aae1ddd4c32abd4191dc0d6014d/users/5de4ff239b064994828b72a50bcbcd0b/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:01.855020 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 938/1869] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:34:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:34:01.865487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418c568-aff8-4a24-b5e5-bcd8dd3dbc73 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:01.865856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418c568-aff8-4a24-b5e5-bcd8dd3dbc73 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:01.866160 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418c568-aff8-4a24-b5e5-bcd8dd3dbc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:01.933487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-6418c568-aff8-4a24-b5e5-bcd8dd3dbc73 None None] MFA Rules not processed for user `5de4ff239b064994828b72a50bcbcd0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:01.935081 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6418c568-aff8-4a24-b5e5-bcd8dd3dbc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:02.028548 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 932/1870] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:02.042638 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2aa67-98f8-41fc-bd73-e1bda156be51 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:02.044150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0ae2aa67-98f8-41fc-bd73-e1bda156be51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:02.163853 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2aa67-98f8-41fc-bd73-e1bda156be51 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:02.224737 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2994c-37f0-45da-a413-004d65cc0006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:02.225666 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2994c-37f0-45da-a413-004d65cc0006 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:02.226288 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2994c-37f0-45da-a413-004d65cc0006 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:02.227797 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2994c-37f0-45da-a413-004d65cc0006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:02.229975 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9ea2994c-37f0-45da-a413-004d65cc0006 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:02.281949 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418c568-aff8-4a24-b5e5-bcd8dd3dbc73 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:02.284199 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6418c568-aff8-4a24-b5e5-bcd8dd3dbc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:02.291839 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:02.334296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2994c-37f0-45da-a413-004d65cc0006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:02.336145 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2994c-37f0-45da-a413-004d65cc0006 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:02.349029 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 939/1871] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:34:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:34:02.369462 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:02.406612 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418c568-aff8-4a24-b5e5-bcd8dd3dbc73 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:02.412028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0302668-d678-443e-9bd0-56a0febcfa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:02.412674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0302668-d678-443e-9bd0-56a0febcfa07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:02.413089 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0302668-d678-443e-9bd0-56a0febcfa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:02.413427 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0302668-d678-443e-9bd0-56a0febcfa07 admin admin] PATH_INFO: `/v3/projects/803f081b1d284535b4e8fa551efc0110` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:02.414987 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0302668-d678-443e-9bd0-56a0febcfa07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=803f081b1d284535b4e8fa551efc0110)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:02.417234 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0302668-d678-443e-9bd0-56a0febcfa07 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:02.479053 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c0302668-d678-443e-9bd0-56a0febcfa07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '803f081b1d284535b4e8fa551efc0110', 'request_id': 'req-c0302668-d678-443e-9bd0-56a0febcfa07'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:02.491899 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c0302668-d678-443e-9bd0-56a0febcfa07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '803f081b1d284535b4e8fa551efc0110', 'request_id': 'req-c0302668-d678-443e-9bd0-56a0febcfa07'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:02.500655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c0302668-d678-443e-9bd0-56a0febcfa07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '803f081b1d284535b4e8fa551efc0110', 'request_id': 'req-c0302668-d678-443e-9bd0-56a0febcfa07'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:02.533368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c0302668-d678-443e-9bd0-56a0febcfa07 admin admin] The token cache is being invalidate because project 803f081b1d284535b4e8fa551efc0110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:34:02.533643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c0302668-d678-443e-9bd0-56a0febcfa07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:02.534341 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-c0302668-d678-443e-9bd0-56a0febcfa07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:02.538507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 933/1872] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:34:02 2022] DELETE /identity/v3/projects/803f081b1d284535b4e8fa551efc0110 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:34:02.545261 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9f14f-02ac-49dc-860d-c54c08a212b6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:02.546248 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9f14f-02ac-49dc-860d-c54c08a212b6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:02.546780 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9f14f-02ac-49dc-860d-c54c08a212b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:02.607286 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-eeb9f14f-02ac-49dc-860d-c54c08a212b6 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:02.608800 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-eeb9f14f-02ac-49dc-860d-c54c08a212b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:02.712689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 940/1873] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:02.721750 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda14e42-d29d-4d4c-b84d-8b0ee32d7f72 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:02.722038 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda14e42-d29d-4d4c-b84d-8b0ee32d7f72 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:02.722313 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda14e42-d29d-4d4c-b84d-8b0ee32d7f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:02.814755 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-cda14e42-d29d-4d4c-b84d-8b0ee32d7f72 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:02.822694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-cda14e42-d29d-4d4c-b84d-8b0ee32d7f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:02.860433 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 934/1874] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:02.865464 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9f14f-02ac-49dc-860d-c54c08a212b6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:02.885637 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9f14f-02ac-49dc-860d-c54c08a212b6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:02.905979 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3018a-6769-413e-a2d3-2bb35e863fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:02.906624 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3018a-6769-413e-a2d3-2bb35e863fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:02.906971 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3018a-6769-413e-a2d3-2bb35e863fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:02.907388 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3018a-6769-413e-a2d3-2bb35e863fc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:02.908065 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3018a-6769-413e-a2d3-2bb35e863fc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:34:02.908362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3018a-6769-413e-a2d3-2bb35e863fc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:02.925491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3018a-6769-413e-a2d3-2bb35e863fc5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:02.948064 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 941/1875] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:34:02.953576 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda14e42-d29d-4d4c-b84d-8b0ee32d7f72 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:02.964318 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda14e42-d29d-4d4c-b84d-8b0ee32d7f72 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:02.970483 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae192a1-99d5-419e-a9cf-bb10a062c2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:02.971246 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae192a1-99d5-419e-a9cf-bb10a062c2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:02.971772 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae192a1-99d5-419e-a9cf-bb10a062c2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:02.972156 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae192a1-99d5-419e-a9cf-bb10a062c2a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:02.973073 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae192a1-99d5-419e-a9cf-bb10a062c2a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:02.975519 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae192a1-99d5-419e-a9cf-bb10a062c2a3 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:03.032836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 935/1876] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:34:02 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:34:03.037076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3018a-6769-413e-a2d3-2bb35e863fc5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:03.052963 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3018a-6769-413e-a2d3-2bb35e863fc5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:03.182556 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9643b8-704e-480b-9dde-61a01958d0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:03.183222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9643b8-704e-480b-9dde-61a01958d0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:03.183553 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9643b8-704e-480b-9dde-61a01958d0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:03.183827 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9643b8-704e-480b-9dde-61a01958d0c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:03.184468 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9643b8-704e-480b-9dde-61a01958d0c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:03.186396 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9643b8-704e-480b-9dde-61a01958d0c5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:03.209263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 942/1877] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:34:03 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:34:03.217637 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae192a1-99d5-419e-a9cf-bb10a062c2a3 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:03.229486 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae192a1-99d5-419e-a9cf-bb10a062c2a3 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:03.237818 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93796ed-d390-44a5-93a2-6e658b779002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:03.238580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93796ed-d390-44a5-93a2-6e658b779002 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:03.238882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93796ed-d390-44a5-93a2-6e658b779002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:03.239141 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93796ed-d390-44a5-93a2-6e658b779002 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:03.239807 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93796ed-d390-44a5-93a2-6e658b779002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:03.241482 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93796ed-d390-44a5-93a2-6e658b779002 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:03.254983 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 936/1878] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:34:03.259132 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9643b8-704e-480b-9dde-61a01958d0c5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:03.270341 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9643b8-704e-480b-9dde-61a01958d0c5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:03.276555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a9ebc-4bf6-44dc-b30d-4b9888161866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:03.277325 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a9ebc-4bf6-44dc-b30d-4b9888161866 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:03.277724 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a9ebc-4bf6-44dc-b30d-4b9888161866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:03.278099 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a9ebc-4bf6-44dc-b30d-4b9888161866 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:03.279241 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a9ebc-4bf6-44dc-b30d-4b9888161866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:03.280926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a9ebc-4bf6-44dc-b30d-4b9888161866 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:03.306960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 943/1879] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:34:03.311290 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93796ed-d390-44a5-93a2-6e658b779002 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:03.323984 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93796ed-d390-44a5-93a2-6e658b779002 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:03.330420 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dad741-cfbf-48f9-b192-c9d0c34e5b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:03.331438 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dad741-cfbf-48f9-b192-c9d0c34e5b6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:03.331849 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dad741-cfbf-48f9-b192-c9d0c34e5b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:03.332219 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dad741-cfbf-48f9-b192-c9d0c34e5b6e admin admin] PATH_INFO: `/v3/projects/fe0ed8f0296e48949ae16ca62f20dc59/users/774f6323e89d46fda0901c7b6a6c3ccd/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:03.351697 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dad741-cfbf-48f9-b192-c9d0c34e5b6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe0ed8f0296e48949ae16ca62f20dc59, user_id=774f6323e89d46fda0901c7b6a6c3ccd, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:03.355027 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dad741-cfbf-48f9-b192-c9d0c34e5b6e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:03.376201 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 937/1880] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:34:03 2022] PUT /identity/v3/projects/fe0ed8f0296e48949ae16ca62f20dc59/users/774f6323e89d46fda0901c7b6a6c3ccd/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:34:03.387540 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0d7f3-c900-48ba-b813-b036e38b0124 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:03.387830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0d7f3-c900-48ba-b813-b036e38b0124 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:03.388105 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0d7f3-c900-48ba-b813-b036e38b0124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:03.433159 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-55c0d7f3-c900-48ba-b813-b036e38b0124 None None] MFA Rules not processed for user `774f6323e89d46fda0901c7b6a6c3ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:03.433159 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-55c0d7f3-c900-48ba-b813-b036e38b0124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:03.442990 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a65a5e-36ec-45b8-aa19-fda578a319a9 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:03.443515 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a65a5e-36ec-45b8-aa19-fda578a319a9 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:03.447309 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a65a5e-36ec-45b8-aa19-fda578a319a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:03.473062 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:03.515415 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-c6a65a5e-36ec-45b8-aa19-fda578a319a9 None None] MFA Rules not processed for user `ceeacedb9ea5485c8cdd7d6531b7d54e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:03.516665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c6a65a5e-36ec-45b8-aa19-fda578a319a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:03.554233 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 944/1881] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:03.559399 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0d7f3-c900-48ba-b813-b036e38b0124 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:03.619240 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:03.647947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 938/1882] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:03.648943 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0d7f3-c900-48ba-b813-b036e38b0124 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:03.662075 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a65a5e-36ec-45b8-aa19-fda578a319a9 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:03.663531 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f561263-b213-4569-b332-921130abfb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:03.664461 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f561263-b213-4569-b332-921130abfb7b admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:03.664747 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f561263-b213-4569-b332-921130abfb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:03.665020 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f561263-b213-4569-b332-921130abfb7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:03.665428 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c6a65a5e-36ec-45b8-aa19-fda578a319a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:03.665699 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f561263-b213-4569-b332-921130abfb7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:03.668327 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f561263-b213-4569-b332-921130abfb7b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:03.727008 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 945/1883] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:34:03 2022] POST /identity/v3/projects => generated 369 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:34:03.732045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f561263-b213-4569-b332-921130abfb7b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:03.783425 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a65a5e-36ec-45b8-aa19-fda578a319a9 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:03.850589 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f561263-b213-4569-b332-921130abfb7b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:03.858500 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3f110-2279-41b3-a82d-223bfa736f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:03.859533 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3f110-2279-41b3-a82d-223bfa736f1a admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:03.860205 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3f110-2279-41b3-a82d-223bfa736f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:03.860490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3f110-2279-41b3-a82d-223bfa736f1a admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:03.861169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3f110-2279-41b3-a82d-223bfa736f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:03.863226 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3f110-2279-41b3-a82d-223bfa736f1a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:03.887122 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bac08-ba27-4230-a199-4d71b20fa892 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c6b6b1cdc649dda3a9caa8d9713569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:03.888117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bac08-ba27-4230-a199-4d71b20fa892 service glance] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:03.888445 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bac08-ba27-4230-a199-4d71b20fa892 service glance] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:03.888731 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bac08-ba27-4230-a199-4d71b20fa892 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:03.891080 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ee8bac08-ba27-4230-a199-4d71b20fa892 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:03.894660 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 946/1884] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:34:03 2022] POST /identity/v3/users => generated 291 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:34:03.900158 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3f110-2279-41b3-a82d-223bfa736f1a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:03.915409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3f110-2279-41b3-a82d-223bfa736f1a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:03.925099 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d51e0d-5532-4473-911e-9867a0902850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:03.927660 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d51e0d-5532-4473-911e-9867a0902850 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:03.931382 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d51e0d-5532-4473-911e-9867a0902850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:03.931684 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d51e0d-5532-4473-911e-9867a0902850 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:03.932557 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d51e0d-5532-4473-911e-9867a0902850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:03.934205 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d51e0d-5532-4473-911e-9867a0902850 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:03.966602 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 947/1885] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:34:03.969690 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d51e0d-5532-4473-911e-9867a0902850 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:03.986723 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d51e0d-5532-4473-911e-9867a0902850 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:03.995868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769aae0b-a732-42c7-b69e-cf61d43bb8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:03.996622 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769aae0b-a732-42c7-b69e-cf61d43bb8d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:03.996990 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769aae0b-a732-42c7-b69e-cf61d43bb8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:03.997292 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769aae0b-a732-42c7-b69e-cf61d43bb8d5 admin admin] PATH_INFO: `/v3/projects/7233db76236e45889d328f122aa368cb/users/05ffd9610c2a449ebd8e91ae254d4dde/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:04.016003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8bac08-ba27-4230-a199-4d71b20fa892 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:04.017937 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8bac08-ba27-4230-a199-4d71b20fa892 service glance] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:04.029318 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769aae0b-a732-42c7-b69e-cf61d43bb8d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7233db76236e45889d328f122aa368cb, user_id=05ffd9610c2a449ebd8e91ae254d4dde, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:04.032131 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769aae0b-a732-42c7-b69e-cf61d43bb8d5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:04.079090 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 939/1886] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:34:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:34:04.109473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 948/1887] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:34:03 2022] PUT /identity/v3/projects/7233db76236e45889d328f122aa368cb/users/05ffd9610c2a449ebd8e91ae254d4dde/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:04.113432 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bac08-ba27-4230-a199-4d71b20fa892 service glance] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:04.140557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bac08-ba27-4230-a199-4d71b20fa892 service glance] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:04.293847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d9504-7615-4953-97b8-77e7771361aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:04.297223 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d9504-7615-4953-97b8-77e7771361aa admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:04.298340 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d9504-7615-4953-97b8-77e7771361aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:04.299939 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d9504-7615-4953-97b8-77e7771361aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:04.303002 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d9504-7615-4953-97b8-77e7771361aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:04.304900 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d9504-7615-4953-97b8-77e7771361aa admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:04.309827 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:04.310182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5631954-d0c9-4cf1-8876-e1a489280773 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:04.310404 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5631954-d0c9-4cf1-8876-e1a489280773 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:04.310747 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5631954-d0c9-4cf1-8876-e1a489280773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:04.325715 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 940/1888] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:34:04.327312 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d9504-7615-4953-97b8-77e7771361aa admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:04.332423 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:04.345424 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d9504-7615-4953-97b8-77e7771361aa admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:04.353439 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bfee5-e6a7-42dd-ae3d-74123b34fb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:04.354215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f5631954-d0c9-4cf1-8876-e1a489280773 None None] MFA Rules not processed for user `912693f459f147a5a479ad01e2e8387a`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:04.354550 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bfee5-e6a7-42dd-ae3d-74123b34fb8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:04.354977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bfee5-e6a7-42dd-ae3d-74123b34fb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:04.355412 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bfee5-e6a7-42dd-ae3d-74123b34fb8c admin admin] PATH_INFO: `/v3/projects/7233db76236e45889d328f122aa368cb/users/05ffd9610c2a449ebd8e91ae254d4dde/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:04.355537 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f5631954-d0c9-4cf1-8876-e1a489280773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:04.357846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bfee5-e6a7-42dd-ae3d-74123b34fb8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7233db76236e45889d328f122aa368cb, user_id=05ffd9610c2a449ebd8e91ae254d4dde, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:04.361874 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bfee5-e6a7-42dd-ae3d-74123b34fb8c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:04.377164 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 941/1889] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:34:04 2022] PUT /identity/v3/projects/7233db76236e45889d328f122aa368cb/users/05ffd9610c2a449ebd8e91ae254d4dde/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:04.389454 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9abef-f133-4573-b1e1-bf867ed19743 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:04.389895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9abef-f133-4573-b1e1-bf867ed19743 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:04.390433 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9abef-f133-4573-b1e1-bf867ed19743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:04.452204 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-56c9abef-f133-4573-b1e1-bf867ed19743 None None] MFA Rules not processed for user `05ffd9610c2a449ebd8e91ae254d4dde`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:04.460664 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-56c9abef-f133-4573-b1e1-bf867ed19743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:04.528849 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 949/1890] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 31 12:34:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:04.564754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5631954-d0c9-4cf1-8876-e1a489280773 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:04.566216 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f5631954-d0c9-4cf1-8876-e1a489280773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:04.597386 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 942/1891] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:34:04.607264 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9abef-f133-4573-b1e1-bf867ed19743 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:04.609083 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-56c9abef-f133-4573-b1e1-bf867ed19743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:04.715018 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5631954-d0c9-4cf1-8876-e1a489280773 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:04.718797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9abef-f133-4573-b1e1-bf867ed19743 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:04.719969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417ea99-7c22-423c-a668-789a97295a20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:04.721025 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417ea99-7c22-423c-a668-789a97295a20 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:04.721387 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417ea99-7c22-423c-a668-789a97295a20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:04.724573 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50dbf3e-e2ce-4f19-9aa8-6be1973ba2ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188c4989dcfb4f99a04c3349e1a882d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:04.725233 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dbf3e-e2ce-4f19-9aa8-6be1973ba2ef service swift] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:04.725517 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dbf3e-e2ce-4f19-9aa8-6be1973ba2ef service swift] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:04.725789 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dbf3e-e2ce-4f19-9aa8-6be1973ba2ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:04.729417 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417ea99-7c22-423c-a668-789a97295a20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:04.732240 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8417ea99-7c22-423c-a668-789a97295a20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:04.735777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50dbf3e-e2ce-4f19-9aa8-6be1973ba2ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:04.737522 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50dbf3e-e2ce-4f19-9aa8-6be1973ba2ef service swift] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:04.749947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 943/1892] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 31 12:34:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 12:34:04.750793 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50dbf3e-e2ce-4f19-9aa8-6be1973ba2ef service swift] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:04.752117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e50dbf3e-e2ce-4f19-9aa8-6be1973ba2ef service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:04.800673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50dbf3e-e2ce-4f19-9aa8-6be1973ba2ef service swift] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:04.812898 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef107501-cab5-4b97-9bde-a1ed48b858b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:04.813483 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef107501-cab5-4b97-9bde-a1ed48b858b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:04.813899 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef107501-cab5-4b97-9bde-a1ed48b858b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:04.814201 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef107501-cab5-4b97-9bde-a1ed48b858b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:04.835180 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef107501-cab5-4b97-9bde-a1ed48b858b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:04.838953 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef107501-cab5-4b97-9bde-a1ed48b858b4 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:04.857297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417ea99-7c22-423c-a668-789a97295a20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:04.858994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417ea99-7c22-423c-a668-789a97295a20 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:04.875435 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 950/1893] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:34:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:34:04.901270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 944/1894] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:34:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:34:06.383953 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417ea99-7c22-423c-a668-789a97295a20 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:06.397447 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417ea99-7c22-423c-a668-789a97295a20 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:06.409539 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4ab9d-2c3e-4a8e-8c3e-a10010e50a37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:06.410269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4ab9d-2c3e-4a8e-8c3e-a10010e50a37 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:06.410570 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4ab9d-2c3e-4a8e-8c3e-a10010e50a37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:06.410851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4ab9d-2c3e-4a8e-8c3e-a10010e50a37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:06.418709 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-43b4ab9d-2c3e-4a8e-8c3e-a10010e50a37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:06.518422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4ab9d-2c3e-4a8e-8c3e-a10010e50a37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:06.520028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4ab9d-2c3e-4a8e-8c3e-a10010e50a37 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:06.525678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:06.542004 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 951/1895] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:34:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:34:06.983181 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef107501-cab5-4b97-9bde-a1ed48b858b4 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:06.984632 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ef107501-cab5-4b97-9bde-a1ed48b858b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:07.113922 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:07.183757 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef107501-cab5-4b97-9bde-a1ed48b858b4 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:07.197798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f316cb3-660c-4af1-ab22-7a5155691517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:07.198469 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f316cb3-660c-4af1-ab22-7a5155691517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:07.202174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f316cb3-660c-4af1-ab22-7a5155691517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:07.202733 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f316cb3-660c-4af1-ab22-7a5155691517 admin admin] PATH_INFO: `/v3/users/ae356d73ebc044a3a9d1c8b0f2a97d33` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:07.205093 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f316cb3-660c-4af1-ab22-7a5155691517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae356d73ebc044a3a9d1c8b0f2a97d33)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:07.207414 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f316cb3-660c-4af1-ab22-7a5155691517 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:07.285442 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9f316cb3-660c-4af1-ab22-7a5155691517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae356d73ebc044a3a9d1c8b0f2a97d33'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:07.286390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9f316cb3-660c-4af1-ab22-7a5155691517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae356d73ebc044a3a9d1c8b0f2a97d33'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:07.287172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9f316cb3-660c-4af1-ab22-7a5155691517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae356d73ebc044a3a9d1c8b0f2a97d33'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:07.308173 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9f316cb3-660c-4af1-ab22-7a5155691517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae356d73ebc044a3a9d1c8b0f2a97d33'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:07.323150 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9f316cb3-660c-4af1-ab22-7a5155691517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae356d73ebc044a3a9d1c8b0f2a97d33'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:07.357388 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 945/1896] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:34:06 2022] DELETE /identity/v3/users/ae356d73ebc044a3a9d1c8b0f2a97d33 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:07.359939 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347019b-5342-4302-8d04-c7479c63e28f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:07.360230 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347019b-5342-4302-8d04-c7479c63e28f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:07.360510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347019b-5342-4302-8d04-c7479c63e28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:07.380458 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f347019b-5342-4302-8d04-c7479c63e28f None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:07.382139 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f347019b-5342-4302-8d04-c7479c63e28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:07.487546 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 952/1897] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:07.499933 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f316cb3-660c-4af1-ab22-7a5155691517 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:07.501385 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9f316cb3-660c-4af1-ab22-7a5155691517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:07.603746 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f316cb3-660c-4af1-ab22-7a5155691517 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:07.611101 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56a219-8225-46bc-a66e-30bcb7678bfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:07.611405 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56a219-8225-46bc-a66e-30bcb7678bfe service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:07.611789 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56a219-8225-46bc-a66e-30bcb7678bfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:07.612160 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56a219-8225-46bc-a66e-30bcb7678bfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:07.623715 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56a219-8225-46bc-a66e-30bcb7678bfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:07.625514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56a219-8225-46bc-a66e-30bcb7678bfe service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:07.656474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 946/1898] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:34:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:34:08.126288 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347019b-5342-4302-8d04-c7479c63e28f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:08.128784 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f347019b-5342-4302-8d04-c7479c63e28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:08.149795 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347019b-5342-4302-8d04-c7479c63e28f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:08.165789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5203ad-3035-4934-bcba-1b2d81502c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:08.166738 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5203ad-3035-4934-bcba-1b2d81502c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:08.167193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5203ad-3035-4934-bcba-1b2d81502c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:08.167623 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5203ad-3035-4934-bcba-1b2d81502c88 admin admin] PATH_INFO: `/v3/users/774f6323e89d46fda0901c7b6a6c3ccd` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:08.170268 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5203ad-3035-4934-bcba-1b2d81502c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=774f6323e89d46fda0901c7b6a6c3ccd)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:08.175482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5203ad-3035-4934-bcba-1b2d81502c88 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:08.287789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-de5203ad-3035-4934-bcba-1b2d81502c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '774f6323e89d46fda0901c7b6a6c3ccd'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:08.307662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-de5203ad-3035-4934-bcba-1b2d81502c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '774f6323e89d46fda0901c7b6a6c3ccd'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:08.308506 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-de5203ad-3035-4934-bcba-1b2d81502c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '774f6323e89d46fda0901c7b6a6c3ccd'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:08.331087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-de5203ad-3035-4934-bcba-1b2d81502c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '774f6323e89d46fda0901c7b6a6c3ccd'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:08.345796 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-de5203ad-3035-4934-bcba-1b2d81502c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '774f6323e89d46fda0901c7b6a6c3ccd'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:08.364781 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 953/1899] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:34:08 2022] DELETE /identity/v3/users/774f6323e89d46fda0901c7b6a6c3ccd => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:08.369709 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f9d4f-74db-49e7-aa53-8d28da3f06e1 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:08.370282 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f9d4f-74db-49e7-aa53-8d28da3f06e1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:08.370608 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f9d4f-74db-49e7-aa53-8d28da3f06e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:08.419625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-0b3f9d4f-74db-49e7-aa53-8d28da3f06e1 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:08.431850 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0b3f9d4f-74db-49e7-aa53-8d28da3f06e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:08.584767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 947/1900] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:08.620104 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5203ad-3035-4934-bcba-1b2d81502c88 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:08.628565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-de5203ad-3035-4934-bcba-1b2d81502c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:08.768781 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5203ad-3035-4934-bcba-1b2d81502c88 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:08.775046 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9ade1-837b-4c1f-a70a-ff2fe1b6cd36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:08.776479 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9ade1-837b-4c1f-a70a-ff2fe1b6cd36 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:08.776935 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9ade1-837b-4c1f-a70a-ff2fe1b6cd36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:08.777390 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9ade1-837b-4c1f-a70a-ff2fe1b6cd36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:08.796177 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9ade1-837b-4c1f-a70a-ff2fe1b6cd36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:08.798564 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9ade1-837b-4c1f-a70a-ff2fe1b6cd36 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:08.828371 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 954/1901] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:34:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:34:09.046991 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f9d4f-74db-49e7-aa53-8d28da3f06e1 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:09.049572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0b3f9d4f-74db-49e7-aa53-8d28da3f06e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:09.072979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f9d4f-74db-49e7-aa53-8d28da3f06e1 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:09.082546 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc158c7d-2693-4d83-9c65-0d50679c9505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:09.083274 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc158c7d-2693-4d83-9c65-0d50679c9505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:09.083624 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc158c7d-2693-4d83-9c65-0d50679c9505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:09.084293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc158c7d-2693-4d83-9c65-0d50679c9505 admin admin] PATH_INFO: `/v3/projects/0fd70951249e4a8f8907accbb110b7cd` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:09.088186 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc158c7d-2693-4d83-9c65-0d50679c9505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd70951249e4a8f8907accbb110b7cd)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:09.089204 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc158c7d-2693-4d83-9c65-0d50679c9505 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:09.091340 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:09.204453 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-cc158c7d-2693-4d83-9c65-0d50679c9505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd70951249e4a8f8907accbb110b7cd', 'request_id': 'req-cc158c7d-2693-4d83-9c65-0d50679c9505'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:09.212622 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-cc158c7d-2693-4d83-9c65-0d50679c9505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd70951249e4a8f8907accbb110b7cd', 'request_id': 'req-cc158c7d-2693-4d83-9c65-0d50679c9505'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:09.222440 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-cc158c7d-2693-4d83-9c65-0d50679c9505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd70951249e4a8f8907accbb110b7cd', 'request_id': 'req-cc158c7d-2693-4d83-9c65-0d50679c9505'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:09.255936 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-cc158c7d-2693-4d83-9c65-0d50679c9505 admin admin] The token cache is being invalidate because project 0fd70951249e4a8f8907accbb110b7cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:34:09.257379 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-cc158c7d-2693-4d83-9c65-0d50679c9505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:09.258240 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-cc158c7d-2693-4d83-9c65-0d50679c9505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:09.260249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 948/1902] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:34:09 2022] DELETE /identity/v3/projects/0fd70951249e4a8f8907accbb110b7cd => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:09.265066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610435a-4926-426a-92d6-06bde468a076 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:09.265523 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610435a-4926-426a-92d6-06bde468a076 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:09.266355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610435a-4926-426a-92d6-06bde468a076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:09.334502 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b610435a-4926-426a-92d6-06bde468a076 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:09.338067 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b610435a-4926-426a-92d6-06bde468a076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:09.367943 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:09.500292 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 955/1903] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:09.509898 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493fac7-9906-4244-a3fb-de3b824d6c1a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:09.510501 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493fac7-9906-4244-a3fb-de3b824d6c1a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:09.511597 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493fac7-9906-4244-a3fb-de3b824d6c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:09.538109 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-a493fac7-9906-4244-a3fb-de3b824d6c1a None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:09.539871 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a493fac7-9906-4244-a3fb-de3b824d6c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:09.578519 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 949/1904] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:09.582813 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610435a-4926-426a-92d6-06bde468a076 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:09.594995 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610435a-4926-426a-92d6-06bde468a076 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:09.601009 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493fac7-9906-4244-a3fb-de3b824d6c1a None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:09.602908 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a493fac7-9906-4244-a3fb-de3b824d6c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:09.615801 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb9e4b-1c81-4d31-bfc6-f56b4cd8f88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:09.616554 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb9e4b-1c81-4d31-bfc6-f56b4cd8f88f admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:09.629541 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb9e4b-1c81-4d31-bfc6-f56b4cd8f88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:09.629541 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb9e4b-1c81-4d31-bfc6-f56b4cd8f88f admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:09.629541 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb9e4b-1c81-4d31-bfc6-f56b4cd8f88f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:34:09.629541 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb9e4b-1c81-4d31-bfc6-f56b4cd8f88f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:09.629541 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb9e4b-1c81-4d31-bfc6-f56b4cd8f88f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:09.631199 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493fac7-9906-4244-a3fb-de3b824d6c1a None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:09.637070 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292f131-e806-46df-98ca-e70017e69a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:09.643221 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292f131-e806-46df-98ca-e70017e69a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:09.646181 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292f131-e806-46df-98ca-e70017e69a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:09.647505 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292f131-e806-46df-98ca-e70017e69a24 admin admin] PATH_INFO: `/v3/projects/fe0ed8f0296e48949ae16ca62f20dc59` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:09.652145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292f131-e806-46df-98ca-e70017e69a24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe0ed8f0296e48949ae16ca62f20dc59)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:09.656825 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292f131-e806-46df-98ca-e70017e69a24 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:09.658890 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 956/1905] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:34:09.660356 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb9e4b-1c81-4d31-bfc6-f56b4cd8f88f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:09.686941 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb9e4b-1c81-4d31-bfc6-f56b4cd8f88f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:09.699655 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f8d1c-8a2b-4ac8-a156-961c5173fff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:09.700395 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f8d1c-8a2b-4ac8-a156-961c5173fff1 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:09.701405 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f8d1c-8a2b-4ac8-a156-961c5173fff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:09.701952 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f8d1c-8a2b-4ac8-a156-961c5173fff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:09.703859 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f8d1c-8a2b-4ac8-a156-961c5173fff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:09.708651 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f8d1c-8a2b-4ac8-a156-961c5173fff1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:09.767873 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 957/1906] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:34:09 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:34:09.773506 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f8d1c-8a2b-4ac8-a156-961c5173fff1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:09.804206 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d292f131-e806-46df-98ca-e70017e69a24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe0ed8f0296e48949ae16ca62f20dc59', 'request_id': 'req-d292f131-e806-46df-98ca-e70017e69a24'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:09.830671 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d292f131-e806-46df-98ca-e70017e69a24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe0ed8f0296e48949ae16ca62f20dc59', 'request_id': 'req-d292f131-e806-46df-98ca-e70017e69a24'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:09.848813 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d292f131-e806-46df-98ca-e70017e69a24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe0ed8f0296e48949ae16ca62f20dc59', 'request_id': 'req-d292f131-e806-46df-98ca-e70017e69a24'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:09.884707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d292f131-e806-46df-98ca-e70017e69a24 admin admin] The token cache is being invalidate because project fe0ed8f0296e48949ae16ca62f20dc59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:34:09.885542 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d292f131-e806-46df-98ca-e70017e69a24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:09.887193 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d292f131-e806-46df-98ca-e70017e69a24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:09.908616 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 950/1907] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:34:09 2022] DELETE /identity/v3/projects/fe0ed8f0296e48949ae16ca62f20dc59 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:09.909689 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292f131-e806-46df-98ca-e70017e69a24 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:09.921229 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d292f131-e806-46df-98ca-e70017e69a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:09.940723 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f8d1c-8a2b-4ac8-a156-961c5173fff1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:09.979061 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f19db-1bfa-49f9-bcbc-65e6e33c601c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:09.979775 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f19db-1bfa-49f9-bcbc-65e6e33c601c admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:09.980052 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f19db-1bfa-49f9-bcbc-65e6e33c601c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:09.980269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f19db-1bfa-49f9-bcbc-65e6e33c601c admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:09.980917 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f19db-1bfa-49f9-bcbc-65e6e33c601c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:09.991977 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f19db-1bfa-49f9-bcbc-65e6e33c601c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:10.056019 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 958/1908] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:34:09 2022] POST /identity/v3/users => generated 283 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:34:10.059456 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f19db-1bfa-49f9-bcbc-65e6e33c601c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:10.069514 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2d1f19db-1bfa-49f9-bcbc-65e6e33c601c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:10.107265 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f19db-1bfa-49f9-bcbc-65e6e33c601c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:10.121687 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4906c8-3371-48f6-84de-628e04098418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:10.122329 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4906c8-3371-48f6-84de-628e04098418 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:10.122607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4906c8-3371-48f6-84de-628e04098418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:10.122873 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4906c8-3371-48f6-84de-628e04098418 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:10.123997 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4906c8-3371-48f6-84de-628e04098418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:10.128637 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4906c8-3371-48f6-84de-628e04098418 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:10.155761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 959/1909] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:34:10.161333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4906c8-3371-48f6-84de-628e04098418 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:10.162336 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292f131-e806-46df-98ca-e70017e69a24 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:10.176842 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17be41-ab40-4972-9d08-44b12a449844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:10.177776 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17be41-ab40-4972-9d08-44b12a449844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:10.178114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17be41-ab40-4972-9d08-44b12a449844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:10.179013 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17be41-ab40-4972-9d08-44b12a449844 admin admin] PATH_INFO: `/v3/users/05ffd9610c2a449ebd8e91ae254d4dde` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:10.182784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17be41-ab40-4972-9d08-44b12a449844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05ffd9610c2a449ebd8e91ae254d4dde)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:10.189632 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17be41-ab40-4972-9d08-44b12a449844 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:10.190761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4906c8-3371-48f6-84de-628e04098418 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:10.203266 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb94a31-9606-4763-b412-01e5859b4d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:10.204259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb94a31-9606-4763-b412-01e5859b4d41 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:10.204518 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb94a31-9606-4763-b412-01e5859b4d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:10.204800 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb94a31-9606-4763-b412-01e5859b4d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:10.205480 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb94a31-9606-4763-b412-01e5859b4d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:10.209304 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:10.210915 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb94a31-9606-4763-b412-01e5859b4d41 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:10.254619 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 960/1910] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:34:10.267424 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb94a31-9606-4763-b412-01e5859b4d41 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:10.298480 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb94a31-9606-4763-b412-01e5859b4d41 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:10.311422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe74b7b-07ce-4474-b584-59c596a8cfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:10.312660 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe74b7b-07ce-4474-b584-59c596a8cfdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:10.314923 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe74b7b-07ce-4474-b584-59c596a8cfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:10.315347 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe74b7b-07ce-4474-b584-59c596a8cfdc admin admin] PATH_INFO: `/v3/projects/deb1f5f557c14865be5860a51c0bcb49/users/9012843736f840a98b95c8f4fe72dfd2/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:10.336783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-eb17be41-ab40-4972-9d08-44b12a449844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05ffd9610c2a449ebd8e91ae254d4dde'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:10.337797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-eb17be41-ab40-4972-9d08-44b12a449844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05ffd9610c2a449ebd8e91ae254d4dde'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:10.338594 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe74b7b-07ce-4474-b584-59c596a8cfdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb1f5f557c14865be5860a51c0bcb49, user_id=9012843736f840a98b95c8f4fe72dfd2, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:10.338870 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-eb17be41-ab40-4972-9d08-44b12a449844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05ffd9610c2a449ebd8e91ae254d4dde'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:10.342580 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe74b7b-07ce-4474-b584-59c596a8cfdc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:10.350199 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-eb17be41-ab40-4972-9d08-44b12a449844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05ffd9610c2a449ebd8e91ae254d4dde'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:10.363049 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-eb17be41-ab40-4972-9d08-44b12a449844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05ffd9610c2a449ebd8e91ae254d4dde'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:10.366387 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 961/1911] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:34:10 2022] PUT /identity/v3/projects/deb1f5f557c14865be5860a51c0bcb49/users/9012843736f840a98b95c8f4fe72dfd2/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:10.378224 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2194b1b-0352-41cd-b611-1cf4343ac3a7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:10.378694 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2194b1b-0352-41cd-b611-1cf4343ac3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:10.379123 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2194b1b-0352-41cd-b611-1cf4343ac3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:10.397444 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 951/1912] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:34:09 2022] DELETE /identity/v3/users/05ffd9610c2a449ebd8e91ae254d4dde => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:10.424467 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d2194b1b-0352-41cd-b611-1cf4343ac3a7 None None] MFA Rules not processed for user `9012843736f840a98b95c8f4fe72dfd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:10.425878 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d2194b1b-0352-41cd-b611-1cf4343ac3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:10.436523 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:10.517428 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 962/1913] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:10.527168 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17be41-ab40-4972-9d08-44b12a449844 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:10.528825 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-eb17be41-ab40-4972-9d08-44b12a449844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:10.642484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17be41-ab40-4972-9d08-44b12a449844 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:10.647161 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74694f8a-a33f-413c-93a3-4abc250a5107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:10.647960 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74694f8a-a33f-413c-93a3-4abc250a5107 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:10.648421 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74694f8a-a33f-413c-93a3-4abc250a5107 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:10.649597 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74694f8a-a33f-413c-93a3-4abc250a5107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:10.662157 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74694f8a-a33f-413c-93a3-4abc250a5107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:10.665914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74694f8a-a33f-413c-93a3-4abc250a5107 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:10.678558 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 952/1914] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:34:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:34:10.794058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2194b1b-0352-41cd-b611-1cf4343ac3a7 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:10.796328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d2194b1b-0352-41cd-b611-1cf4343ac3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:11.008755 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2194b1b-0352-41cd-b611-1cf4343ac3a7 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:11.017651 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16ce24-132e-4fd9-9cd0-ad216771b80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:11.018758 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16ce24-132e-4fd9-9cd0-ad216771b80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:11.018758 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16ce24-132e-4fd9-9cd0-ad216771b80e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:11.018758 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16ce24-132e-4fd9-9cd0-ad216771b80e admin admin] PATH_INFO: `/v3/projects/7233db76236e45889d328f122aa368cb` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:11.020983 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16ce24-132e-4fd9-9cd0-ad216771b80e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7233db76236e45889d328f122aa368cb)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:11.025335 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16ce24-132e-4fd9-9cd0-ad216771b80e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:11.123462 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7d16ce24-132e-4fd9-9cd0-ad216771b80e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7233db76236e45889d328f122aa368cb', 'request_id': 'req-7d16ce24-132e-4fd9-9cd0-ad216771b80e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:11.153947 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7d16ce24-132e-4fd9-9cd0-ad216771b80e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7233db76236e45889d328f122aa368cb', 'request_id': 'req-7d16ce24-132e-4fd9-9cd0-ad216771b80e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:11.162726 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7d16ce24-132e-4fd9-9cd0-ad216771b80e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7233db76236e45889d328f122aa368cb', 'request_id': 'req-7d16ce24-132e-4fd9-9cd0-ad216771b80e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:11.181465 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7d16ce24-132e-4fd9-9cd0-ad216771b80e admin admin] The token cache is being invalidate because project 7233db76236e45889d328f122aa368cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:34:11.181759 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7d16ce24-132e-4fd9-9cd0-ad216771b80e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:11.182426 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7d16ce24-132e-4fd9-9cd0-ad216771b80e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:11.184355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 963/1915] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:34:10 2022] DELETE /identity/v3/projects/7233db76236e45889d328f122aa368cb => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:11.188924 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f7e47-0c5c-4a11-a1e9-a80dd47dbba9 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:11.189278 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f7e47-0c5c-4a11-a1e9-a80dd47dbba9 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:11.189558 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f7e47-0c5c-4a11-a1e9-a80dd47dbba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:11.212695 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-c35f7e47-0c5c-4a11-a1e9-a80dd47dbba9 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:11.214310 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c35f7e47-0c5c-4a11-a1e9-a80dd47dbba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:11.400038 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 953/1916] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:11.417835 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562b063-a3b8-4de4-bb24-df3409c3d023 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:11.418222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562b063-a3b8-4de4-bb24-df3409c3d023 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:11.418740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562b063-a3b8-4de4-bb24-df3409c3d023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:11.480480 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3562b063-a3b8-4de4-bb24-df3409c3d023 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:11.483263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3562b063-a3b8-4de4-bb24-df3409c3d023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:11.499093 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 964/1917] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:11.503139 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f7e47-0c5c-4a11-a1e9-a80dd47dbba9 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:11.518920 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f7e47-0c5c-4a11-a1e9-a80dd47dbba9 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:11.532920 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562b063-a3b8-4de4-bb24-df3409c3d023 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:11.535169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d10bcf-508a-46f4-9ee8-81c3c778f421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:11.536219 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d10bcf-508a-46f4-9ee8-81c3c778f421 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:11.536382 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3562b063-a3b8-4de4-bb24-df3409c3d023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:11.536511 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d10bcf-508a-46f4-9ee8-81c3c778f421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:11.536767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d10bcf-508a-46f4-9ee8-81c3c778f421 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:11.537462 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d10bcf-508a-46f4-9ee8-81c3c778f421 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:34:11.537816 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d10bcf-508a-46f4-9ee8-81c3c778f421 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:11.540857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d10bcf-508a-46f4-9ee8-81c3c778f421 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:11.561441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 954/1918] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:34:11.562210 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d10bcf-508a-46f4-9ee8-81c3c778f421 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:11.562908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562b063-a3b8-4de4-bb24-df3409c3d023 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:11.578099 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d10bcf-508a-46f4-9ee8-81c3c778f421 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:11.585798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63310125-12ff-4607-a37a-5516b5fd06e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:11.587932 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f39c7-c18a-4c95-9dbc-7f3abab147d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:11.588389 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63310125-12ff-4607-a37a-5516b5fd06e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:11.588598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f39c7-c18a-4c95-9dbc-7f3abab147d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:11.588884 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f39c7-c18a-4c95-9dbc-7f3abab147d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:11.589181 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f39c7-c18a-4c95-9dbc-7f3abab147d8 admin admin] PATH_INFO: `/v3/users/e6470cc842a44dbaa81c6ecfdadf2993` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:11.589386 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63310125-12ff-4607-a37a-5516b5fd06e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:11.589800 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63310125-12ff-4607-a37a-5516b5fd06e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:11.590628 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63310125-12ff-4607-a37a-5516b5fd06e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:11.593029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63310125-12ff-4607-a37a-5516b5fd06e2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:11.593182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f39c7-c18a-4c95-9dbc-7f3abab147d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6470cc842a44dbaa81c6ecfdadf2993)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:11.595278 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f39c7-c18a-4c95-9dbc-7f3abab147d8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:11.609840 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:11.650416 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 955/1919] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:34:11 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:34:11.654697 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63310125-12ff-4607-a37a-5516b5fd06e2 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:11.667657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:11.704874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-145f39c7-c18a-4c95-9dbc-7f3abab147d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6470cc842a44dbaa81c6ecfdadf2993'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:11.718074 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-145f39c7-c18a-4c95-9dbc-7f3abab147d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6470cc842a44dbaa81c6ecfdadf2993'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:11.718792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-145f39c7-c18a-4c95-9dbc-7f3abab147d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6470cc842a44dbaa81c6ecfdadf2993'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:11.736992 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-145f39c7-c18a-4c95-9dbc-7f3abab147d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6470cc842a44dbaa81c6ecfdadf2993'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:11.747180 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-145f39c7-c18a-4c95-9dbc-7f3abab147d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6470cc842a44dbaa81c6ecfdadf2993'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:11.759376 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 965/1920] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:34:11 2022] DELETE /identity/v3/users/e6470cc842a44dbaa81c6ecfdadf2993 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:11.761186 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a910c-1102-4044-b30f-d76a85f650e5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:11.761490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a910c-1102-4044-b30f-d76a85f650e5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:11.761834 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a910c-1102-4044-b30f-d76a85f650e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:11.771236 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63310125-12ff-4607-a37a-5516b5fd06e2 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:11.787158 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0f8a910c-1102-4044-b30f-d76a85f650e5 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:11.788814 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0f8a910c-1102-4044-b30f-d76a85f650e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:11.871612 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279534b1-84e4-4a33-af4a-082414517742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:11.872460 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279534b1-84e4-4a33-af4a-082414517742 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:11.872933 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279534b1-84e4-4a33-af4a-082414517742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:11.873302 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279534b1-84e4-4a33-af4a-082414517742 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:11.874085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279534b1-84e4-4a33-af4a-082414517742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:11.876202 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279534b1-84e4-4a33-af4a-082414517742 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:11.882679 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 966/1921] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:11.897789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a910c-1102-4044-b30f-d76a85f650e5 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:11.899852 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0f8a910c-1102-4044-b30f-d76a85f650e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:11.913161 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 956/1922] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:34:11 2022] POST /identity/v3/users => generated 290 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:34:11.918026 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279534b1-84e4-4a33-af4a-082414517742 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:11.920088 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-279534b1-84e4-4a33-af4a-082414517742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:11.940733 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279534b1-84e4-4a33-af4a-082414517742 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:11.955066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf1da7-7389-46fc-a63c-df9394e9deaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:11.955902 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf1da7-7389-46fc-a63c-df9394e9deaf admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:11.956249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf1da7-7389-46fc-a63c-df9394e9deaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:11.956527 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf1da7-7389-46fc-a63c-df9394e9deaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:11.957254 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf1da7-7389-46fc-a63c-df9394e9deaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:11.958861 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf1da7-7389-46fc-a63c-df9394e9deaf admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:11.970982 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 957/1923] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:34:11.975116 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf1da7-7389-46fc-a63c-df9394e9deaf admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:11.994936 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a910c-1102-4044-b30f-d76a85f650e5 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:11.999128 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf1da7-7389-46fc-a63c-df9394e9deaf admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:11.999438 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1d861-b43a-4da9-86e9-74908ad466b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:12.000316 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1d861-b43a-4da9-86e9-74908ad466b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:12.000838 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1d861-b43a-4da9-86e9-74908ad466b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:12.001383 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1d861-b43a-4da9-86e9-74908ad466b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:12.005099 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c837a33-2f20-4fd6-ac5c-86716e0a403b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:12.006578 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c837a33-2f20-4fd6-ac5c-86716e0a403b admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:12.006928 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c837a33-2f20-4fd6-ac5c-86716e0a403b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:12.007263 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c837a33-2f20-4fd6-ac5c-86716e0a403b admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:12.009037 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c837a33-2f20-4fd6-ac5c-86716e0a403b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:12.011527 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c837a33-2f20-4fd6-ac5c-86716e0a403b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:12.013919 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1d861-b43a-4da9-86e9-74908ad466b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:12.015408 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1d861-b43a-4da9-86e9-74908ad466b6 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:12.027131 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 967/1924] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:34:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:34:12.031367 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 958/1925] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:34:12.035457 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1d861-b43a-4da9-86e9-74908ad466b6 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:12.048671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1d861-b43a-4da9-86e9-74908ad466b6 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:12.053735 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08b195-fdda-4434-ab9a-99280b56f3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:12.055610 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08b195-fdda-4434-ab9a-99280b56f3ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:12.056015 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08b195-fdda-4434-ab9a-99280b56f3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:12.056459 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08b195-fdda-4434-ab9a-99280b56f3ad admin admin] PATH_INFO: `/v3/projects/a16a7b1a3cab4c048070fcb3099f6880/users/1ae174d69bf246329a4c2a5c8b83e2a7/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:12.073474 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08b195-fdda-4434-ab9a-99280b56f3ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16a7b1a3cab4c048070fcb3099f6880, user_id=1ae174d69bf246329a4c2a5c8b83e2a7, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:12.076351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08b195-fdda-4434-ab9a-99280b56f3ad admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:12.094055 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 968/1926] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:34:12 2022] PUT /identity/v3/projects/a16a7b1a3cab4c048070fcb3099f6880/users/1ae174d69bf246329a4c2a5c8b83e2a7/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:12.104403 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01035f7a-1575-4864-a8f0-458ee79f2d1f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:12.105023 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01035f7a-1575-4864-a8f0-458ee79f2d1f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:12.105358 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01035f7a-1575-4864-a8f0-458ee79f2d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:12.140465 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-01035f7a-1575-4864-a8f0-458ee79f2d1f None None] MFA Rules not processed for user `1ae174d69bf246329a4c2a5c8b83e2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:12.143622 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-01035f7a-1575-4864-a8f0-458ee79f2d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:12.229231 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:12.243959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 959/1927] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:12.245690 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08b195-fdda-4434-ab9a-99280b56f3ad admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:12.278635 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:12.323578 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08b195-fdda-4434-ab9a-99280b56f3ad admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:12.331556 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddc890-5cdc-400c-b2a2-66000552f437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:12.332407 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddc890-5cdc-400c-b2a2-66000552f437 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:12.332886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddc890-5cdc-400c-b2a2-66000552f437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:12.334291 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddc890-5cdc-400c-b2a2-66000552f437 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:12.335095 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddc890-5cdc-400c-b2a2-66000552f437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:12.337695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddc890-5cdc-400c-b2a2-66000552f437 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:12.386633 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 969/1928] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:34:12 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:34:12.388292 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01035f7a-1575-4864-a8f0-458ee79f2d1f None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:12.398940 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddc890-5cdc-400c-b2a2-66000552f437 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:12.401601 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c6ddc890-5cdc-400c-b2a2-66000552f437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:12.422699 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01035f7a-1575-4864-a8f0-458ee79f2d1f None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:12.513076 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfe8e3-97eb-4db3-b43c-2afa54980c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:12.514528 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfe8e3-97eb-4db3-b43c-2afa54980c04 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:12.514911 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfe8e3-97eb-4db3-b43c-2afa54980c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:12.515330 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfe8e3-97eb-4db3-b43c-2afa54980c04 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:12.518041 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfe8e3-97eb-4db3-b43c-2afa54980c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:12.520747 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfe8e3-97eb-4db3-b43c-2afa54980c04 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:12.551626 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddc890-5cdc-400c-b2a2-66000552f437 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:12.577156 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d04525-9497-4e7a-b82c-e33e9d63ccd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:12.579815 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d04525-9497-4e7a-b82c-e33e9d63ccd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:12.580259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d04525-9497-4e7a-b82c-e33e9d63ccd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:12.581433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d04525-9497-4e7a-b82c-e33e9d63ccd4 admin admin] PATH_INFO: `/v3/projects/413acfc0a64845958e93e751239ba503` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:12.584005 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 960/1929] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:34:12 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:34:12.584725 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d04525-9497-4e7a-b82c-e33e9d63ccd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=413acfc0a64845958e93e751239ba503)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:12.587566 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d04525-9497-4e7a-b82c-e33e9d63ccd4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:12.588766 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfe8e3-97eb-4db3-b43c-2afa54980c04 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:12.610139 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfe8e3-97eb-4db3-b43c-2afa54980c04 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:12.627891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8355c4-5aac-4c43-86ab-b04a74a2740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:12.628897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8355c4-5aac-4c43-86ab-b04a74a2740a admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:12.631716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8355c4-5aac-4c43-86ab-b04a74a2740a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:12.632112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8355c4-5aac-4c43-86ab-b04a74a2740a admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:12.632900 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8355c4-5aac-4c43-86ab-b04a74a2740a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:12.634674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8355c4-5aac-4c43-86ab-b04a74a2740a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:12.688260 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 961/1930] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:34:12.689438 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8355c4-5aac-4c43-86ab-b04a74a2740a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:12.695996 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b4d04525-9497-4e7a-b82c-e33e9d63ccd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '413acfc0a64845958e93e751239ba503', 'request_id': 'req-b4d04525-9497-4e7a-b82c-e33e9d63ccd4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:12.727936 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b4d04525-9497-4e7a-b82c-e33e9d63ccd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '413acfc0a64845958e93e751239ba503', 'request_id': 'req-b4d04525-9497-4e7a-b82c-e33e9d63ccd4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:12.736416 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b4d04525-9497-4e7a-b82c-e33e9d63ccd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '413acfc0a64845958e93e751239ba503', 'request_id': 'req-b4d04525-9497-4e7a-b82c-e33e9d63ccd4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:12.746943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8355c4-5aac-4c43-86ab-b04a74a2740a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:12.763783 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b4d04525-9497-4e7a-b82c-e33e9d63ccd4 admin admin] The token cache is being invalidate because project 413acfc0a64845958e93e751239ba503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:34:12.764148 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b4d04525-9497-4e7a-b82c-e33e9d63ccd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:12.765764 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b4d04525-9497-4e7a-b82c-e33e9d63ccd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:12.811698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 970/1931] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:34:12 2022] DELETE /identity/v3/projects/413acfc0a64845958e93e751239ba503 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:12.812871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d04525-9497-4e7a-b82c-e33e9d63ccd4 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:12.827131 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b4d04525-9497-4e7a-b82c-e33e9d63ccd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:12.931970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:12.956878 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d04525-9497-4e7a-b82c-e33e9d63ccd4 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:12.990803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31de06-b426-4e9c-95ee-b87b0da6cc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:12.990978 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f8e7b-76b4-4447-b736-b2aff67c110f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:12.991545 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f8e7b-76b4-4447-b736-b2aff67c110f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:12.991662 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31de06-b426-4e9c-95ee-b87b0da6cc87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:12.991829 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f8e7b-76b4-4447-b736-b2aff67c110f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:12.992035 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31de06-b426-4e9c-95ee-b87b0da6cc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:12.992140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f8e7b-76b4-4447-b736-b2aff67c110f admin admin] PATH_INFO: `/v3/users/0df3a6e52ae546c284dad41c786c7f9c` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:12.992480 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31de06-b426-4e9c-95ee-b87b0da6cc87 admin admin] PATH_INFO: `/v3/projects/a23bd001e3b04dadad2ba259d9a88f8b/users/6e9a27402e14461bbe2c368e1ce80997/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:13.002386 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f8e7b-76b4-4447-b736-b2aff67c110f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df3a6e52ae546c284dad41c786c7f9c)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:13.010064 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f8e7b-76b4-4447-b736-b2aff67c110f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:13.030397 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31de06-b426-4e9c-95ee-b87b0da6cc87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23bd001e3b04dadad2ba259d9a88f8b, user_id=6e9a27402e14461bbe2c368e1ce80997, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:13.033588 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31de06-b426-4e9c-95ee-b87b0da6cc87 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:13.076727 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 962/1932] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:34:12 2022] PUT /identity/v3/projects/a23bd001e3b04dadad2ba259d9a88f8b/users/6e9a27402e14461bbe2c368e1ce80997/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:13.080825 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31de06-b426-4e9c-95ee-b87b0da6cc87 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:13.084483 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2c31de06-b426-4e9c-95ee-b87b0da6cc87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:13.202793 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31de06-b426-4e9c-95ee-b87b0da6cc87 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:13.204838 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b91f8e7b-76b4-4447-b736-b2aff67c110f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df3a6e52ae546c284dad41c786c7f9c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:13.209607 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29b8f8-92b0-4360-bd15-aef2954871c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:13.210821 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29b8f8-92b0-4360-bd15-aef2954871c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:13.212074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29b8f8-92b0-4360-bd15-aef2954871c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:13.212663 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29b8f8-92b0-4360-bd15-aef2954871c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:13.213967 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29b8f8-92b0-4360-bd15-aef2954871c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:13.217089 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29b8f8-92b0-4360-bd15-aef2954871c7 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:13.218999 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b91f8e7b-76b4-4447-b736-b2aff67c110f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df3a6e52ae546c284dad41c786c7f9c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:13.220069 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b91f8e7b-76b4-4447-b736-b2aff67c110f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df3a6e52ae546c284dad41c786c7f9c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:13.220197 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:13.239988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 963/1933] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:34:13.241138 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29b8f8-92b0-4360-bd15-aef2954871c7 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:13.246047 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0a29b8f8-92b0-4360-bd15-aef2954871c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:13.249792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b91f8e7b-76b4-4447-b736-b2aff67c110f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df3a6e52ae546c284dad41c786c7f9c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:13.270246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b91f8e7b-76b4-4447-b736-b2aff67c110f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df3a6e52ae546c284dad41c786c7f9c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:13.272116 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29b8f8-92b0-4360-bd15-aef2954871c7 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:13.289452 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab32a7-96b2-4323-be0e-8817e2c94263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:13.291140 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab32a7-96b2-4323-be0e-8817e2c94263 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:13.292018 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab32a7-96b2-4323-be0e-8817e2c94263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:13.292162 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 971/1934] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:34:12 2022] DELETE /identity/v3/users/0df3a6e52ae546c284dad41c786c7f9c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:13.296094 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab32a7-96b2-4323-be0e-8817e2c94263 admin admin] PATH_INFO: `/v3/projects/a23bd001e3b04dadad2ba259d9a88f8b/users/6e9a27402e14461bbe2c368e1ce80997/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:13.300882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab32a7-96b2-4323-be0e-8817e2c94263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23bd001e3b04dadad2ba259d9a88f8b, user_id=6e9a27402e14461bbe2c368e1ce80997, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:13.306225 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab32a7-96b2-4323-be0e-8817e2c94263 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:13.336490 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 964/1935] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:34:13 2022] PUT /identity/v3/projects/a23bd001e3b04dadad2ba259d9a88f8b/users/6e9a27402e14461bbe2c368e1ce80997/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:13.338166 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821ee65-eb0c-4891-8be3-7952a71b83a7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:13.338421 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821ee65-eb0c-4891-8be3-7952a71b83a7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:13.338703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821ee65-eb0c-4891-8be3-7952a71b83a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:13.412254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a821ee65-eb0c-4891-8be3-7952a71b83a7 None None] MFA Rules not processed for user `6e9a27402e14461bbe2c368e1ce80997`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:13.414601 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a821ee65-eb0c-4891-8be3-7952a71b83a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:13.598448 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 972/1936] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:34:13.610559 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab32a7-96b2-4323-be0e-8817e2c94263 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:13.612299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-21ab32a7-96b2-4323-be0e-8817e2c94263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:13.765536 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab32a7-96b2-4323-be0e-8817e2c94263 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:13.776922 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286baec-0a55-4008-9f9d-cec940aa3256 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:13.777920 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286baec-0a55-4008-9f9d-cec940aa3256 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:13.778195 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286baec-0a55-4008-9f9d-cec940aa3256 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:13.779333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286baec-0a55-4008-9f9d-cec940aa3256 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:13.806111 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286baec-0a55-4008-9f9d-cec940aa3256 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:13.808272 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286baec-0a55-4008-9f9d-cec940aa3256 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:13.828359 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 965/1937] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:34:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:34:13.864466 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821ee65-eb0c-4891-8be3-7952a71b83a7 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:13.868080 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a821ee65-eb0c-4891-8be3-7952a71b83a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:13.976370 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:14.001072 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821ee65-eb0c-4891-8be3-7952a71b83a7 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:14.016682 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a5d5b-64ef-4e7c-9bd3-0e691aa68e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:14.017505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a5d5b-64ef-4e7c-9bd3-0e691aa68e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:14.017887 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a5d5b-64ef-4e7c-9bd3-0e691aa68e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:14.018266 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a5d5b-64ef-4e7c-9bd3-0e691aa68e75 admin admin] PATH_INFO: `/v3/projects/20b10d6ce0f843b1b3490c33683414ae` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:14.019554 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a5d5b-64ef-4e7c-9bd3-0e691aa68e75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b10d6ce0f843b1b3490c33683414ae)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:14.021871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a5d5b-64ef-4e7c-9bd3-0e691aa68e75 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:14.095912 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-807a5d5b-64ef-4e7c-9bd3-0e691aa68e75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b10d6ce0f843b1b3490c33683414ae', 'request_id': 'req-807a5d5b-64ef-4e7c-9bd3-0e691aa68e75'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:14.105150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-807a5d5b-64ef-4e7c-9bd3-0e691aa68e75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b10d6ce0f843b1b3490c33683414ae', 'request_id': 'req-807a5d5b-64ef-4e7c-9bd3-0e691aa68e75'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:14.115097 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-807a5d5b-64ef-4e7c-9bd3-0e691aa68e75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b10d6ce0f843b1b3490c33683414ae', 'request_id': 'req-807a5d5b-64ef-4e7c-9bd3-0e691aa68e75'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:14.128849 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-807a5d5b-64ef-4e7c-9bd3-0e691aa68e75 admin admin] The token cache is being invalidate because project 20b10d6ce0f843b1b3490c33683414ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:34:14.129523 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-807a5d5b-64ef-4e7c-9bd3-0e691aa68e75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:14.130611 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-807a5d5b-64ef-4e7c-9bd3-0e691aa68e75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:14.134169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 973/1938] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:34:13 2022] DELETE /identity/v3/projects/20b10d6ce0f843b1b3490c33683414ae => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:14.137032 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286baec-0a55-4008-9f9d-cec940aa3256 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:14.161992 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286baec-0a55-4008-9f9d-cec940aa3256 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:14.283964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc246981-f99f-44fb-bebc-64d6af725fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:14.290767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc246981-f99f-44fb-bebc-64d6af725fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:14.290767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc246981-f99f-44fb-bebc-64d6af725fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:14.290767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc246981-f99f-44fb-bebc-64d6af725fbe admin admin] PATH_INFO: `/v3/users/5de4ff239b064994828b72a50bcbcd0b` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:14.290767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc246981-f99f-44fb-bebc-64d6af725fbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de4ff239b064994828b72a50bcbcd0b)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:14.290767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc246981-f99f-44fb-bebc-64d6af725fbe admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:14.364568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a5d5b-64ef-4e7c-9bd3-0e691aa68e75 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:14.367282 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-807a5d5b-64ef-4e7c-9bd3-0e691aa68e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:14.377545 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-fc246981-f99f-44fb-bebc-64d6af725fbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de4ff239b064994828b72a50bcbcd0b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:14.378586 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-fc246981-f99f-44fb-bebc-64d6af725fbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de4ff239b064994828b72a50bcbcd0b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:14.379341 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-fc246981-f99f-44fb-bebc-64d6af725fbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de4ff239b064994828b72a50bcbcd0b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:14.393178 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-fc246981-f99f-44fb-bebc-64d6af725fbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de4ff239b064994828b72a50bcbcd0b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:14.404851 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-fc246981-f99f-44fb-bebc-64d6af725fbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de4ff239b064994828b72a50bcbcd0b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:14.432547 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 966/1939] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:34:14 2022] DELETE /identity/v3/users/5de4ff239b064994828b72a50bcbcd0b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:14.506009 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a5d5b-64ef-4e7c-9bd3-0e691aa68e75 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:14.598296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705dff5c-d9f0-4915-a572-916698414f51 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e9a27402e14461bbe2c368e1ce80997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a23bd001e3b04dadad2ba259d9a88f8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:14.599789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705dff5c-d9f0-4915-a572-916698414f51 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:14.600246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705dff5c-d9f0-4915-a572-916698414f51 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:14.600626 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705dff5c-d9f0-4915-a572-916698414f51 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:14.602619 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705dff5c-d9f0-4915-a572-916698414f51 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:34:14.603512 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705dff5c-d9f0-4915-a572-916698414f51 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:14.611332 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705dff5c-d9f0-4915-a572-916698414f51 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:14.630826 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 974/1940] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:34:14.634819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc246981-f99f-44fb-bebc-64d6af725fbe admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:14.637256 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-fc246981-f99f-44fb-bebc-64d6af725fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:14.670055 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc246981-f99f-44fb-bebc-64d6af725fbe admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:14.674063 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:14.675628 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a73ac-1ffc-4069-a368-9055ead1f0ba tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e9a27402e14461bbe2c368e1ce80997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a23bd001e3b04dadad2ba259d9a88f8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:14.676268 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a73ac-1ffc-4069-a368-9055ead1f0ba tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:14.676569 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a73ac-1ffc-4069-a368-9055ead1f0ba tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:14.676857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a73ac-1ffc-4069-a368-9055ead1f0ba tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:14.677598 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a73ac-1ffc-4069-a368-9055ead1f0ba tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:14.680925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a73ac-1ffc-4069-a368-9055ead1f0ba tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:14.741379 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 967/1941] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:34:14 2022] POST /identity/v3/projects => generated 354 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:34:14.744632 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705dff5c-d9f0-4915-a572-916698414f51 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:14.765726 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705dff5c-d9f0-4915-a572-916698414f51 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:14.796371 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:14.902408 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd15417-aef3-4130-88cf-36aa4dc2cf69 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e9a27402e14461bbe2c368e1ce80997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a23bd001e3b04dadad2ba259d9a88f8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:14.903306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd15417-aef3-4130-88cf-36aa4dc2cf69 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:14.903686 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd15417-aef3-4130-88cf-36aa4dc2cf69 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:14.904131 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd15417-aef3-4130-88cf-36aa4dc2cf69 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:14.904793 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd15417-aef3-4130-88cf-36aa4dc2cf69 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:34:14.905648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd15417-aef3-4130-88cf-36aa4dc2cf69 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:14.907942 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd15417-aef3-4130-88cf-36aa4dc2cf69 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:14.926181 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 975/1942] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:34:14.934745 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a73ac-1ffc-4069-a368-9055ead1f0ba tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:14.936726 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-496a73ac-1ffc-4069-a368-9055ead1f0ba tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:15.040488 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd15417-aef3-4130-88cf-36aa4dc2cf69 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:15.054454 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd15417-aef3-4130-88cf-36aa4dc2cf69 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:15.076779 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a73ac-1ffc-4069-a368-9055ead1f0ba tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:15.080200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120d09e-5528-4b3d-882d-252924f462b5 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e9a27402e14461bbe2c368e1ce80997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a23bd001e3b04dadad2ba259d9a88f8b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:15.080913 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120d09e-5528-4b3d-882d-252924f462b5 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:15.081305 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120d09e-5528-4b3d-882d-252924f462b5 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:15.081658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120d09e-5528-4b3d-882d-252924f462b5 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] PATH_INFO: `/v3/projects/96817753b5f1430b91773d7bb0a57d51` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:15.082940 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f37fd-ccf7-4aaf-8397-9db9c660bdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:15.083100 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120d09e-5528-4b3d-882d-252924f462b5 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] RBAC: Authorizing `identity:delete_project(project_id=96817753b5f1430b91773d7bb0a57d51)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:15.083604 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f37fd-ccf7-4aaf-8397-9db9c660bdcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:15.083961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f37fd-ccf7-4aaf-8397-9db9c660bdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:15.084234 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f37fd-ccf7-4aaf-8397-9db9c660bdcf admin admin] PATH_INFO: `/v3/projects/fdc53aae1ddd4c32abd4191dc0d6014d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:15.085471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f37fd-ccf7-4aaf-8397-9db9c660bdcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc53aae1ddd4c32abd4191dc0d6014d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:15.085685 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120d09e-5528-4b3d-882d-252924f462b5 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:15.088341 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f37fd-ccf7-4aaf-8397-9db9c660bdcf admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:15.178534 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d16f37fd-ccf7-4aaf-8397-9db9c660bdcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc53aae1ddd4c32abd4191dc0d6014d', 'request_id': 'req-d16f37fd-ccf7-4aaf-8397-9db9c660bdcf'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:15.179581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b120d09e-5528-4b3d-882d-252924f462b5 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96817753b5f1430b91773d7bb0a57d51', 'request_id': 'req-b120d09e-5528-4b3d-882d-252924f462b5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:15.190166 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d16f37fd-ccf7-4aaf-8397-9db9c660bdcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc53aae1ddd4c32abd4191dc0d6014d', 'request_id': 'req-d16f37fd-ccf7-4aaf-8397-9db9c660bdcf'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:15.198755 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b120d09e-5528-4b3d-882d-252924f462b5 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96817753b5f1430b91773d7bb0a57d51', 'request_id': 'req-b120d09e-5528-4b3d-882d-252924f462b5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:15.215669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d16f37fd-ccf7-4aaf-8397-9db9c660bdcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc53aae1ddd4c32abd4191dc0d6014d', 'request_id': 'req-d16f37fd-ccf7-4aaf-8397-9db9c660bdcf'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:15.224285 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b120d09e-5528-4b3d-882d-252924f462b5 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96817753b5f1430b91773d7bb0a57d51', 'request_id': 'req-b120d09e-5528-4b3d-882d-252924f462b5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:15.235814 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d16f37fd-ccf7-4aaf-8397-9db9c660bdcf admin admin] The token cache is being invalidate because project fdc53aae1ddd4c32abd4191dc0d6014d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:34:15.236123 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d16f37fd-ccf7-4aaf-8397-9db9c660bdcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:15.236775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-d16f37fd-ccf7-4aaf-8397-9db9c660bdcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:15.238812 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 968/1943] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:34:14 2022] DELETE /identity/v3/projects/fdc53aae1ddd4c32abd4191dc0d6014d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:15.241762 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b120d09e-5528-4b3d-882d-252924f462b5 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] The token cache is being invalidate because project 96817753b5f1430b91773d7bb0a57d51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:34:15.242066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b120d09e-5528-4b3d-882d-252924f462b5 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:15.242803 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b120d09e-5528-4b3d-882d-252924f462b5 tempest-VolumeQuotaClassesTest-1589884986 tempest-VolumeQuotaClassesTest-1589884986-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:15.246091 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 976/1944] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:34:15 2022] DELETE /identity/v3/projects/96817753b5f1430b91773d7bb0a57d51 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:34:15.568085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f37fd-ccf7-4aaf-8397-9db9c660bdcf admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:15.571797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d16f37fd-ccf7-4aaf-8397-9db9c660bdcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:15.699774 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f37fd-ccf7-4aaf-8397-9db9c660bdcf admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:15.754704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:15.836066 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190428d-d7b6-44a3-a789-425d994ca1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:15.836857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190428d-d7b6-44a3-a789-425d994ca1c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:15.837161 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190428d-d7b6-44a3-a789-425d994ca1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:15.837444 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190428d-d7b6-44a3-a789-425d994ca1c1 admin admin] PATH_INFO: `/v3/users/1ae174d69bf246329a4c2a5c8b83e2a7` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:15.838679 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190428d-d7b6-44a3-a789-425d994ca1c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ae174d69bf246329a4c2a5c8b83e2a7)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:15.840836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190428d-d7b6-44a3-a789-425d994ca1c1 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:15.921372 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8190428d-d7b6-44a3-a789-425d994ca1c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ae174d69bf246329a4c2a5c8b83e2a7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:15.922361 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8190428d-d7b6-44a3-a789-425d994ca1c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ae174d69bf246329a4c2a5c8b83e2a7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:15.923299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8190428d-d7b6-44a3-a789-425d994ca1c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ae174d69bf246329a4c2a5c8b83e2a7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:15.935209 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8190428d-d7b6-44a3-a789-425d994ca1c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ae174d69bf246329a4c2a5c8b83e2a7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:15.946688 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8190428d-d7b6-44a3-a789-425d994ca1c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ae174d69bf246329a4c2a5c8b83e2a7'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:15.971072 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 969/1945] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:34:15 2022] DELETE /identity/v3/users/1ae174d69bf246329a4c2a5c8b83e2a7 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:15.977786 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716220a8-a63a-41b3-81ae-832e7ca23742 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:15.978131 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716220a8-a63a-41b3-81ae-832e7ca23742 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:15.978631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716220a8-a63a-41b3-81ae-832e7ca23742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:16.007791 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-716220a8-a63a-41b3-81ae-832e7ca23742 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:16.009073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-716220a8-a63a-41b3-81ae-832e7ca23742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:16.121306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 977/1946] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:16.127129 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190428d-d7b6-44a3-a789-425d994ca1c1 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:16.128996 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8190428d-d7b6-44a3-a789-425d994ca1c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:16.274058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190428d-d7b6-44a3-a789-425d994ca1c1 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:16.299378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6774b8-604e-4e4b-a948-bae44f901ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:16.302591 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6774b8-604e-4e4b-a948-bae44f901ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:16.303164 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6774b8-604e-4e4b-a948-bae44f901ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:16.303828 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6774b8-604e-4e4b-a948-bae44f901ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:16.315903 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6774b8-604e-4e4b-a948-bae44f901ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:16.318062 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6774b8-604e-4e4b-a948-bae44f901ad9 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:16.340774 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 970/1947] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:34:16.718590 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716220a8-a63a-41b3-81ae-832e7ca23742 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:16.720063 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-716220a8-a63a-41b3-81ae-832e7ca23742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:16.744995 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716220a8-a63a-41b3-81ae-832e7ca23742 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:16.753432 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f08cad-da3d-43b9-9c4a-c2562f3fae76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:16.754536 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f08cad-da3d-43b9-9c4a-c2562f3fae76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:16.755146 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f08cad-da3d-43b9-9c4a-c2562f3fae76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:16.755598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f08cad-da3d-43b9-9c4a-c2562f3fae76 admin admin] PATH_INFO: `/v3/projects/a16a7b1a3cab4c048070fcb3099f6880` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:16.758740 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f08cad-da3d-43b9-9c4a-c2562f3fae76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a16a7b1a3cab4c048070fcb3099f6880)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:16.761318 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f08cad-da3d-43b9-9c4a-c2562f3fae76 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:16.831729 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:16.882354 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b3f08cad-da3d-43b9-9c4a-c2562f3fae76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a16a7b1a3cab4c048070fcb3099f6880', 'request_id': 'req-b3f08cad-da3d-43b9-9c4a-c2562f3fae76'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:16.913705 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b3f08cad-da3d-43b9-9c4a-c2562f3fae76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a16a7b1a3cab4c048070fcb3099f6880', 'request_id': 'req-b3f08cad-da3d-43b9-9c4a-c2562f3fae76'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:16.924926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b3f08cad-da3d-43b9-9c4a-c2562f3fae76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a16a7b1a3cab4c048070fcb3099f6880', 'request_id': 'req-b3f08cad-da3d-43b9-9c4a-c2562f3fae76'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:16.968586 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b3f08cad-da3d-43b9-9c4a-c2562f3fae76 admin admin] The token cache is being invalidate because project a16a7b1a3cab4c048070fcb3099f6880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:34:16.973020 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b3f08cad-da3d-43b9-9c4a-c2562f3fae76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:16.973840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b3f08cad-da3d-43b9-9c4a-c2562f3fae76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:16.975985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 978/1948] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:34:16 2022] DELETE /identity/v3/projects/a16a7b1a3cab4c048070fcb3099f6880 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:16.980907 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6774b8-604e-4e4b-a948-bae44f901ad9 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:17.009742 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6774b8-604e-4e4b-a948-bae44f901ad9 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:17.066886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:17.098615 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c8eb8-ab38-47c2-ac6c-8d17b383e08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:17.099604 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c8eb8-ab38-47c2-ac6c-8d17b383e08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:17.102973 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c8eb8-ab38-47c2-ac6c-8d17b383e08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:17.103279 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c8eb8-ab38-47c2-ac6c-8d17b383e08b admin admin] PATH_INFO: `/v3/users/6e9a27402e14461bbe2c368e1ce80997` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:17.105889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c8eb8-ab38-47c2-ac6c-8d17b383e08b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e9a27402e14461bbe2c368e1ce80997)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:17.108367 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c8eb8-ab38-47c2-ac6c-8d17b383e08b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:17.184672 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e98c8eb8-ab38-47c2-ac6c-8d17b383e08b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e9a27402e14461bbe2c368e1ce80997'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:17.185476 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e98c8eb8-ab38-47c2-ac6c-8d17b383e08b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e9a27402e14461bbe2c368e1ce80997'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:17.186228 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e98c8eb8-ab38-47c2-ac6c-8d17b383e08b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e9a27402e14461bbe2c368e1ce80997'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:17.198064 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e98c8eb8-ab38-47c2-ac6c-8d17b383e08b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e9a27402e14461bbe2c368e1ce80997'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:17.224260 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e98c8eb8-ab38-47c2-ac6c-8d17b383e08b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e9a27402e14461bbe2c368e1ce80997'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:17.247924 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 971/1949] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:34:16 2022] DELETE /identity/v3/users/6e9a27402e14461bbe2c368e1ce80997 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:17.647524 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f08cad-da3d-43b9-9c4a-c2562f3fae76 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:17.649522 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b3f08cad-da3d-43b9-9c4a-c2562f3fae76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:17.698616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f08cad-da3d-43b9-9c4a-c2562f3fae76 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:17.852613 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87452101-2a24-4087-bff2-59e84a298d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:17.853692 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87452101-2a24-4087-bff2-59e84a298d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:17.854003 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87452101-2a24-4087-bff2-59e84a298d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:17.854300 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87452101-2a24-4087-bff2-59e84a298d64 admin admin] PATH_INFO: `/v3/projects/a23bd001e3b04dadad2ba259d9a88f8b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:17.856251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87452101-2a24-4087-bff2-59e84a298d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a23bd001e3b04dadad2ba259d9a88f8b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:17.861965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87452101-2a24-4087-bff2-59e84a298d64 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:17.953671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-87452101-2a24-4087-bff2-59e84a298d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a23bd001e3b04dadad2ba259d9a88f8b', 'request_id': 'req-87452101-2a24-4087-bff2-59e84a298d64'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:17.977390 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-87452101-2a24-4087-bff2-59e84a298d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a23bd001e3b04dadad2ba259d9a88f8b', 'request_id': 'req-87452101-2a24-4087-bff2-59e84a298d64'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:17.991210 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-87452101-2a24-4087-bff2-59e84a298d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a23bd001e3b04dadad2ba259d9a88f8b', 'request_id': 'req-87452101-2a24-4087-bff2-59e84a298d64'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:18.019495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-87452101-2a24-4087-bff2-59e84a298d64 admin admin] The token cache is being invalidate because project a23bd001e3b04dadad2ba259d9a88f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:34:18.022752 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-87452101-2a24-4087-bff2-59e84a298d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:18.025351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-87452101-2a24-4087-bff2-59e84a298d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:18.029579 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 979/1950] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:34:17 2022] DELETE /identity/v3/projects/a23bd001e3b04dadad2ba259d9a88f8b => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:34:18.047736 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc105809-79f9-4ea8-8560-edc0adaadb42 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:18.048330 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc105809-79f9-4ea8-8560-edc0adaadb42 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:18.048330 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc105809-79f9-4ea8-8560-edc0adaadb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:18.109477 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-bc105809-79f9-4ea8-8560-edc0adaadb42 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:18.114788 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-bc105809-79f9-4ea8-8560-edc0adaadb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:18.329275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 972/1951] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:18.336952 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb503a-0414-4ce5-85ee-0e1592e872ea None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:18.337353 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb503a-0414-4ce5-85ee-0e1592e872ea None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:18.337636 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb503a-0414-4ce5-85ee-0e1592e872ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:18.365752 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5bdb503a-0414-4ce5-85ee-0e1592e872ea None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:18.367008 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5bdb503a-0414-4ce5-85ee-0e1592e872ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:18.377154 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 980/1952] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:18.381196 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc105809-79f9-4ea8-8560-edc0adaadb42 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:18.392227 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc105809-79f9-4ea8-8560-edc0adaadb42 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:18.398560 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c565ac6-65f4-4fc8-81ea-2d25be4738ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:18.400643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c565ac6-65f4-4fc8-81ea-2d25be4738ba admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:18.403994 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c565ac6-65f4-4fc8-81ea-2d25be4738ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:18.404348 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c565ac6-65f4-4fc8-81ea-2d25be4738ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:18.405329 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c565ac6-65f4-4fc8-81ea-2d25be4738ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:34:18.405866 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c565ac6-65f4-4fc8-81ea-2d25be4738ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:18.407944 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c565ac6-65f4-4fc8-81ea-2d25be4738ba admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:18.425249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 973/1953] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:34:18.429363 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb503a-0414-4ce5-85ee-0e1592e872ea None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:18.442009 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb503a-0414-4ce5-85ee-0e1592e872ea None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:18.448233 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771dd14-defd-49e4-be2c-a225825ffa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:18.450704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771dd14-defd-49e4-be2c-a225825ffa82 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:18.450704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771dd14-defd-49e4-be2c-a225825ffa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:18.450704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771dd14-defd-49e4-be2c-a225825ffa82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:18.451208 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771dd14-defd-49e4-be2c-a225825ffa82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:18.453680 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771dd14-defd-49e4-be2c-a225825ffa82 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:18.502023 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 981/1954] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:34:18 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:34:18.506457 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c565ac6-65f4-4fc8-81ea-2d25be4738ba admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:18.517953 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c565ac6-65f4-4fc8-81ea-2d25be4738ba admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:18.596207 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:18.620636 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75330f1c-e861-4e96-9338-a0a900e06e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:18.622212 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75330f1c-e861-4e96-9338-a0a900e06e84 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:18.622988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75330f1c-e861-4e96-9338-a0a900e06e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:18.624667 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75330f1c-e861-4e96-9338-a0a900e06e84 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:18.625530 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75330f1c-e861-4e96-9338-a0a900e06e84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:18.627620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75330f1c-e861-4e96-9338-a0a900e06e84 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:18.656786 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 974/1955] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:34:18 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:34:18.661205 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771dd14-defd-49e4-be2c-a225825ffa82 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:18.676966 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771dd14-defd-49e4-be2c-a225825ffa82 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:18.685715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a288f-6afa-4de6-8178-0ca86fe3009b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:18.686585 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a288f-6afa-4de6-8178-0ca86fe3009b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:18.687014 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a288f-6afa-4de6-8178-0ca86fe3009b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:18.687461 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a288f-6afa-4de6-8178-0ca86fe3009b admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:18.688272 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a288f-6afa-4de6-8178-0ca86fe3009b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:18.690076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a288f-6afa-4de6-8178-0ca86fe3009b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:18.702369 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 982/1956] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:34:18.707603 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75330f1c-e861-4e96-9338-a0a900e06e84 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:18.724845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75330f1c-e861-4e96-9338-a0a900e06e84 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:18.730836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d36ccb-3634-43cd-85af-3579c4dd125e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:18.732356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d36ccb-3634-43cd-85af-3579c4dd125e admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:18.732794 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d36ccb-3634-43cd-85af-3579c4dd125e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:18.733305 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d36ccb-3634-43cd-85af-3579c4dd125e admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:18.734376 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d36ccb-3634-43cd-85af-3579c4dd125e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:18.736309 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d36ccb-3634-43cd-85af-3579c4dd125e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:18.748956 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 975/1957] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:34:18.753251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a288f-6afa-4de6-8178-0ca86fe3009b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:18.767669 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a288f-6afa-4de6-8178-0ca86fe3009b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:18.775685 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b873c8-7977-46b5-99c0-76ca3eea117c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:18.776501 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b873c8-7977-46b5-99c0-76ca3eea117c admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:18.776790 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b873c8-7977-46b5-99c0-76ca3eea117c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:18.777068 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b873c8-7977-46b5-99c0-76ca3eea117c admin admin] PATH_INFO: `/v3/projects/96deb45cb5b0459f90325d8384c9a6cf/users/0169761b49644fe292e5a4f1c8e955ce/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:18.781459 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:18.803984 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b873c8-7977-46b5-99c0-76ca3eea117c admin admin] RBAC: Authorizing `identity:create_grant(project_id=96deb45cb5b0459f90325d8384c9a6cf, user_id=0169761b49644fe292e5a4f1c8e955ce, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:18.825412 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b873c8-7977-46b5-99c0-76ca3eea117c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:18.870499 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 983/1958] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:34:18 2022] PUT /identity/v3/projects/96deb45cb5b0459f90325d8384c9a6cf/users/0169761b49644fe292e5a4f1c8e955ce/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:18.887029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af0d17-3cb0-4db9-98f6-4e72c3c26f10 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:18.887609 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af0d17-3cb0-4db9-98f6-4e72c3c26f10 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:18.888165 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af0d17-3cb0-4db9-98f6-4e72c3c26f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:18.935092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-61af0d17-3cb0-4db9-98f6-4e72c3c26f10 None None] MFA Rules not processed for user `0169761b49644fe292e5a4f1c8e955ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:18.938212 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-61af0d17-3cb0-4db9-98f6-4e72c3c26f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:19.060127 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 976/1959] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:19.064803 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b873c8-7977-46b5-99c0-76ca3eea117c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:19.168993 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b873c8-7977-46b5-99c0-76ca3eea117c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:19.178859 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4182e23-99ea-4fb6-94b0-3faf0609635b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:19.179660 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4182e23-99ea-4fb6-94b0-3faf0609635b admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:19.180070 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4182e23-99ea-4fb6-94b0-3faf0609635b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:19.180667 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4182e23-99ea-4fb6-94b0-3faf0609635b admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:19.181998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4182e23-99ea-4fb6-94b0-3faf0609635b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:19.184862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4182e23-99ea-4fb6-94b0-3faf0609635b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:19.225446 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 984/1960] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:34:19 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:34:19.228889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af0d17-3cb0-4db9-98f6-4e72c3c26f10 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:19.253152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af0d17-3cb0-4db9-98f6-4e72c3c26f10 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:19.347857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d840c61-3f8b-48ff-9b00-355ed62c7a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:19.348495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d840c61-3f8b-48ff-9b00-355ed62c7a85 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:19.348799 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d840c61-3f8b-48ff-9b00-355ed62c7a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:19.349686 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d840c61-3f8b-48ff-9b00-355ed62c7a85 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:19.350669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d840c61-3f8b-48ff-9b00-355ed62c7a85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:19.352691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d840c61-3f8b-48ff-9b00-355ed62c7a85 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:19.389570 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 977/1961] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:34:19 2022] POST /identity/v3/users => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:34:19.393820 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4182e23-99ea-4fb6-94b0-3faf0609635b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:19.408906 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4182e23-99ea-4fb6-94b0-3faf0609635b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:19.423272 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be06b7-2597-46de-b94d-2443d5e40db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:19.424066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be06b7-2597-46de-b94d-2443d5e40db8 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:19.425093 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be06b7-2597-46de-b94d-2443d5e40db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:19.425375 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be06b7-2597-46de-b94d-2443d5e40db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:19.426045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be06b7-2597-46de-b94d-2443d5e40db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:19.427777 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be06b7-2597-46de-b94d-2443d5e40db8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:19.446000 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 985/1962] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:34:19.447193 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d840c61-3f8b-48ff-9b00-355ed62c7a85 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:19.468272 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d840c61-3f8b-48ff-9b00-355ed62c7a85 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:19.474989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a73c8e-eeb8-4c57-be69-faf1ec58762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:19.476017 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a73c8e-eeb8-4c57-be69-faf1ec58762e admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:19.476499 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a73c8e-eeb8-4c57-be69-faf1ec58762e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:19.476948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a73c8e-eeb8-4c57-be69-faf1ec58762e admin admin] PATH_INFO: `/v3/projects/0c48d24420884b6ca4157e1b3f5e7dfb/users/c1efd18b6649438c8bfaf7e9c8f16306/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:19.496153 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a73c8e-eeb8-4c57-be69-faf1ec58762e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c48d24420884b6ca4157e1b3f5e7dfb, user_id=c1efd18b6649438c8bfaf7e9c8f16306, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:19.499740 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a73c8e-eeb8-4c57-be69-faf1ec58762e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:19.533253 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 978/1963] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:34:19 2022] PUT /identity/v3/projects/0c48d24420884b6ca4157e1b3f5e7dfb/users/c1efd18b6649438c8bfaf7e9c8f16306/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:19.534512 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be06b7-2597-46de-b94d-2443d5e40db8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:19.545681 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be06b7-2597-46de-b94d-2443d5e40db8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:19.683278 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1922ddf-3e43-4b85-a3dc-bacd8e208cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:19.685473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1922ddf-3e43-4b85-a3dc-bacd8e208cdb admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:19.685828 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1922ddf-3e43-4b85-a3dc-bacd8e208cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:19.686179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1922ddf-3e43-4b85-a3dc-bacd8e208cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:19.686918 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1922ddf-3e43-4b85-a3dc-bacd8e208cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:19.688592 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1922ddf-3e43-4b85-a3dc-bacd8e208cdb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:19.703940 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 986/1964] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:34:19.713002 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a73c8e-eeb8-4c57-be69-faf1ec58762e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:19.729392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a73c8e-eeb8-4c57-be69-faf1ec58762e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:19.738703 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce27c59-7082-4d7e-97ae-bdbc5d15be7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:19.739467 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce27c59-7082-4d7e-97ae-bdbc5d15be7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:19.739821 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce27c59-7082-4d7e-97ae-bdbc5d15be7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:19.740654 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce27c59-7082-4d7e-97ae-bdbc5d15be7d admin admin] PATH_INFO: `/v3/projects/0c48d24420884b6ca4157e1b3f5e7dfb/users/c1efd18b6649438c8bfaf7e9c8f16306/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:19.744147 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce27c59-7082-4d7e-97ae-bdbc5d15be7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c48d24420884b6ca4157e1b3f5e7dfb, user_id=c1efd18b6649438c8bfaf7e9c8f16306, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:19.750957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce27c59-7082-4d7e-97ae-bdbc5d15be7d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:19.862378 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb14cef-88ff-4610-b868-13f1cd31b46b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:19.862378 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb14cef-88ff-4610-b868-13f1cd31b46b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:19.862378 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb14cef-88ff-4610-b868-13f1cd31b46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:19.872477 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 979/1965] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:34:19 2022] PUT /identity/v3/projects/0c48d24420884b6ca4157e1b3f5e7dfb/users/c1efd18b6649438c8bfaf7e9c8f16306/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:34:19.890302 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a9dc7-de44-4622-b32e-a639ac31770c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:19.890710 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a9dc7-de44-4622-b32e-a639ac31770c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:19.891069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a9dc7-de44-4622-b32e-a639ac31770c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:19.967397 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:20.012189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-cbb14cef-88ff-4610-b868-13f1cd31b46b None None] MFA Rules not processed for user `459bb7dfc62346c8b2081de02ccb12df`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:20.013497 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cbb14cef-88ff-4610-b868-13f1cd31b46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:20.026131 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-6a0a9dc7-de44-4622-b32e-a639ac31770c None None] MFA Rules not processed for user `c1efd18b6649438c8bfaf7e9c8f16306`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:20.028712 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6a0a9dc7-de44-4622-b32e-a639ac31770c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:20.105166 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:20.113793 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 987/1966] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:20.178709 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 980/1967] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:20.195353 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb14cef-88ff-4610-b868-13f1cd31b46b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:20.197550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cbb14cef-88ff-4610-b868-13f1cd31b46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:20.268796 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb14cef-88ff-4610-b868-13f1cd31b46b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:20.272623 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89000f5-ed74-45c4-8d79-0600bef7fe8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:20.273366 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89000f5-ed74-45c4-8d79-0600bef7fe8c service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:20.273759 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89000f5-ed74-45c4-8d79-0600bef7fe8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:20.274112 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89000f5-ed74-45c4-8d79-0600bef7fe8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:20.287238 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89000f5-ed74-45c4-8d79-0600bef7fe8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:20.288789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89000f5-ed74-45c4-8d79-0600bef7fe8c service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:20.300791 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 988/1968] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:34:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:34:20.392630 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a9dc7-de44-4622-b32e-a639ac31770c None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:20.404557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a9dc7-de44-4622-b32e-a639ac31770c None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:20.409101 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73c890-44d8-46f9-8899-d0b69f38b875 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:20.409743 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73c890-44d8-46f9-8899-d0b69f38b875 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:20.410027 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73c890-44d8-46f9-8899-d0b69f38b875 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:20.410391 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73c890-44d8-46f9-8899-d0b69f38b875 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:20.491433 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73c890-44d8-46f9-8899-d0b69f38b875 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:20.492939 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73c890-44d8-46f9-8899-d0b69f38b875 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:20.505206 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 981/1969] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:34:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:34:20.847397 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89000f5-ed74-45c4-8d79-0600bef7fe8c service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:20.935817 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89000f5-ed74-45c4-8d79-0600bef7fe8c service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:20.940556 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2fb6d-a170-4bbe-a742-2d8f12fb4c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:20.941229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2fb6d-a170-4bbe-a742-2d8f12fb4c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:20.941515 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2fb6d-a170-4bbe-a742-2d8f12fb4c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:20.941822 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2fb6d-a170-4bbe-a742-2d8f12fb4c56 admin admin] PATH_INFO: `/v3/users/0169761b49644fe292e5a4f1c8e955ce` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:20.942935 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2fb6d-a170-4bbe-a742-2d8f12fb4c56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0169761b49644fe292e5a4f1c8e955ce)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:20.944854 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2fb6d-a170-4bbe-a742-2d8f12fb4c56 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:21.027680 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9bc2fb6d-a170-4bbe-a742-2d8f12fb4c56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0169761b49644fe292e5a4f1c8e955ce'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:21.037941 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9bc2fb6d-a170-4bbe-a742-2d8f12fb4c56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0169761b49644fe292e5a4f1c8e955ce'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:21.040262 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9bc2fb6d-a170-4bbe-a742-2d8f12fb4c56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0169761b49644fe292e5a4f1c8e955ce'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:21.054781 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9bc2fb6d-a170-4bbe-a742-2d8f12fb4c56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0169761b49644fe292e5a4f1c8e955ce'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:21.074412 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9bc2fb6d-a170-4bbe-a742-2d8f12fb4c56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0169761b49644fe292e5a4f1c8e955ce'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:21.096128 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 989/1970] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:34:20 2022] DELETE /identity/v3/users/0169761b49644fe292e5a4f1c8e955ce => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:21.098377 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa920f0-7103-4d98-9541-cc11a2380e10 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:21.098712 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa920f0-7103-4d98-9541-cc11a2380e10 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:21.099119 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa920f0-7103-4d98-9541-cc11a2380e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:21.139810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-dfa920f0-7103-4d98-9541-cc11a2380e10 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:21.141281 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-dfa920f0-7103-4d98-9541-cc11a2380e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:21.276152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 982/1971] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:21.286290 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2fb6d-a170-4bbe-a742-2d8f12fb4c56 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:21.289793 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9bc2fb6d-a170-4bbe-a742-2d8f12fb4c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:21.324383 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:21.369024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2fb6d-a170-4bbe-a742-2d8f12fb4c56 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:21.373325 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9083f6-70f1-4645-a4e7-bf88168e5add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:21.374325 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9083f6-70f1-4645-a4e7-bf88168e5add service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:21.374325 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9083f6-70f1-4645-a4e7-bf88168e5add service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:21.374543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9083f6-70f1-4645-a4e7-bf88168e5add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:21.386269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9083f6-70f1-4645-a4e7-bf88168e5add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:21.387703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9083f6-70f1-4645-a4e7-bf88168e5add service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:21.398270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 990/1972] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:34:21.854225 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa920f0-7103-4d98-9541-cc11a2380e10 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:21.855951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-dfa920f0-7103-4d98-9541-cc11a2380e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:21.869568 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa920f0-7103-4d98-9541-cc11a2380e10 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:21.884410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3f5a8-0a73-4e77-bd9c-07a4f38be353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:21.885827 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3f5a8-0a73-4e77-bd9c-07a4f38be353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:21.886252 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3f5a8-0a73-4e77-bd9c-07a4f38be353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:21.886830 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3f5a8-0a73-4e77-bd9c-07a4f38be353 admin admin] PATH_INFO: `/v3/projects/96deb45cb5b0459f90325d8384c9a6cf` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:21.888197 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3f5a8-0a73-4e77-bd9c-07a4f38be353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96deb45cb5b0459f90325d8384c9a6cf)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:21.891080 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3f5a8-0a73-4e77-bd9c-07a4f38be353 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:21.942941 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:21.960090 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca3218-fdb5-4a49-b6d5-439607bf6775 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:21.960621 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca3218-fdb5-4a49-b6d5-439607bf6775 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:21.960621 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca3218-fdb5-4a49-b6d5-439607bf6775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:21.977655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-35a3f5a8-0a73-4e77-bd9c-07a4f38be353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96deb45cb5b0459f90325d8384c9a6cf', 'request_id': 'req-35a3f5a8-0a73-4e77-bd9c-07a4f38be353'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:21.985871 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-35a3f5a8-0a73-4e77-bd9c-07a4f38be353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96deb45cb5b0459f90325d8384c9a6cf', 'request_id': 'req-35a3f5a8-0a73-4e77-bd9c-07a4f38be353'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:21.986427 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-bbca3218-fdb5-4a49-b6d5-439607bf6775 None None] MFA Rules not processed for user `05a15a786fda4c7bb0a840f58d5b4a66`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:21.988265 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bbca3218-fdb5-4a49-b6d5-439607bf6775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:21.995414 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-35a3f5a8-0a73-4e77-bd9c-07a4f38be353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96deb45cb5b0459f90325d8384c9a6cf', 'request_id': 'req-35a3f5a8-0a73-4e77-bd9c-07a4f38be353'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:22.012559 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-35a3f5a8-0a73-4e77-bd9c-07a4f38be353 admin admin] The token cache is being invalidate because project 96deb45cb5b0459f90325d8384c9a6cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:34:22.012863 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-35a3f5a8-0a73-4e77-bd9c-07a4f38be353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:22.013532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-35a3f5a8-0a73-4e77-bd9c-07a4f38be353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:22.015145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 983/1973] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:34:21 2022] DELETE /identity/v3/projects/96deb45cb5b0459f90325d8384c9a6cf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:22.020386 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3f5a8-0a73-4e77-bd9c-07a4f38be353 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:22.022256 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-35a3f5a8-0a73-4e77-bd9c-07a4f38be353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:22.084233 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 991/1974] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:34:22.114125 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3f5a8-0a73-4e77-bd9c-07a4f38be353 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:22.119185 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1d77c-0bcf-4898-a416-15109685ecaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:22.119894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1d77c-0bcf-4898-a416-15109685ecaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:22.120264 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1d77c-0bcf-4898-a416-15109685ecaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:22.120603 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1d77c-0bcf-4898-a416-15109685ecaf admin admin] PATH_INFO: `/v3/users/c1efd18b6649438c8bfaf7e9c8f16306` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:22.122068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1d77c-0bcf-4898-a416-15109685ecaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1efd18b6649438c8bfaf7e9c8f16306)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:22.124117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1d77c-0bcf-4898-a416-15109685ecaf admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:22.219721 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8bf1d77c-0bcf-4898-a416-15109685ecaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1efd18b6649438c8bfaf7e9c8f16306'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:22.220868 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8bf1d77c-0bcf-4898-a416-15109685ecaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1efd18b6649438c8bfaf7e9c8f16306'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:22.221751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8bf1d77c-0bcf-4898-a416-15109685ecaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1efd18b6649438c8bfaf7e9c8f16306'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:22.234985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8bf1d77c-0bcf-4898-a416-15109685ecaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1efd18b6649438c8bfaf7e9c8f16306'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:22.246616 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8bf1d77c-0bcf-4898-a416-15109685ecaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1efd18b6649438c8bfaf7e9c8f16306'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:22.268598 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 984/1975] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:34:22 2022] DELETE /identity/v3/users/c1efd18b6649438c8bfaf7e9c8f16306 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:22.996496 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca3218-fdb5-4a49-b6d5-439607bf6775 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:23.008768 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca3218-fdb5-4a49-b6d5-439607bf6775 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:23.107086 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17228816-4bcc-4c06-8efc-69fc0f8053d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:23.108195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17228816-4bcc-4c06-8efc-69fc0f8053d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:23.108567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17228816-4bcc-4c06-8efc-69fc0f8053d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:23.108915 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17228816-4bcc-4c06-8efc-69fc0f8053d9 admin admin] PATH_INFO: `/v3/projects/0c48d24420884b6ca4157e1b3f5e7dfb` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:23.110867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17228816-4bcc-4c06-8efc-69fc0f8053d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c48d24420884b6ca4157e1b3f5e7dfb)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:23.113385 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17228816-4bcc-4c06-8efc-69fc0f8053d9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:23.196493 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-17228816-4bcc-4c06-8efc-69fc0f8053d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c48d24420884b6ca4157e1b3f5e7dfb', 'request_id': 'req-17228816-4bcc-4c06-8efc-69fc0f8053d9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:23.206058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-17228816-4bcc-4c06-8efc-69fc0f8053d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c48d24420884b6ca4157e1b3f5e7dfb', 'request_id': 'req-17228816-4bcc-4c06-8efc-69fc0f8053d9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:23.215443 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-17228816-4bcc-4c06-8efc-69fc0f8053d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c48d24420884b6ca4157e1b3f5e7dfb', 'request_id': 'req-17228816-4bcc-4c06-8efc-69fc0f8053d9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:23.224929 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:23.233922 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-17228816-4bcc-4c06-8efc-69fc0f8053d9 admin admin] The token cache is being invalidate because project 0c48d24420884b6ca4157e1b3f5e7dfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:34:23.234318 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-17228816-4bcc-4c06-8efc-69fc0f8053d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:23.237606 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-17228816-4bcc-4c06-8efc-69fc0f8053d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:23.239716 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 992/1976] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:34:22 2022] DELETE /identity/v3/projects/0c48d24420884b6ca4157e1b3f5e7dfb => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:23.244665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b2dfd-a110-4d58-b82f-1b82ad31de9a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:23.245159 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b2dfd-a110-4d58-b82f-1b82ad31de9a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:23.245274 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b2dfd-a110-4d58-b82f-1b82ad31de9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:23.300903 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-798b2dfd-a110-4d58-b82f-1b82ad31de9a None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:23.302300 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-798b2dfd-a110-4d58-b82f-1b82ad31de9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:23.370012 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:23.431573 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 985/1977] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:23.432664 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b94031-a68f-4405-afe5-2919c8b0d992 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:23.432962 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b94031-a68f-4405-afe5-2919c8b0d992 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:23.433358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b94031-a68f-4405-afe5-2919c8b0d992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:23.470744 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f5b94031-a68f-4405-afe5-2919c8b0d992 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:23.475465 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f5b94031-a68f-4405-afe5-2919c8b0d992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:23.485425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 993/1978] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:23.489806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b2dfd-a110-4d58-b82f-1b82ad31de9a None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:23.499725 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b2dfd-a110-4d58-b82f-1b82ad31de9a None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:23.504394 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb5c25-5219-4a9d-a3c5-afa05a064513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:23.505026 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb5c25-5219-4a9d-a3c5-afa05a064513 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:23.505337 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb5c25-5219-4a9d-a3c5-afa05a064513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:23.505773 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb5c25-5219-4a9d-a3c5-afa05a064513 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:23.506423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb5c25-5219-4a9d-a3c5-afa05a064513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:34:23.506722 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb5c25-5219-4a9d-a3c5-afa05a064513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:23.508836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb5c25-5219-4a9d-a3c5-afa05a064513 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:23.531972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 986/1979] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:34:23.536727 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b94031-a68f-4405-afe5-2919c8b0d992 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:23.547172 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b94031-a68f-4405-afe5-2919c8b0d992 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:23.552249 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363ff1f-95e0-4f8e-805b-bd5560af3ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:23.552983 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363ff1f-95e0-4f8e-805b-bd5560af3ebc admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:23.553442 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363ff1f-95e0-4f8e-805b-bd5560af3ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:23.553762 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363ff1f-95e0-4f8e-805b-bd5560af3ebc admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:23.554448 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363ff1f-95e0-4f8e-805b-bd5560af3ebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:23.556504 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363ff1f-95e0-4f8e-805b-bd5560af3ebc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:23.594204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 994/1980] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:34:23 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:34:23.596039 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb5c25-5219-4a9d-a3c5-afa05a064513 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:23.606616 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb5c25-5219-4a9d-a3c5-afa05a064513 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:23.675973 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d25dff-94df-45f7-80cc-492144772b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:23.676597 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d25dff-94df-45f7-80cc-492144772b03 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:23.676960 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d25dff-94df-45f7-80cc-492144772b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:23.677271 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d25dff-94df-45f7-80cc-492144772b03 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:23.677944 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d25dff-94df-45f7-80cc-492144772b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:23.679843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d25dff-94df-45f7-80cc-492144772b03 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:23.701592 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 987/1981] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:34:23 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:34:23.705775 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363ff1f-95e0-4f8e-805b-bd5560af3ebc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:23.717887 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363ff1f-95e0-4f8e-805b-bd5560af3ebc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:23.730007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f3ed2-f74e-4404-9318-4703fbfd113f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:23.730664 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f3ed2-f74e-4404-9318-4703fbfd113f admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:23.730954 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f3ed2-f74e-4404-9318-4703fbfd113f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:23.731232 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f3ed2-f74e-4404-9318-4703fbfd113f admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:23.731893 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f3ed2-f74e-4404-9318-4703fbfd113f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:23.733614 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f3ed2-f74e-4404-9318-4703fbfd113f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:23.745644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 995/1982] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:34:23.750093 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d25dff-94df-45f7-80cc-492144772b03 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:23.762896 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d25dff-94df-45f7-80cc-492144772b03 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:23.767846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d528ec-469c-4830-bf30-ec2042f01e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:23.768480 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d528ec-469c-4830-bf30-ec2042f01e71 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:23.768758 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d528ec-469c-4830-bf30-ec2042f01e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:23.769026 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d528ec-469c-4830-bf30-ec2042f01e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:23.769684 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d528ec-469c-4830-bf30-ec2042f01e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:23.771461 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d528ec-469c-4830-bf30-ec2042f01e71 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:23.785914 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 988/1983] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:34:23.790497 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f3ed2-f74e-4404-9318-4703fbfd113f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:23.801610 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f3ed2-f74e-4404-9318-4703fbfd113f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:23.807327 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075256b-2a49-4e92-b553-8a3687f2ea5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:23.808042 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075256b-2a49-4e92-b553-8a3687f2ea5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:23.808330 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075256b-2a49-4e92-b553-8a3687f2ea5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:23.808609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075256b-2a49-4e92-b553-8a3687f2ea5d admin admin] PATH_INFO: `/v3/projects/0279d5901c1f461e9457bfdd1df92636/users/ff147d5a3d37435e882c534278251141/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:23.832888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075256b-2a49-4e92-b553-8a3687f2ea5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0279d5901c1f461e9457bfdd1df92636, user_id=ff147d5a3d37435e882c534278251141, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:23.835574 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075256b-2a49-4e92-b553-8a3687f2ea5d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:23.849621 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 996/1984] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:34:23 2022] PUT /identity/v3/projects/0279d5901c1f461e9457bfdd1df92636/users/ff147d5a3d37435e882c534278251141/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:23.855464 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca739d-a459-4f3f-b743-fae995449ba0 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:23.855464 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca739d-a459-4f3f-b743-fae995449ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:23.855840 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca739d-a459-4f3f-b743-fae995449ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:23.879021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-1cca739d-a459-4f3f-b743-fae995449ba0 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:23.880599 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1cca739d-a459-4f3f-b743-fae995449ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:23.951879 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 989/1985] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:23.974857 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075256b-2a49-4e92-b553-8a3687f2ea5d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:23.976734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c075256b-2a49-4e92-b553-8a3687f2ea5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:24.069031 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075256b-2a49-4e92-b553-8a3687f2ea5d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:24.073412 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc4a50-7984-4397-8246-70d674eceda9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:24.074185 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc4a50-7984-4397-8246-70d674eceda9 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:24.074472 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc4a50-7984-4397-8246-70d674eceda9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:24.074775 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc4a50-7984-4397-8246-70d674eceda9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:24.085014 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc4a50-7984-4397-8246-70d674eceda9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:24.086944 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc4a50-7984-4397-8246-70d674eceda9 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:24.097057 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 997/1986] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:34:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:34:24.877376 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf076-f930-4759-9cef-07d8fa4d0cfc None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:24.877899 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf076-f930-4759-9cef-07d8fa4d0cfc None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:24.877997 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf076-f930-4759-9cef-07d8fa4d0cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:24.913907 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-358cf076-f930-4759-9cef-07d8fa4d0cfc None None] MFA Rules not processed for user `ff147d5a3d37435e882c534278251141`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:24.915779 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-358cf076-f930-4759-9cef-07d8fa4d0cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:24.947587 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:24.998919 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 990/1987] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:25.003921 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc4a50-7984-4397-8246-70d674eceda9 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:25.028305 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc4a50-7984-4397-8246-70d674eceda9 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:25.040109 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb99d1-c3b3-4463-bbf4-e7598b2d1ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:25.041075 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb99d1-c3b3-4463-bbf4-e7598b2d1ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:25.041382 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb99d1-c3b3-4463-bbf4-e7598b2d1ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:25.041663 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb99d1-c3b3-4463-bbf4-e7598b2d1ef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:25.042319 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb99d1-c3b3-4463-bbf4-e7598b2d1ef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:25.044254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb99d1-c3b3-4463-bbf4-e7598b2d1ef1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:25.105295 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 998/1988] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:34:25 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:34:25.108064 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cf076-f930-4759-9cef-07d8fa4d0cfc None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:25.137984 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cf076-f930-4759-9cef-07d8fa4d0cfc None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:25.245058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da5018-476a-40c8-87d6-c7b06952cc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:25.246088 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da5018-476a-40c8-87d6-c7b06952cc80 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:25.246401 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da5018-476a-40c8-87d6-c7b06952cc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:25.246684 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da5018-476a-40c8-87d6-c7b06952cc80 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:25.247337 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da5018-476a-40c8-87d6-c7b06952cc80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:25.257045 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da5018-476a-40c8-87d6-c7b06952cc80 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:25.297894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 991/1989] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:34:25 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:34:25.301525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb99d1-c3b3-4463-bbf4-e7598b2d1ef1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:25.318868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb99d1-c3b3-4463-bbf4-e7598b2d1ef1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:25.324823 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962503f-ecb3-4701-b531-c869acf21e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:25.325532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962503f-ecb3-4701-b531-c869acf21e3f admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:25.325969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962503f-ecb3-4701-b531-c869acf21e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:25.326402 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962503f-ecb3-4701-b531-c869acf21e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:25.327141 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962503f-ecb3-4701-b531-c869acf21e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:25.328801 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962503f-ecb3-4701-b531-c869acf21e3f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:25.344711 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 999/1990] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:34:25.345922 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da5018-476a-40c8-87d6-c7b06952cc80 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:25.356383 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da5018-476a-40c8-87d6-c7b06952cc80 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:25.361127 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871074b-5377-4e34-af49-5caa548a9410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:25.361874 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871074b-5377-4e34-af49-5caa548a9410 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:25.362154 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871074b-5377-4e34-af49-5caa548a9410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:25.362427 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871074b-5377-4e34-af49-5caa548a9410 admin admin] PATH_INFO: `/v3/projects/8917a7a458124e4bbcb7ac2368ee0c35/users/cb8467a77eb24b78a0fec3676bca9d00/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:25.379689 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871074b-5377-4e34-af49-5caa548a9410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8917a7a458124e4bbcb7ac2368ee0c35, user_id=cb8467a77eb24b78a0fec3676bca9d00, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:25.382600 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871074b-5377-4e34-af49-5caa548a9410 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:25.397205 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 992/1991] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:34:25 2022] PUT /identity/v3/projects/8917a7a458124e4bbcb7ac2368ee0c35/users/cb8467a77eb24b78a0fec3676bca9d00/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:25.401358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962503f-ecb3-4701-b531-c869acf21e3f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:25.416409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962503f-ecb3-4701-b531-c869acf21e3f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:25.532924 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ed2d7-aabb-4592-a478-7b67a8a75c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:25.533706 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ed2d7-aabb-4592-a478-7b67a8a75c54 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:25.534014 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ed2d7-aabb-4592-a478-7b67a8a75c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:25.534319 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ed2d7-aabb-4592-a478-7b67a8a75c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:25.536928 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ed2d7-aabb-4592-a478-7b67a8a75c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:25.541714 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ed2d7-aabb-4592-a478-7b67a8a75c54 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:25.555576 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1000/1992] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:34:25.559202 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871074b-5377-4e34-af49-5caa548a9410 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:25.582043 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871074b-5377-4e34-af49-5caa548a9410 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:25.593719 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decd2ba-3b67-4ab4-a9d4-1c82ffeae0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:25.594715 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decd2ba-3b67-4ab4-a9d4-1c82ffeae0db admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:25.595100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decd2ba-3b67-4ab4-a9d4-1c82ffeae0db admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:25.595473 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decd2ba-3b67-4ab4-a9d4-1c82ffeae0db admin admin] PATH_INFO: `/v3/projects/8917a7a458124e4bbcb7ac2368ee0c35/users/cb8467a77eb24b78a0fec3676bca9d00/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:25.609324 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decd2ba-3b67-4ab4-a9d4-1c82ffeae0db admin admin] RBAC: Authorizing `identity:create_grant(project_id=8917a7a458124e4bbcb7ac2368ee0c35, user_id=cb8467a77eb24b78a0fec3676bca9d00, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:25.616215 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decd2ba-3b67-4ab4-a9d4-1c82ffeae0db admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:25.634213 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 993/1993] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:34:25 2022] PUT /identity/v3/projects/8917a7a458124e4bbcb7ac2368ee0c35/users/cb8467a77eb24b78a0fec3676bca9d00/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:26.706712 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74860e18-5a4e-4683-81ea-01a644197514 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:26.707295 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74860e18-5a4e-4683-81ea-01a644197514 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:26.707508 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74860e18-5a4e-4683-81ea-01a644197514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:26.718910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:26.754432 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-74860e18-5a4e-4683-81ea-01a644197514 None None] MFA Rules not processed for user `cb8467a77eb24b78a0fec3676bca9d00`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:26.755710 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-74860e18-5a4e-4683-81ea-01a644197514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:26.880678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1001/1994] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:26.892379 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec567d7c-77a6-48c4-95cb-5035b43ce7d8 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:26.892918 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec567d7c-77a6-48c4-95cb-5035b43ce7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:26.892918 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec567d7c-77a6-48c4-95cb-5035b43ce7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:26.972349 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ec567d7c-77a6-48c4-95cb-5035b43ce7d8 None None] MFA Rules not processed for user `ff147d5a3d37435e882c534278251141`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:26.974811 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ec567d7c-77a6-48c4-95cb-5035b43ce7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:27.078112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 994/1995] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:27.222150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74860e18-5a4e-4683-81ea-01a644197514 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:27.223695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-74860e18-5a4e-4683-81ea-01a644197514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:27.350435 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74860e18-5a4e-4683-81ea-01a644197514 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:27.366424 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062d69c-5160-4470-8e17-bf0dc8d1564d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:27.367142 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062d69c-5160-4470-8e17-bf0dc8d1564d service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:27.367959 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062d69c-5160-4470-8e17-bf0dc8d1564d service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:27.368239 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062d69c-5160-4470-8e17-bf0dc8d1564d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:27.377562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062d69c-5160-4470-8e17-bf0dc8d1564d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:27.380296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062d69c-5160-4470-8e17-bf0dc8d1564d service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:27.401315 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1002/1996] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:34:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:34:31.495717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bebb86-0632-4655-8eff-f46de5e2f537 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:31.497375 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bebb86-0632-4655-8eff-f46de5e2f537 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:31.497869 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bebb86-0632-4655-8eff-f46de5e2f537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:31.519063 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-78bebb86-0632-4655-8eff-f46de5e2f537 None None] MFA Rules not processed for user `912693f459f147a5a479ad01e2e8387a`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:31.520443 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-78bebb86-0632-4655-8eff-f46de5e2f537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:31.549187 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:31.608264 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 995/1997] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 31 12:34:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:31.621919 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062d69c-5160-4470-8e17-bf0dc8d1564d service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:31.624773 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9062d69c-5160-4470-8e17-bf0dc8d1564d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:31.768354 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062d69c-5160-4470-8e17-bf0dc8d1564d service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:31.779271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459b27d-8fcd-491a-a4eb-0662bb038600 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188c4989dcfb4f99a04c3349e1a882d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:31.779902 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459b27d-8fcd-491a-a4eb-0662bb038600 service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:31.780181 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459b27d-8fcd-491a-a4eb-0662bb038600 service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:31.780450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459b27d-8fcd-491a-a4eb-0662bb038600 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:31.792464 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459b27d-8fcd-491a-a4eb-0662bb038600 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:31.794488 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459b27d-8fcd-491a-a4eb-0662bb038600 service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:31.819206 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1003/1998] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 31 12:34:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 12:34:36.762798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a2d6f-e65c-483f-ae0e-8d723ff49709 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:36.763356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a2d6f-e65c-483f-ae0e-8d723ff49709 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:36.763356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a2d6f-e65c-483f-ae0e-8d723ff49709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:36.791009 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-fb3a2d6f-e65c-483f-ae0e-8d723ff49709 None None] MFA Rules not processed for user `d1c036fa4872485e903820d848089e02`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:36.792754 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-fb3a2d6f-e65c-483f-ae0e-8d723ff49709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:36.888961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 996/1999] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:41.800535 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:46.877149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=37 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:49.410885 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459b27d-8fcd-491a-a4eb-0662bb038600 service swift] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:49.413200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3459b27d-8fcd-491a-a4eb-0662bb038600 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:49.537941 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459b27d-8fcd-491a-a4eb-0662bb038600 service swift] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:49.546314 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4f93d-c4bc-4636-90a5-6ebc359d6730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:49.548069 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4f93d-c4bc-4636-90a5-6ebc359d6730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:49.548597 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4f93d-c4bc-4636-90a5-6ebc359d6730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:49.549336 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4f93d-c4bc-4636-90a5-6ebc359d6730 admin admin] PATH_INFO: `/v3/users/9012843736f840a98b95c8f4fe72dfd2` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:49.551849 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4f93d-c4bc-4636-90a5-6ebc359d6730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9012843736f840a98b95c8f4fe72dfd2)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:49.554253 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4f93d-c4bc-4636-90a5-6ebc359d6730 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:49.627560 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960967e-a4ed-45ee-936d-e7e965dedeb8 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:49.628122 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960967e-a4ed-45ee-936d-e7e965dedeb8 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:49.628346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960967e-a4ed-45ee-936d-e7e965dedeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:49.639634 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-79e4f93d-c4bc-4636-90a5-6ebc359d6730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9012843736f840a98b95c8f4fe72dfd2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:49.647809 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-79e4f93d-c4bc-4636-90a5-6ebc359d6730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9012843736f840a98b95c8f4fe72dfd2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:49.649552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-79e4f93d-c4bc-4636-90a5-6ebc359d6730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9012843736f840a98b95c8f4fe72dfd2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:49.666536 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-79e4f93d-c4bc-4636-90a5-6ebc359d6730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9012843736f840a98b95c8f4fe72dfd2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:49.676398 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-79e4f93d-c4bc-4636-90a5-6ebc359d6730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9012843736f840a98b95c8f4fe72dfd2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:49.698333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1004/2000] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:34:49 2022] DELETE /identity/v3/users/9012843736f840a98b95c8f4fe72dfd2 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:49.703831 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ddf47-8da9-4bdb-af74-90fa38b03e60 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:49.704168 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ddf47-8da9-4bdb-af74-90fa38b03e60 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:49.704398 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ddf47-8da9-4bdb-af74-90fa38b03e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:49.719460 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-1960967e-a4ed-45ee-936d-e7e965dedeb8 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:49.724865 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1960967e-a4ed-45ee-936d-e7e965dedeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:49.753747 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fd8ddf47-8da9-4bdb-af74-90fa38b03e60 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:49.754989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fd8ddf47-8da9-4bdb-af74-90fa38b03e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:49.859919 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 997/2001] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 31 12:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:34:49.873453 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13b6e9-39d1-46ac-b72c-ba10957b0913 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:49.874255 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13b6e9-39d1-46ac-b72c-ba10957b0913 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:49.874539 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13b6e9-39d1-46ac-b72c-ba10957b0913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:49.906300 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-8d13b6e9-39d1-46ac-b72c-ba10957b0913 None None] MFA Rules not processed for user `912693f459f147a5a479ad01e2e8387a`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:49.907572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8d13b6e9-39d1-46ac-b72c-ba10957b0913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:49.925993 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1005/2002] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:49.926998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ddf47-8da9-4bdb-af74-90fa38b03e60 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:49.930220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fd8ddf47-8da9-4bdb-af74-90fa38b03e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:49.977821 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:50.042652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 998/2003] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 31 12:34:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:34:50.043868 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13b6e9-39d1-46ac-b72c-ba10957b0913 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:50.046313 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8d13b6e9-39d1-46ac-b72c-ba10957b0913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:50.106471 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ddf47-8da9-4bdb-af74-90fa38b03e60 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:50.125872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c73c15-ff07-4702-a68b-64c911339e09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:50.126513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c73c15-ff07-4702-a68b-64c911339e09 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:50.126745 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13b6e9-39d1-46ac-b72c-ba10957b0913 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:50.126863 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c73c15-ff07-4702-a68b-64c911339e09 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:50.127064 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c73c15-ff07-4702-a68b-64c911339e09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:50.138839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414e102-73ac-4d66-ac48-fbd49bc35a74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:50.139834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414e102-73ac-4d66-ac48-fbd49bc35a74 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:50.140828 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c73c15-ff07-4702-a68b-64c911339e09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:50.142801 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414e102-73ac-4d66-ac48-fbd49bc35a74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:50.143536 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414e102-73ac-4d66-ac48-fbd49bc35a74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:50.144071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c73c15-ff07-4702-a68b-64c911339e09 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:50.159075 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414e102-73ac-4d66-ac48-fbd49bc35a74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:50.160680 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414e102-73ac-4d66-ac48-fbd49bc35a74 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:50.174510 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 999/2004] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:34:50.174897 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1006/2005] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:34:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:34:50.175690 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414e102-73ac-4d66-ac48-fbd49bc35a74 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:50.177212 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d414e102-73ac-4d66-ac48-fbd49bc35a74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:50.269373 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:50.295387 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414e102-73ac-4d66-ac48-fbd49bc35a74 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:50.302005 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba2485-c47a-452b-b70e-f025c0d5cc85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188c4989dcfb4f99a04c3349e1a882d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:50.302732 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba2485-c47a-452b-b70e-f025c0d5cc85 service swift] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:50.303113 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba2485-c47a-452b-b70e-f025c0d5cc85 service swift] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:50.303572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba2485-c47a-452b-b70e-f025c0d5cc85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:50.314271 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba2485-c47a-452b-b70e-f025c0d5cc85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:50.316041 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba2485-c47a-452b-b70e-f025c0d5cc85 service swift] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:50.326454 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1000/2006] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 31 12:34:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 12:34:51.179205 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c73c15-ff07-4702-a68b-64c911339e09 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:51.181398 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-17c73c15-ff07-4702-a68b-64c911339e09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:51.203188 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c73c15-ff07-4702-a68b-64c911339e09 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:51.214818 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de9cf9-594a-43f7-888a-7ea95e4244f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:51.215494 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de9cf9-594a-43f7-888a-7ea95e4244f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:51.215780 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de9cf9-594a-43f7-888a-7ea95e4244f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:51.216077 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de9cf9-594a-43f7-888a-7ea95e4244f7 admin admin] PATH_INFO: `/v3/projects/deb1f5f557c14865be5860a51c0bcb49` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:51.218596 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de9cf9-594a-43f7-888a-7ea95e4244f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=deb1f5f557c14865be5860a51c0bcb49)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:51.220452 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de9cf9-594a-43f7-888a-7ea95e4244f7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:51.328774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-61de9cf9-594a-43f7-888a-7ea95e4244f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb1f5f557c14865be5860a51c0bcb49', 'request_id': 'req-61de9cf9-594a-43f7-888a-7ea95e4244f7'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:51.344563 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-61de9cf9-594a-43f7-888a-7ea95e4244f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb1f5f557c14865be5860a51c0bcb49', 'request_id': 'req-61de9cf9-594a-43f7-888a-7ea95e4244f7'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:51.359129 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-61de9cf9-594a-43f7-888a-7ea95e4244f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb1f5f557c14865be5860a51c0bcb49', 'request_id': 'req-61de9cf9-594a-43f7-888a-7ea95e4244f7'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:51.391053 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-61de9cf9-594a-43f7-888a-7ea95e4244f7 admin admin] The token cache is being invalidate because project deb1f5f557c14865be5860a51c0bcb49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:34:51.391330 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-61de9cf9-594a-43f7-888a-7ea95e4244f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:51.393951 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-61de9cf9-594a-43f7-888a-7ea95e4244f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:34:51.399621 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1007/2007] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:34:51 2022] DELETE /identity/v3/projects/deb1f5f557c14865be5860a51c0bcb49 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:51.401728 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f89c6-bf83-40a1-8463-4381052be46d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:51.402245 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f89c6-bf83-40a1-8463-4381052be46d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:51.402245 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f89c6-bf83-40a1-8463-4381052be46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:51.438000 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-9a9f89c6-bf83-40a1-8463-4381052be46d None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:51.439224 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9a9f89c6-bf83-40a1-8463-4381052be46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:51.575499 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1001/2008] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:51.585390 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9a770-9715-4d11-906e-f1ed663459bf None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:51.586235 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9a770-9715-4d11-906e-f1ed663459bf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:51.586674 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9a770-9715-4d11-906e-f1ed663459bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:51.632265 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-55a9a770-9715-4d11-906e-f1ed663459bf None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:51.634379 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-55a9a770-9715-4d11-906e-f1ed663459bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:51.658599 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1008/2009] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:51.662866 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f89c6-bf83-40a1-8463-4381052be46d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:51.678797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f89c6-bf83-40a1-8463-4381052be46d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:51.689936 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac2298-b6ed-4557-a497-2a1fa3fe942a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:51.690575 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac2298-b6ed-4557-a497-2a1fa3fe942a admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:51.690858 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac2298-b6ed-4557-a497-2a1fa3fe942a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:51.692174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac2298-b6ed-4557-a497-2a1fa3fe942a admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:51.692857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac2298-b6ed-4557-a497-2a1fa3fe942a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:34:51.693197 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac2298-b6ed-4557-a497-2a1fa3fe942a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:51.694841 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac2298-b6ed-4557-a497-2a1fa3fe942a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:51.729516 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1002/2010] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:34:51.733584 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9a770-9715-4d11-906e-f1ed663459bf None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:51.744479 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9a770-9715-4d11-906e-f1ed663459bf None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:51.751898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeecf9c-75fa-4b83-b1a1-9535c3e338fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:51.752991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeecf9c-75fa-4b83-b1a1-9535c3e338fc admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:51.753437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeecf9c-75fa-4b83-b1a1-9535c3e338fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:51.753804 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeecf9c-75fa-4b83-b1a1-9535c3e338fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:51.754553 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeecf9c-75fa-4b83-b1a1-9535c3e338fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:51.771758 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeecf9c-75fa-4b83-b1a1-9535c3e338fc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:51.869201 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1009/2011] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:34:51 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:34:51.874152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac2298-b6ed-4557-a497-2a1fa3fe942a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:51.890042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac2298-b6ed-4557-a497-2a1fa3fe942a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:52.122017 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978836c-a242-474a-8028-515827f6277f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:52.122697 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978836c-a242-474a-8028-515827f6277f admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:52.122988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978836c-a242-474a-8028-515827f6277f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:52.123633 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978836c-a242-474a-8028-515827f6277f admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:52.124144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978836c-a242-474a-8028-515827f6277f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:52.126112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978836c-a242-474a-8028-515827f6277f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:52.164498 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1003/2012] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:34:51 2022] POST /identity/v3/users => generated 288 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:34:52.169004 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeecf9c-75fa-4b83-b1a1-9535c3e338fc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:52.182002 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeecf9c-75fa-4b83-b1a1-9535c3e338fc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:52.209802 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267b8dc-fadf-4313-a0b9-ee030cca6482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:52.211350 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267b8dc-fadf-4313-a0b9-ee030cca6482 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:52.211929 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267b8dc-fadf-4313-a0b9-ee030cca6482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:52.212297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267b8dc-fadf-4313-a0b9-ee030cca6482 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:52.213133 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267b8dc-fadf-4313-a0b9-ee030cca6482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:52.215102 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267b8dc-fadf-4313-a0b9-ee030cca6482 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:52.237337 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1010/2013] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:34:52.241464 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978836c-a242-474a-8028-515827f6277f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:52.253975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978836c-a242-474a-8028-515827f6277f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:52.278841 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44d712-8e29-4751-b711-01744ae68561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:52.279528 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44d712-8e29-4751-b711-01744ae68561 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:52.279763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44d712-8e29-4751-b711-01744ae68561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:52.280073 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44d712-8e29-4751-b711-01744ae68561 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:52.280775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44d712-8e29-4751-b711-01744ae68561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:52.282559 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44d712-8e29-4751-b711-01744ae68561 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:52.303863 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1004/2014] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:34:52.308515 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267b8dc-fadf-4313-a0b9-ee030cca6482 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:52.324674 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267b8dc-fadf-4313-a0b9-ee030cca6482 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:52.346936 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c859ce-a56f-476d-a053-ab75e926a9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:52.347762 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c859ce-a56f-476d-a053-ab75e926a9a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:52.348150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c859ce-a56f-476d-a053-ab75e926a9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:52.349827 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c859ce-a56f-476d-a053-ab75e926a9a5 admin admin] PATH_INFO: `/v3/projects/4773d6f95d734634a23a07b176671cbc/users/5ee1912a3e434ca4be2fba450735ad37/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:52.395456 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c859ce-a56f-476d-a053-ab75e926a9a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4773d6f95d734634a23a07b176671cbc, user_id=5ee1912a3e434ca4be2fba450735ad37, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:52.398988 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c859ce-a56f-476d-a053-ab75e926a9a5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:52.420750 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1011/2015] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:34:52 2022] PUT /identity/v3/projects/4773d6f95d734634a23a07b176671cbc/users/5ee1912a3e434ca4be2fba450735ad37/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:34:52.431834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f75d94-e4b9-457c-99a4-d366d4c1b98e None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:52.432447 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f75d94-e4b9-457c-99a4-d366d4c1b98e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:52.432447 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f75d94-e4b9-457c-99a4-d366d4c1b98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:52.504429 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-99f75d94-e4b9-457c-99a4-d366d4c1b98e None None] MFA Rules not processed for user `5ee1912a3e434ca4be2fba450735ad37`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:52.506068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-99f75d94-e4b9-457c-99a4-d366d4c1b98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:52.620088 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:52.687184 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1005/2016] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:52.698546 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c859ce-a56f-476d-a053-ab75e926a9a5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:52.701394 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-09c859ce-a56f-476d-a053-ab75e926a9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:52.778441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:34:52.840239 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c859ce-a56f-476d-a053-ab75e926a9a5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:52.845133 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a766d7b-3345-4eb1-8310-6a7d458766ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:52.845894 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a766d7b-3345-4eb1-8310-6a7d458766ed service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:52.847197 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a766d7b-3345-4eb1-8310-6a7d458766ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:52.847660 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a766d7b-3345-4eb1-8310-6a7d458766ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:52.865729 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a766d7b-3345-4eb1-8310-6a7d458766ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:52.867969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a766d7b-3345-4eb1-8310-6a7d458766ed service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:52.883837 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1012/2017] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:34:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:34:54.562520 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c23138-0d2c-4d33-aa97-ab6a9b429880 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:54.563098 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c23138-0d2c-4d33-aa97-ab6a9b429880 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:54.563098 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c23138-0d2c-4d33-aa97-ab6a9b429880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:54.589301 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-07c23138-0d2c-4d33-aa97-ab6a9b429880 None None] MFA Rules not processed for user `5ee1912a3e434ca4be2fba450735ad37`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:54.590682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-07c23138-0d2c-4d33-aa97-ab6a9b429880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:54.604754 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1006/2018] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:34:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:54.838706 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb376bbc-f039-4d51-a7c8-8ed239cf4861 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:54.839638 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb376bbc-f039-4d51-a7c8-8ed239cf4861 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:54.840061 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb376bbc-f039-4d51-a7c8-8ed239cf4861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:54.879393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-bb376bbc-f039-4d51-a7c8-8ed239cf4861 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:54.880769 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bb376bbc-f039-4d51-a7c8-8ed239cf4861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:54.977162 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1013/2019] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 31 12:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:55.208626 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c23138-0d2c-4d33-aa97-ab6a9b429880 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:55.210368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-07c23138-0d2c-4d33-aa97-ab6a9b429880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:55.403713 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c23138-0d2c-4d33-aa97-ab6a9b429880 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:55.413794 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72131dec-adb9-46fe-a083-ad4871440dc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:55.414609 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72131dec-adb9-46fe-a083-ad4871440dc5 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:55.415358 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72131dec-adb9-46fe-a083-ad4871440dc5 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:55.415617 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72131dec-adb9-46fe-a083-ad4871440dc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:55.425832 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72131dec-adb9-46fe-a083-ad4871440dc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:55.427539 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72131dec-adb9-46fe-a083-ad4871440dc5 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:55.462006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1007/2020] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:34:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:34:59.420018 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7020a1-21c9-446e-bed9-538cf0004c5c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:59.420645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7020a1-21c9-446e-bed9-538cf0004c5c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:59.421081 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7020a1-21c9-446e-bed9-538cf0004c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:59.451060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2a7020a1-21c9-446e-bed9-538cf0004c5c None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:34:59.452389 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2a7020a1-21c9-446e-bed9-538cf0004c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:59.466922 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1014/2021] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 31 12:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:34:59.571690 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72131dec-adb9-46fe-a083-ad4871440dc5 service nova] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:34:59.573159 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-72131dec-adb9-46fe-a083-ad4871440dc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:34:59.593698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72131dec-adb9-46fe-a083-ad4871440dc5 service nova] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:34:59.599462 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17182e-1bdb-4e06-b56c-4e141a9da972 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:34:59.600163 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17182e-1bdb-4e06-b56c-4e141a9da972 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:34:59.600509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17182e-1bdb-4e06-b56c-4e141a9da972 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:34:59.600845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17182e-1bdb-4e06-b56c-4e141a9da972 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:34:59.610298 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17182e-1bdb-4e06-b56c-4e141a9da972 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:34:59.611949 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17182e-1bdb-4e06-b56c-4e141a9da972 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:34:59.628507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1008/2022] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:35:03.605423 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4eec44-f8a2-4031-ae98-30f0c2909e97 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:03.606012 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4eec44-f8a2-4031-ae98-30f0c2909e97 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:03.606012 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4eec44-f8a2-4031-ae98-30f0c2909e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:03.626009 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-db4eec44-f8a2-4031-ae98-30f0c2909e97 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:35:03.627234 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-db4eec44-f8a2-4031-ae98-30f0c2909e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:03.636702 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1015/2023] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 31 12:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:35:03.652307 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17182e-1bdb-4e06-b56c-4e141a9da972 service nova] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:35:03.663808 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17182e-1bdb-4e06-b56c-4e141a9da972 service nova] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:35:03.669924 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f06223-8c1c-4275-b229-235e19cb3b1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:35:03.670708 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f06223-8c1c-4275-b229-235e19cb3b1e service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:03.671168 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f06223-8c1c-4275-b229-235e19cb3b1e service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:03.671445 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f06223-8c1c-4275-b229-235e19cb3b1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:03.680939 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f06223-8c1c-4275-b229-235e19cb3b1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:35:03.682794 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f06223-8c1c-4275-b229-235e19cb3b1e service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:35:03.693681 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1009/2024] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:35:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:35:05.948637 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4eec44-f8a2-4031-ae98-30f0c2909e97 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:35:05.950659 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-db4eec44-f8a2-4031-ae98-30f0c2909e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:06.008650 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4eec44-f8a2-4031-ae98-30f0c2909e97 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:35:06.012230 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec187dbf-1d1e-4545-8c29-bab1047c8533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:35:06.012836 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec187dbf-1d1e-4545-8c29-bab1047c8533 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:06.013136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec187dbf-1d1e-4545-8c29-bab1047c8533 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:06.013415 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec187dbf-1d1e-4545-8c29-bab1047c8533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:06.015106 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ec187dbf-1d1e-4545-8c29-bab1047c8533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:06.091253 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec187dbf-1d1e-4545-8c29-bab1047c8533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:35:06.092678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec187dbf-1d1e-4545-8c29-bab1047c8533 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:35:06.102828 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1016/2025] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:35:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:35:06.125023 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f06223-8c1c-4275-b229-235e19cb3b1e service nova] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:35:06.135005 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f06223-8c1c-4275-b229-235e19cb3b1e service nova] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:35:06.138589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1ef32-3069-43c1-8425-47fbf6e670df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:35:06.139179 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ef32-3069-43c1-8425-47fbf6e670df service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:06.139455 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ef32-3069-43c1-8425-47fbf6e670df service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:06.139748 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ef32-3069-43c1-8425-47fbf6e670df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:06.141475 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-03c1ef32-3069-43c1-8425-47fbf6e670df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:06.209357 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1ef32-3069-43c1-8425-47fbf6e670df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:35:06.211005 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1ef32-3069-43c1-8425-47fbf6e670df service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:35:06.221908 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1010/2026] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:35:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:35:10.946484 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ad2d0-2ced-4ec8-8d5f-18cadbde30a0 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:10.947082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ad2d0-2ced-4ec8-8d5f-18cadbde30a0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:10.947082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ad2d0-2ced-4ec8-8d5f-18cadbde30a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:10.958264 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:10.972607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b84ad2d0-2ced-4ec8-8d5f-18cadbde30a0 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:35:10.974229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b84ad2d0-2ced-4ec8-8d5f-18cadbde30a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:10.982803 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1017/2027] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 31 12:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:35:10.998862 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1ef32-3069-43c1-8425-47fbf6e670df service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:35:11.013978 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1ef32-3069-43c1-8425-47fbf6e670df service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:35:11.021313 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5611590-2eec-4adf-94d7-a713ef14fe91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:35:11.021775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5611590-2eec-4adf-94d7-a713ef14fe91 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:11.022061 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5611590-2eec-4adf-94d7-a713ef14fe91 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:11.022340 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5611590-2eec-4adf-94d7-a713ef14fe91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:11.033559 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5611590-2eec-4adf-94d7-a713ef14fe91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:35:11.035073 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5611590-2eec-4adf-94d7-a713ef14fe91 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:35:11.059136 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1011/2028] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:35:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:35:15.947515 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de128d-acc7-414f-9cd7-ea0ce32c0632 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:15.948054 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de128d-acc7-414f-9cd7-ea0ce32c0632 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:15.948054 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de128d-acc7-414f-9cd7-ea0ce32c0632 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:15.950494 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1018/2029] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 31 12:35:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:35:15.961322 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987ed70-3686-4acd-b043-9b7a717666cd None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:15.961876 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987ed70-3686-4acd-b043-9b7a717666cd None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:15.961990 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987ed70-3686-4acd-b043-9b7a717666cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:15.985873 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:16.003440 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-2987ed70-3686-4acd-b043-9b7a717666cd None None] MFA Rules not processed for user `d93ce5759e0648a1934ff4d9c9d8fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:35:16.005216 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2987ed70-3686-4acd-b043-9b7a717666cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:16.016777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1012/2030] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 31 12:35:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:35:16.028702 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de128d-acc7-414f-9cd7-ea0ce32c0632 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:35:16.030452 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a9de128d-acc7-414f-9cd7-ea0ce32c0632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:16.142413 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de128d-acc7-414f-9cd7-ea0ce32c0632 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:35:16.147934 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd04a9a-f2b3-4cf0-93a4-b9fdf501a11b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c6b6b1cdc649dda3a9caa8d9713569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:35:16.148571 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd04a9a-f2b3-4cf0-93a4-b9fdf501a11b service glance] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:16.149029 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd04a9a-f2b3-4cf0-93a4-b9fdf501a11b service glance] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:16.149335 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd04a9a-f2b3-4cf0-93a4-b9fdf501a11b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:16.163471 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd04a9a-f2b3-4cf0-93a4-b9fdf501a11b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:35:16.165989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd04a9a-f2b3-4cf0-93a4-b9fdf501a11b service glance] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:35:16.179796 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1019/2031] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:35:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:35:16.288465 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9077e3a-e489-4023-b32b-3d4e199e08eb None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:16.288829 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9077e3a-e489-4023-b32b-3d4e199e08eb None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:16.289222 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9077e3a-e489-4023-b32b-3d4e199e08eb None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:16.291851 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1013/2032] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 31 12:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:35:16.297506 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf54cf-92e0-4b56-bb1d-6af728ea0beb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:16.297931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf54cf-92e0-4b56-bb1d-6af728ea0beb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:16.298062 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf54cf-92e0-4b56-bb1d-6af728ea0beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:16.324178 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f2bf54cf-92e0-4b56-bb1d-6af728ea0beb None None] MFA Rules not processed for user `7179d21011064d5b91d0e35a51b8adae`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:35:16.325717 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f2bf54cf-92e0-4b56-bb1d-6af728ea0beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:16.334005 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1020/2033] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 31 12:35:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:35:16.356202 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9077e3a-e489-4023-b32b-3d4e199e08eb None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:35:16.358905 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a9077e3a-e489-4023-b32b-3d4e199e08eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:16.385651 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9077e3a-e489-4023-b32b-3d4e199e08eb None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:35:16.389484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff327b-c1a1-45fe-8d92-93382b893719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:35:16.392124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff327b-c1a1-45fe-8d92-93382b893719 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:16.392124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff327b-c1a1-45fe-8d92-93382b893719 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:16.392124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff327b-c1a1-45fe-8d92-93382b893719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:16.404912 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff327b-c1a1-45fe-8d92-93382b893719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:35:16.405657 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff327b-c1a1-45fe-8d92-93382b893719 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:35:16.415307 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1014/2034] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:35:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:35:16.789387 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce3123-0775-40c1-ac12-7f44662cee69 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:16.789672 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce3123-0775-40c1-ac12-7f44662cee69 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:16.790340 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce3123-0775-40c1-ac12-7f44662cee69 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:16.791713 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1021/2035] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 31 12:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:35:16.798001 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefb08e-4685-415c-b492-2546aec0dbfe None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:16.798293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefb08e-4685-415c-b492-2546aec0dbfe None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:16.798568 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefb08e-4685-415c-b492-2546aec0dbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:16.818302 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-eaefb08e-4685-415c-b492-2546aec0dbfe None None] MFA Rules not processed for user `d93ce5759e0648a1934ff4d9c9d8fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:35:16.819513 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-eaefb08e-4685-415c-b492-2546aec0dbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:16.829282 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1015/2036] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 31 12:35:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:35:16.840431 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce3123-0775-40c1-ac12-7f44662cee69 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:35:16.851261 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce3123-0775-40c1-ac12-7f44662cee69 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:35:16.854801 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd204ee9-61f4-407c-88ae-93dd4a10e182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:35:16.855398 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd204ee9-61f4-407c-88ae-93dd4a10e182 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:16.855682 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd204ee9-61f4-407c-88ae-93dd4a10e182 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:16.855966 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd204ee9-61f4-407c-88ae-93dd4a10e182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:16.866558 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd204ee9-61f4-407c-88ae-93dd4a10e182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:35:16.868004 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd204ee9-61f4-407c-88ae-93dd4a10e182 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:35:16.879291 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1022/2037] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:35:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:35:17.191900 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe597d09-492b-47b3-b24e-afa08d837d1f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:17.192378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe597d09-492b-47b3-b24e-afa08d837d1f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:17.192493 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe597d09-492b-47b3-b24e-afa08d837d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:17.212455 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-fe597d09-492b-47b3-b24e-afa08d837d1f None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:35:17.213686 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-fe597d09-492b-47b3-b24e-afa08d837d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:17.221955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1016/2038] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 31 12:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:35:17.240649 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd204ee9-61f4-407c-88ae-93dd4a10e182 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:35:17.253286 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd204ee9-61f4-407c-88ae-93dd4a10e182 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:35:17.260492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a354c0c-37b5-483d-94fd-e1f027333197 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:35:17.261140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a354c0c-37b5-483d-94fd-e1f027333197 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:17.261420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a354c0c-37b5-483d-94fd-e1f027333197 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:17.261699 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a354c0c-37b5-483d-94fd-e1f027333197 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:17.270501 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a354c0c-37b5-483d-94fd-e1f027333197 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:35:17.272060 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a354c0c-37b5-483d-94fd-e1f027333197 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:35:17.282988 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1023/2039] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:35:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:35:27.207395 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=12 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:27.277735 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=42 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:29.524664 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27219490-6223-4b98-82bb-2c0b4160f2b9 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:29.525169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27219490-6223-4b98-82bb-2c0b4160f2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:29.525264 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27219490-6223-4b98-82bb-2c0b4160f2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:29.545891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-27219490-6223-4b98-82bb-2c0b4160f2b9 None None] MFA Rules not processed for user `912693f459f147a5a479ad01e2e8387a`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:35:29.547039 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-27219490-6223-4b98-82bb-2c0b4160f2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:29.604635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1017/2040] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 31 12:35:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:35:29.629760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a354c0c-37b5-483d-94fd-e1f027333197 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:35:29.631456 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3a354c0c-37b5-483d-94fd-e1f027333197 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:29.741455 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a354c0c-37b5-483d-94fd-e1f027333197 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:35:29.748075 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510e60c-498a-4aa3-819d-5e4f703f8a40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188c4989dcfb4f99a04c3349e1a882d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:35:29.748835 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510e60c-498a-4aa3-819d-5e4f703f8a40 service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:29.749308 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510e60c-498a-4aa3-819d-5e4f703f8a40 service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:29.749690 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510e60c-498a-4aa3-819d-5e4f703f8a40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:29.759358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510e60c-498a-4aa3-819d-5e4f703f8a40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:35:29.761123 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510e60c-498a-4aa3-819d-5e4f703f8a40 service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:35:29.779337 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1024/2041] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 31 12:35:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 12:35:31.559086 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756da24-9ee2-4261-ade4-5bacfcb49fc7 None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:31.559712 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756da24-9ee2-4261-ade4-5bacfcb49fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:31.559712 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756da24-9ee2-4261-ade4-5bacfcb49fc7 None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:31.561185 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1018/2042] 10.222.0.18 () {54 vars in 921 bytes} [Mon Oct 31 12:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:35:31.568469 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a30e8-5acb-41d0-a872-cb53d7aae647 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:31.569071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a30e8-5acb-41d0-a872-cb53d7aae647 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:31.569071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a30e8-5acb-41d0-a872-cb53d7aae647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:31.589306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4b6a30e8-5acb-41d0-a872-cb53d7aae647 None None] MFA Rules not processed for user `18c015b8317b4517911f69bef21a0573`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:35:31.590519 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4b6a30e8-5acb-41d0-a872-cb53d7aae647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:31.695982 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1025/2043] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Oct 31 12:35:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:35:31.725846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756da24-9ee2-4261-ade4-5bacfcb49fc7 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:35:31.729393 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4756da24-9ee2-4261-ade4-5bacfcb49fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:31.760886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756da24-9ee2-4261-ade4-5bacfcb49fc7 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:35:31.783648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978a0b4-8747-4347-bd0f-0d1e1cc21d0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18c015b8317b4517911f69bef21a0573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:35:31.783648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978a0b4-8747-4347-bd0f-0d1e1cc21d0c service placement] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:31.783648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978a0b4-8747-4347-bd0f-0d1e1cc21d0c service placement] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:31.783648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978a0b4-8747-4347-bd0f-0d1e1cc21d0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:31.813359 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978a0b4-8747-4347-bd0f-0d1e1cc21d0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:35:31.814979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978a0b4-8747-4347-bd0f-0d1e1cc21d0c service placement] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:35:31.833722 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1019/2044] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:35:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:35:32.323919 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a30e8-5acb-41d0-a872-cb53d7aae647 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:35:32.325408 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4b6a30e8-5acb-41d0-a872-cb53d7aae647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:32.340365 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a30e8-5acb-41d0-a872-cb53d7aae647 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:35:32.344907 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50397187-a13f-43c6-b92d-a9f52c3613d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:35:32.345575 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50397187-a13f-43c6-b92d-a9f52c3613d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:32.345855 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50397187-a13f-43c6-b92d-a9f52c3613d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:32.346127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50397187-a13f-43c6-b92d-a9f52c3613d5 admin admin] PATH_INFO: `/v3/users/ff147d5a3d37435e882c534278251141` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:32.347246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50397187-a13f-43c6-b92d-a9f52c3613d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff147d5a3d37435e882c534278251141)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:35:32.349975 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50397187-a13f-43c6-b92d-a9f52c3613d5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:35:32.406202 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-50397187-a13f-43c6-b92d-a9f52c3613d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff147d5a3d37435e882c534278251141'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:32.413392 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-50397187-a13f-43c6-b92d-a9f52c3613d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff147d5a3d37435e882c534278251141'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:32.414673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-50397187-a13f-43c6-b92d-a9f52c3613d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff147d5a3d37435e882c534278251141'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:32.434123 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-50397187-a13f-43c6-b92d-a9f52c3613d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff147d5a3d37435e882c534278251141'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:32.447303 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-50397187-a13f-43c6-b92d-a9f52c3613d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff147d5a3d37435e882c534278251141'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:32.449128 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:32.458959 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1026/2045] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:35:32 2022] DELETE /identity/v3/users/ff147d5a3d37435e882c534278251141 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:35:32.658338 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978a0b4-8747-4347-bd0f-0d1e1cc21d0c service placement] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:35:32.670178 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978a0b4-8747-4347-bd0f-0d1e1cc21d0c service placement] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:35:32.768785 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd7244-5c5a-4f22-9341-368c16f43a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:35:32.769459 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd7244-5c5a-4f22-9341-368c16f43a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:32.769814 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd7244-5c5a-4f22-9341-368c16f43a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:32.770392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd7244-5c5a-4f22-9341-368c16f43a1d admin admin] PATH_INFO: `/v3/projects/0279d5901c1f461e9457bfdd1df92636` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:32.771685 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd7244-5c5a-4f22-9341-368c16f43a1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0279d5901c1f461e9457bfdd1df92636)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:35:32.774715 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd7244-5c5a-4f22-9341-368c16f43a1d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:35:32.830029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-64bd7244-5c5a-4f22-9341-368c16f43a1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0279d5901c1f461e9457bfdd1df92636', 'request_id': 'req-64bd7244-5c5a-4f22-9341-368c16f43a1d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:32.836530 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-64bd7244-5c5a-4f22-9341-368c16f43a1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0279d5901c1f461e9457bfdd1df92636', 'request_id': 'req-64bd7244-5c5a-4f22-9341-368c16f43a1d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:32.847328 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-64bd7244-5c5a-4f22-9341-368c16f43a1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0279d5901c1f461e9457bfdd1df92636', 'request_id': 'req-64bd7244-5c5a-4f22-9341-368c16f43a1d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:32.865849 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-64bd7244-5c5a-4f22-9341-368c16f43a1d admin admin] The token cache is being invalidate because project 0279d5901c1f461e9457bfdd1df92636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:35:32.866252 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-64bd7244-5c5a-4f22-9341-368c16f43a1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:32.867011 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-64bd7244-5c5a-4f22-9341-368c16f43a1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:32.869349 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1020/2046] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:35:32 2022] DELETE /identity/v3/projects/0279d5901c1f461e9457bfdd1df92636 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:35:32.873333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50397187-a13f-43c6-b92d-a9f52c3613d5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:35:32.874802 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-50397187-a13f-43c6-b92d-a9f52c3613d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:32.888170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50397187-a13f-43c6-b92d-a9f52c3613d5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:35:32.959130 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90706300-4a99-4551-b4ef-5583ef9079c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:35:32.960225 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90706300-4a99-4551-b4ef-5583ef9079c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:32.960703 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90706300-4a99-4551-b4ef-5583ef9079c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:32.961271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90706300-4a99-4551-b4ef-5583ef9079c0 admin admin] PATH_INFO: `/v3/users/cb8467a77eb24b78a0fec3676bca9d00` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:32.962782 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90706300-4a99-4551-b4ef-5583ef9079c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb8467a77eb24b78a0fec3676bca9d00)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:35:32.964904 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90706300-4a99-4551-b4ef-5583ef9079c0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:35:33.031040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-90706300-4a99-4551-b4ef-5583ef9079c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb8467a77eb24b78a0fec3676bca9d00'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:33.045770 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-90706300-4a99-4551-b4ef-5583ef9079c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb8467a77eb24b78a0fec3676bca9d00'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:33.046523 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-90706300-4a99-4551-b4ef-5583ef9079c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb8467a77eb24b78a0fec3676bca9d00'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:33.065244 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-90706300-4a99-4551-b4ef-5583ef9079c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb8467a77eb24b78a0fec3676bca9d00'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:33.073139 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-90706300-4a99-4551-b4ef-5583ef9079c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb8467a77eb24b78a0fec3676bca9d00'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:33.079496 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1027/2047] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:35:32 2022] DELETE /identity/v3/users/cb8467a77eb24b78a0fec3676bca9d00 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:35:33.266575 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd7244-5c5a-4f22-9341-368c16f43a1d admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:35:33.271880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-64bd7244-5c5a-4f22-9341-368c16f43a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:33.290640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd7244-5c5a-4f22-9341-368c16f43a1d admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:35:33.324649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:33.408769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd43f0-f66b-4669-813b-396023af9be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:35:33.409984 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd43f0-f66b-4669-813b-396023af9be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:33.410506 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd43f0-f66b-4669-813b-396023af9be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:33.410986 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd43f0-f66b-4669-813b-396023af9be3 admin admin] PATH_INFO: `/v3/projects/8917a7a458124e4bbcb7ac2368ee0c35` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:33.412510 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd43f0-f66b-4669-813b-396023af9be3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8917a7a458124e4bbcb7ac2368ee0c35)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:35:33.414463 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd43f0-f66b-4669-813b-396023af9be3 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:35:33.473711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a9dd43f0-f66b-4669-813b-396023af9be3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8917a7a458124e4bbcb7ac2368ee0c35', 'request_id': 'req-a9dd43f0-f66b-4669-813b-396023af9be3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:33.490972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a9dd43f0-f66b-4669-813b-396023af9be3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8917a7a458124e4bbcb7ac2368ee0c35', 'request_id': 'req-a9dd43f0-f66b-4669-813b-396023af9be3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:33.517581 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a9dd43f0-f66b-4669-813b-396023af9be3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8917a7a458124e4bbcb7ac2368ee0c35', 'request_id': 'req-a9dd43f0-f66b-4669-813b-396023af9be3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:33.559503 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a9dd43f0-f66b-4669-813b-396023af9be3 admin admin] The token cache is being invalidate because project 8917a7a458124e4bbcb7ac2368ee0c35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:35:33.559767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a9dd43f0-f66b-4669-813b-396023af9be3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:33.560463 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a9dd43f0-f66b-4669-813b-396023af9be3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:33.562889 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1021/2048] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:35:33 2022] DELETE /identity/v3/projects/8917a7a458124e4bbcb7ac2368ee0c35 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:35:43.076148 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:43.133593 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90706300-4a99-4551-b4ef-5583ef9079c0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:35:43.135089 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-90706300-4a99-4551-b4ef-5583ef9079c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:43.208616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90706300-4a99-4551-b4ef-5583ef9079c0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:35:43.273559 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bc8b9-9a4c-478a-aa5d-f39359ca933d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18c015b8317b4517911f69bef21a0573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:35:43.274673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bc8b9-9a4c-478a-aa5d-f39359ca933d service placement] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:43.274956 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bc8b9-9a4c-478a-aa5d-f39359ca933d service placement] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:43.275231 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bc8b9-9a4c-478a-aa5d-f39359ca933d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:43.276997 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b24bc8b9-9a4c-478a-aa5d-f39359ca933d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:43.288680 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24bc8b9-9a4c-478a-aa5d-f39359ca933d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:35:43.291156 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24bc8b9-9a4c-478a-aa5d-f39359ca933d service placement] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:35:43.301516 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1028/2049] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:35:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:35:43.549683 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:44.751032 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29d404-5a5d-4cd7-a8ba-2030dba0701f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:44.751980 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29d404-5a5d-4cd7-a8ba-2030dba0701f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:44.752411 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29d404-5a5d-4cd7-a8ba-2030dba0701f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:44.793522 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-7a29d404-5a5d-4cd7-a8ba-2030dba0701f None None] MFA Rules not processed for user `912693f459f147a5a479ad01e2e8387a`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:35:44.798461 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7a29d404-5a5d-4cd7-a8ba-2030dba0701f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:44.908117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1022/2050] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 31 12:35:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:35:44.927807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bc8b9-9a4c-478a-aa5d-f39359ca933d service placement] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:35:44.931195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b24bc8b9-9a4c-478a-aa5d-f39359ca933d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:45.047982 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bc8b9-9a4c-478a-aa5d-f39359ca933d service placement] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:35:45.053259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb2d82-7548-498f-a813-be3be5b3a9bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188c4989dcfb4f99a04c3349e1a882d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:35:45.053942 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb2d82-7548-498f-a813-be3be5b3a9bc service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:45.054289 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb2d82-7548-498f-a813-be3be5b3a9bc service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:45.054627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb2d82-7548-498f-a813-be3be5b3a9bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:45.068974 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb2d82-7548-498f-a813-be3be5b3a9bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:35:45.070716 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb2d82-7548-498f-a813-be3be5b3a9bc service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:35:45.081774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1029/2051] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 31 12:35:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 12:35:45.816857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a670b76-7dd0-4da7-8400-ec28aa61efc9 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:45.817365 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a670b76-7dd0-4da7-8400-ec28aa61efc9 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:45.817458 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a670b76-7dd0-4da7-8400-ec28aa61efc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:45.842870 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-7a670b76-7dd0-4da7-8400-ec28aa61efc9 None None] MFA Rules not processed for user `912693f459f147a5a479ad01e2e8387a`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:35:45.844173 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-7a670b76-7dd0-4da7-8400-ec28aa61efc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:45.851672 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1023/2052] 10.222.0.18 () {58 vars in 967 bytes} [Mon Oct 31 12:35:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:35:45.866134 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb2d82-7548-498f-a813-be3be5b3a9bc service swift] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:35:45.877825 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb2d82-7548-498f-a813-be3be5b3a9bc service swift] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:35:45.883099 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2fb94-c39a-4e70-8dde-7e26ed1ac76d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188c4989dcfb4f99a04c3349e1a882d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:35:45.883823 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2fb94-c39a-4e70-8dde-7e26ed1ac76d service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:45.884278 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2fb94-c39a-4e70-8dde-7e26ed1ac76d service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:45.884631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2fb94-c39a-4e70-8dde-7e26ed1ac76d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:45.893293 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2fb94-c39a-4e70-8dde-7e26ed1ac76d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:35:45.894981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2fb94-c39a-4e70-8dde-7e26ed1ac76d service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:35:45.904125 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1030/2053] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 31 12:35:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 12:35:46.383086 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98b0e3-48e1-459b-8775-0b6122cd686b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:46.383423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98b0e3-48e1-459b-8775-0b6122cd686b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:46.383898 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98b0e3-48e1-459b-8775-0b6122cd686b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:46.406221 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3c98b0e3-48e1-459b-8775-0b6122cd686b None None] MFA Rules not processed for user `912693f459f147a5a479ad01e2e8387a`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:35:46.407435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3c98b0e3-48e1-459b-8775-0b6122cd686b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:46.416767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1024/2054] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 31 12:35:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:35:46.428296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2fb94-c39a-4e70-8dde-7e26ed1ac76d service swift] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:35:46.444522 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2fb94-c39a-4e70-8dde-7e26ed1ac76d service swift] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:35:46.450971 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fab4cb-ef8b-4ade-8396-720854dc1359 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188c4989dcfb4f99a04c3349e1a882d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:35:46.451668 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fab4cb-ef8b-4ade-8396-720854dc1359 service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:46.452173 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fab4cb-ef8b-4ade-8396-720854dc1359 service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:46.452512 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fab4cb-ef8b-4ade-8396-720854dc1359 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:46.459908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:46.462739 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fab4cb-ef8b-4ade-8396-720854dc1359 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:35:46.464391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fab4cb-ef8b-4ade-8396-720854dc1359 service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:35:46.480437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1031/2055] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 31 12:35:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 12:35:47.196615 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddaa027-d767-4860-8f33-13b2d256c88c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:47.197218 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddaa027-d767-4860-8f33-13b2d256c88c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:47.197218 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddaa027-d767-4860-8f33-13b2d256c88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:47.217479 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-dddaa027-d767-4860-8f33-13b2d256c88c None None] MFA Rules not processed for user `912693f459f147a5a479ad01e2e8387a`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:35:47.218743 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-dddaa027-d767-4860-8f33-13b2d256c88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:47.227778 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1025/2056] 10.222.0.18 () {58 vars in 967 bytes} [Mon Oct 31 12:35:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:35:47.260943 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fab4cb-ef8b-4ade-8396-720854dc1359 service swift] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:35:47.271502 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fab4cb-ef8b-4ade-8396-720854dc1359 service swift] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:35:47.277190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f8f95-0b11-4a17-aea0-506ae4496e89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188c4989dcfb4f99a04c3349e1a882d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:35:47.277791 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f8f95-0b11-4a17-aea0-506ae4496e89 service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:47.278073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f8f95-0b11-4a17-aea0-506ae4496e89 service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:47.278478 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f8f95-0b11-4a17-aea0-506ae4496e89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:47.286924 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f8f95-0b11-4a17-aea0-506ae4496e89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:35:47.288505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f8f95-0b11-4a17-aea0-506ae4496e89 service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:35:47.296886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1032/2057] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 31 12:35:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 12:35:48.552205 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07915be-1911-4a51-b73d-54949e25ffb2 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:48.552632 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07915be-1911-4a51-b73d-54949e25ffb2 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:48.552753 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07915be-1911-4a51-b73d-54949e25ffb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:48.576126 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d07915be-1911-4a51-b73d-54949e25ffb2 None None] MFA Rules not processed for user `912693f459f147a5a479ad01e2e8387a`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:35:48.577678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d07915be-1911-4a51-b73d-54949e25ffb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:48.589186 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1026/2058] 10.222.0.18 () {58 vars in 967 bytes} [Mon Oct 31 12:35:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:35:48.603720 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f8f95-0b11-4a17-aea0-506ae4496e89 service swift] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:35:48.616597 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f8f95-0b11-4a17-aea0-506ae4496e89 service swift] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:35:48.622677 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e8222-3755-494a-b6a2-5b1dad44e985 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188c4989dcfb4f99a04c3349e1a882d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:35:48.623634 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e8222-3755-494a-b6a2-5b1dad44e985 service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:48.624080 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e8222-3755-494a-b6a2-5b1dad44e985 service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:48.624370 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e8222-3755-494a-b6a2-5b1dad44e985 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:48.634944 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e8222-3755-494a-b6a2-5b1dad44e985 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:35:48.637133 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e8222-3755-494a-b6a2-5b1dad44e985 service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:35:48.653686 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1033/2059] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 31 12:35:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 12:35:49.548364 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07915be-1911-4a51-b73d-54949e25ffb2 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:35:49.549925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d07915be-1911-4a51-b73d-54949e25ffb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:49.620847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07915be-1911-4a51-b73d-54949e25ffb2 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:35:49.625425 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403a346-c293-4290-977f-49881c2afbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:35:49.626053 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403a346-c293-4290-977f-49881c2afbd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:49.626335 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403a346-c293-4290-977f-49881c2afbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:49.626611 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403a346-c293-4290-977f-49881c2afbd1 admin admin] PATH_INFO: `/v3/users/5ee1912a3e434ca4be2fba450735ad37` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:49.627743 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403a346-c293-4290-977f-49881c2afbd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee1912a3e434ca4be2fba450735ad37)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:35:49.629698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403a346-c293-4290-977f-49881c2afbd1 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:35:49.677200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0403a346-c293-4290-977f-49881c2afbd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee1912a3e434ca4be2fba450735ad37'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:49.677857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0403a346-c293-4290-977f-49881c2afbd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee1912a3e434ca4be2fba450735ad37'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:49.678481 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0403a346-c293-4290-977f-49881c2afbd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee1912a3e434ca4be2fba450735ad37'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:49.685281 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0403a346-c293-4290-977f-49881c2afbd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee1912a3e434ca4be2fba450735ad37'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:49.692295 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0403a346-c293-4290-977f-49881c2afbd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee1912a3e434ca4be2fba450735ad37'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:49.706154 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:35:49.713212 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1027/2060] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:35:49 2022] DELETE /identity/v3/users/5ee1912a3e434ca4be2fba450735ad37 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:35:49.717630 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637d375-af66-4f1e-b028-ac643cb2764f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:49.718098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637d375-af66-4f1e-b028-ac643cb2764f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:49.718222 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637d375-af66-4f1e-b028-ac643cb2764f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:49.737022 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1637d375-af66-4f1e-b028-ac643cb2764f None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:35:49.738247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1637d375-af66-4f1e-b028-ac643cb2764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:49.796319 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1034/2061] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:35:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:35:49.806734 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403a346-c293-4290-977f-49881c2afbd1 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:35:49.808117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0403a346-c293-4290-977f-49881c2afbd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:49.865755 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403a346-c293-4290-977f-49881c2afbd1 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:35:49.869377 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06ecd8-1fbb-4ad5-ad66-10a0e7854adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:35:49.869978 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06ecd8-1fbb-4ad5-ad66-10a0e7854adc service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:49.870260 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06ecd8-1fbb-4ad5-ad66-10a0e7854adc service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:49.870534 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06ecd8-1fbb-4ad5-ad66-10a0e7854adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:49.879797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06ecd8-1fbb-4ad5-ad66-10a0e7854adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:35:49.881277 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06ecd8-1fbb-4ad5-ad66-10a0e7854adc service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:35:49.891663 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1028/2062] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:35:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:35:50.042001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14d161-40a1-4ef7-92fc-34ae87f8c34e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:50.042828 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14d161-40a1-4ef7-92fc-34ae87f8c34e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:50.043456 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14d161-40a1-4ef7-92fc-34ae87f8c34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:50.078470 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8b14d161-40a1-4ef7-92fc-34ae87f8c34e None None] MFA Rules not processed for user `e691a4a9d905492ca80887f0e955e9d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:35:50.079500 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8b14d161-40a1-4ef7-92fc-34ae87f8c34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:50.164105 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1035/2063] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:35:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:35:50.170570 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06ecd8-1fbb-4ad5-ad66-10a0e7854adc service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:35:50.172241 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-cf06ecd8-1fbb-4ad5-ad66-10a0e7854adc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:50.214860 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06ecd8-1fbb-4ad5-ad66-10a0e7854adc service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:35:50.226657 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e38cd4-9960-43b1-a0ff-30f937ebc2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:35:50.227843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e38cd4-9960-43b1-a0ff-30f937ebc2c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:50.228127 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e38cd4-9960-43b1-a0ff-30f937ebc2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:50.228409 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e38cd4-9960-43b1-a0ff-30f937ebc2c4 admin admin] PATH_INFO: `/v3/projects/4773d6f95d734634a23a07b176671cbc` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:50.229702 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e38cd4-9960-43b1-a0ff-30f937ebc2c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4773d6f95d734634a23a07b176671cbc)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:35:50.231734 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e38cd4-9960-43b1-a0ff-30f937ebc2c4 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:35:50.281302 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b2e38cd4-9960-43b1-a0ff-30f937ebc2c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4773d6f95d734634a23a07b176671cbc', 'request_id': 'req-b2e38cd4-9960-43b1-a0ff-30f937ebc2c4'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:50.287021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b2e38cd4-9960-43b1-a0ff-30f937ebc2c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4773d6f95d734634a23a07b176671cbc', 'request_id': 'req-b2e38cd4-9960-43b1-a0ff-30f937ebc2c4'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:50.294117 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b2e38cd4-9960-43b1-a0ff-30f937ebc2c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4773d6f95d734634a23a07b176671cbc', 'request_id': 'req-b2e38cd4-9960-43b1-a0ff-30f937ebc2c4'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:50.307715 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b2e38cd4-9960-43b1-a0ff-30f937ebc2c4 admin admin] The token cache is being invalidate because project 4773d6f95d734634a23a07b176671cbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:35:50.308003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b2e38cd4-9960-43b1-a0ff-30f937ebc2c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:50.308632 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b2e38cd4-9960-43b1-a0ff-30f937ebc2c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:35:50.310166 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1029/2064] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:35:50 2022] DELETE /identity/v3/projects/4773d6f95d734634a23a07b176671cbc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:35:57.556039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bce84-5755-47e1-9d56-0c9a56f1afd7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:35:57.556572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bce84-5755-47e1-9d56-0c9a56f1afd7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:35:57.556691 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bce84-5755-47e1-9d56-0c9a56f1afd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:35:57.579906 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3a6bce84-5755-47e1-9d56-0c9a56f1afd7 None None] MFA Rules not processed for user `459bb7dfc62346c8b2081de02ccb12df`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:35:57.581300 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3a6bce84-5755-47e1-9d56-0c9a56f1afd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:35:57.636917 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1036/2065] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:35:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:36:00.304545 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:36:07.629828 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:36:08.140513 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dec1dd-cfe0-42e0-8082-41c5394b5835 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:08.141053 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dec1dd-cfe0-42e0-8082-41c5394b5835 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:08.141205 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dec1dd-cfe0-42e0-8082-41c5394b5835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:08.161532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-82dec1dd-cfe0-42e0-8082-41c5394b5835 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:36:08.162729 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-82dec1dd-cfe0-42e0-8082-41c5394b5835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:36:08.219977 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1030/2066] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 31 12:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:36:08.233574 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bce84-5755-47e1-9d56-0c9a56f1afd7 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:36:08.235011 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3a6bce84-5755-47e1-9d56-0c9a56f1afd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:36:08.308087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bce84-5755-47e1-9d56-0c9a56f1afd7 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:36:08.313603 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d35efc-9f78-461e-89a9-483437a142cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:36:08.314210 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d35efc-9f78-461e-89a9-483437a142cb service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:08.314491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d35efc-9f78-461e-89a9-483437a142cb service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:08.314765 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d35efc-9f78-461e-89a9-483437a142cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:08.323378 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d35efc-9f78-461e-89a9-483437a142cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:36:08.324932 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d35efc-9f78-461e-89a9-483437a142cb service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:36:08.334473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1037/2067] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:36:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:36:12.477592 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34f5ac-6b76-49ea-b42d-382282f5e763 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:12.478113 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34f5ac-6b76-49ea-b42d-382282f5e763 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:12.478209 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34f5ac-6b76-49ea-b42d-382282f5e763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:12.497634 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ca34f5ac-6b76-49ea-b42d-382282f5e763 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:36:12.498814 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ca34f5ac-6b76-49ea-b42d-382282f5e763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:36:12.506937 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1031/2068] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 31 12:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:36:12.520990 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d35efc-9f78-461e-89a9-483437a142cb service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:36:12.522504 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-55d35efc-9f78-461e-89a9-483437a142cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:36:12.536773 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d35efc-9f78-461e-89a9-483437a142cb service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:36:12.542456 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5372c-aa06-48ab-b05b-123d01909fbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:36:12.543044 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5372c-aa06-48ab-b05b-123d01909fbe service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:12.543325 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5372c-aa06-48ab-b05b-123d01909fbe service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:12.543597 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5372c-aa06-48ab-b05b-123d01909fbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:12.551477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5372c-aa06-48ab-b05b-123d01909fbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:36:12.553070 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5372c-aa06-48ab-b05b-123d01909fbe service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:36:12.563281 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1038/2069] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:36:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:36:15.540652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53690f27-24f9-454f-9734-9575897143e3 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:15.541433 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53690f27-24f9-454f-9734-9575897143e3 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:15.541530 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53690f27-24f9-454f-9734-9575897143e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:15.561495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-53690f27-24f9-454f-9734-9575897143e3 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:36:15.562694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-53690f27-24f9-454f-9734-9575897143e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:36:15.571234 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1032/2070] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 31 12:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:36:15.587459 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5372c-aa06-48ab-b05b-123d01909fbe service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:36:15.598455 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5372c-aa06-48ab-b05b-123d01909fbe service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:36:15.603881 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802aeba3-bba5-4dab-9847-7c1b99c03d29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:36:15.604467 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802aeba3-bba5-4dab-9847-7c1b99c03d29 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:15.604746 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802aeba3-bba5-4dab-9847-7c1b99c03d29 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:15.605019 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802aeba3-bba5-4dab-9847-7c1b99c03d29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:15.612900 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802aeba3-bba5-4dab-9847-7c1b99c03d29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:36:15.614497 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802aeba3-bba5-4dab-9847-7c1b99c03d29 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:36:15.624115 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1039/2071] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:36:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:36:18.688247 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ba919-6216-44c5-a7d6-26e8330df73a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:18.688708 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ba919-6216-44c5-a7d6-26e8330df73a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:18.688810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ba919-6216-44c5-a7d6-26e8330df73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:18.708405 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-582ba919-6216-44c5-a7d6-26e8330df73a None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:36:18.709624 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-582ba919-6216-44c5-a7d6-26e8330df73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:36:18.717590 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1033/2072] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 31 12:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:36:18.732672 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802aeba3-bba5-4dab-9847-7c1b99c03d29 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:36:18.744198 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802aeba3-bba5-4dab-9847-7c1b99c03d29 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:36:18.749583 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddf9ec-e99d-43b3-a578-ac39e70b2271 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:36:18.750169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddf9ec-e99d-43b3-a578-ac39e70b2271 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:18.750444 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddf9ec-e99d-43b3-a578-ac39e70b2271 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:18.750712 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddf9ec-e99d-43b3-a578-ac39e70b2271 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:18.759177 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ddf9ec-e99d-43b3-a578-ac39e70b2271 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:36:18.760722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ddf9ec-e99d-43b3-a578-ac39e70b2271 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:36:18.769934 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1040/2073] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:36:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:36:21.867799 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297144d6-73b5-4f6a-8f2c-c62a8cd1f064 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:21.868330 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297144d6-73b5-4f6a-8f2c-c62a8cd1f064 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:21.868330 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297144d6-73b5-4f6a-8f2c-c62a8cd1f064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:21.887880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-297144d6-73b5-4f6a-8f2c-c62a8cd1f064 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:36:21.889052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-297144d6-73b5-4f6a-8f2c-c62a8cd1f064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:36:21.896633 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1034/2074] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Oct 31 12:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:36:21.916768 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddf9ec-e99d-43b3-a578-ac39e70b2271 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:36:21.927755 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddf9ec-e99d-43b3-a578-ac39e70b2271 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:36:21.933789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776eb0b5-8040-4039-8341-bd1635657218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:36:21.934376 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776eb0b5-8040-4039-8341-bd1635657218 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:21.934658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776eb0b5-8040-4039-8341-bd1635657218 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:21.934932 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776eb0b5-8040-4039-8341-bd1635657218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:21.943286 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776eb0b5-8040-4039-8341-bd1635657218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:36:21.944851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776eb0b5-8040-4039-8341-bd1635657218 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:36:21.954178 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1041/2075] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:36:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:36:24.014614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5886877-d005-44f5-918b-9c1f493c1c90 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:24.015145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5886877-d005-44f5-918b-9c1f493c1c90 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:24.015145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5886877-d005-44f5-918b-9c1f493c1c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:24.033860 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-c5886877-d005-44f5-918b-9c1f493c1c90 None None] MFA Rules not processed for user `d1c036fa4872485e903820d848089e02`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:36:24.035039 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c5886877-d005-44f5-918b-9c1f493c1c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:36:24.089500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1035/2076] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:36:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:36:31.950029 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=58 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:36:34.082279 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=64 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:36:41.497435 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bac4f7-dd42-4c59-bffa-0a7fff9b843a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:41.497989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bac4f7-dd42-4c59-bffa-0a7fff9b843a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:41.497989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bac4f7-dd42-4c59-bffa-0a7fff9b843a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:41.516966 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-11bac4f7-dd42-4c59-bffa-0a7fff9b843a None None] MFA Rules not processed for user `5a9e86876ed8467cb1fad623af5c8d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:36:41.518194 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-11bac4f7-dd42-4c59-bffa-0a7fff9b843a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:36:41.571562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1042/2077] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:36:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:36:51.564573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=25 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:36:56.791221 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5886877-d005-44f5-918b-9c1f493c1c90 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:36:56.793016 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c5886877-d005-44f5-918b-9c1f493c1c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:36:56.807013 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5886877-d005-44f5-918b-9c1f493c1c90 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:36:56.811470 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcadcc-2c2a-4afc-b6f5-39f450726ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:36:56.812089 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcadcc-2c2a-4afc-b6f5-39f450726ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:56.812365 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcadcc-2c2a-4afc-b6f5-39f450726ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:56.812635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcadcc-2c2a-4afc-b6f5-39f450726ad3 admin admin] PATH_INFO: `/v3/users/e691a4a9d905492ca80887f0e955e9d3` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:56.813795 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcadcc-2c2a-4afc-b6f5-39f450726ad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e691a4a9d905492ca80887f0e955e9d3)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:36:56.815692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcadcc-2c2a-4afc-b6f5-39f450726ad3 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:36:56.861507 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dedcadcc-2c2a-4afc-b6f5-39f450726ad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e691a4a9d905492ca80887f0e955e9d3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:36:56.862147 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dedcadcc-2c2a-4afc-b6f5-39f450726ad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e691a4a9d905492ca80887f0e955e9d3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:36:56.862765 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dedcadcc-2c2a-4afc-b6f5-39f450726ad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e691a4a9d905492ca80887f0e955e9d3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:36:56.870610 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dedcadcc-2c2a-4afc-b6f5-39f450726ad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e691a4a9d905492ca80887f0e955e9d3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:36:56.877470 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dedcadcc-2c2a-4afc-b6f5-39f450726ad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e691a4a9d905492ca80887f0e955e9d3'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:36:56.895249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1036/2078] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:36:56 2022] DELETE /identity/v3/users/e691a4a9d905492ca80887f0e955e9d3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:36:57.061820 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bac4f7-dd42-4c59-bffa-0a7fff9b843a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:36:57.075080 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bac4f7-dd42-4c59-bffa-0a7fff9b843a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:36:57.132063 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f796fd-985c-454f-9001-8d85c22bef78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:36:57.132620 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f796fd-985c-454f-9001-8d85c22bef78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:57.133215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f796fd-985c-454f-9001-8d85c22bef78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:57.133496 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f796fd-985c-454f-9001-8d85c22bef78 admin admin] PATH_INFO: `/v3/projects/45f126e4185442768ff89ae8e1109e08` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:57.134634 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f796fd-985c-454f-9001-8d85c22bef78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45f126e4185442768ff89ae8e1109e08)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:36:57.136610 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f796fd-985c-454f-9001-8d85c22bef78 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:36:57.182618 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-74f796fd-985c-454f-9001-8d85c22bef78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45f126e4185442768ff89ae8e1109e08', 'request_id': 'req-74f796fd-985c-454f-9001-8d85c22bef78'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:36:57.189745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-74f796fd-985c-454f-9001-8d85c22bef78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45f126e4185442768ff89ae8e1109e08', 'request_id': 'req-74f796fd-985c-454f-9001-8d85c22bef78'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:36:57.195254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-74f796fd-985c-454f-9001-8d85c22bef78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45f126e4185442768ff89ae8e1109e08', 'request_id': 'req-74f796fd-985c-454f-9001-8d85c22bef78'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:36:57.206008 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-74f796fd-985c-454f-9001-8d85c22bef78 admin admin] The token cache is being invalidate because project 45f126e4185442768ff89ae8e1109e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:36:57.206303 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-74f796fd-985c-454f-9001-8d85c22bef78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:36:57.206935 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-74f796fd-985c-454f-9001-8d85c22bef78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:36:57.208447 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1043/2079] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:36:57 2022] DELETE /identity/v3/projects/45f126e4185442768ff89ae8e1109e08 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:36:57.213255 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e33aa-f832-404e-a547-aac066feab06 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:57.213565 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e33aa-f832-404e-a547-aac066feab06 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:57.213840 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e33aa-f832-404e-a547-aac066feab06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:57.233460 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e64e33aa-f832-404e-a547-aac066feab06 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:36:57.234644 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e64e33aa-f832-404e-a547-aac066feab06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:36:57.292493 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1037/2080] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:36:57.300027 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1bc19-bf61-48b3-be69-17ed76d09e6a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:57.300322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1bc19-bf61-48b3-be69-17ed76d09e6a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:57.300590 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1bc19-bf61-48b3-be69-17ed76d09e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:57.320587 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-30c1bc19-bf61-48b3-be69-17ed76d09e6a None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:36:57.321841 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-30c1bc19-bf61-48b3-be69-17ed76d09e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:36:57.329531 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1044/2081] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:36:57.333567 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e33aa-f832-404e-a547-aac066feab06 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:36:57.343022 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e33aa-f832-404e-a547-aac066feab06 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:36:57.347542 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848158e6-935b-4019-8547-06e8f4f645db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:36:57.348124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848158e6-935b-4019-8547-06e8f4f645db admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:57.348401 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848158e6-935b-4019-8547-06e8f4f645db admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:57.348672 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848158e6-935b-4019-8547-06e8f4f645db admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:57.349344 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848158e6-935b-4019-8547-06e8f4f645db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:36:57.349644 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848158e6-935b-4019-8547-06e8f4f645db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:36:57.351215 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848158e6-935b-4019-8547-06e8f4f645db admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:36:57.362969 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1038/2082] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:36:57.366973 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1bc19-bf61-48b3-be69-17ed76d09e6a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:36:57.376711 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1bc19-bf61-48b3-be69-17ed76d09e6a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:36:57.381438 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d744ce-a2d3-4b4b-9177-9323fbd09f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:36:57.382048 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d744ce-a2d3-4b4b-9177-9323fbd09f54 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:57.382366 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d744ce-a2d3-4b4b-9177-9323fbd09f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:57.382589 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d744ce-a2d3-4b4b-9177-9323fbd09f54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:57.383217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d744ce-a2d3-4b4b-9177-9323fbd09f54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:36:57.385090 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d744ce-a2d3-4b4b-9177-9323fbd09f54 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:36:57.411401 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1045/2083] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:36:57 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:36:57.415314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848158e6-935b-4019-8547-06e8f4f645db admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:36:57.425955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848158e6-935b-4019-8547-06e8f4f645db admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:36:57.480182 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa8092-ac6a-4067-ae80-c8336d8090b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:36:57.480769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa8092-ac6a-4067-ae80-c8336d8090b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:57.481048 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa8092-ac6a-4067-ae80-c8336d8090b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:57.481347 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa8092-ac6a-4067-ae80-c8336d8090b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:57.481962 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa8092-ac6a-4067-ae80-c8336d8090b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:36:57.483841 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa8092-ac6a-4067-ae80-c8336d8090b4 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:36:57.491633 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:36:57.509031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1039/2084] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:36:57 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:36:57.510269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d744ce-a2d3-4b4b-9177-9323fbd09f54 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:36:57.520500 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d744ce-a2d3-4b4b-9177-9323fbd09f54 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:36:57.525730 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7355f-aa57-469a-a03d-330be0dfa60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:36:57.526339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7355f-aa57-469a-a03d-330be0dfa60e admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:57.526619 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7355f-aa57-469a-a03d-330be0dfa60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:57.526895 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7355f-aa57-469a-a03d-330be0dfa60e admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:57.527900 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7355f-aa57-469a-a03d-330be0dfa60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:36:57.529153 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7355f-aa57-469a-a03d-330be0dfa60e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:36:57.544193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1046/2085] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:36:57.545559 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa8092-ac6a-4067-ae80-c8336d8090b4 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:36:57.556155 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa8092-ac6a-4067-ae80-c8336d8090b4 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:36:57.560705 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42670f5b-45b4-4163-90e6-b4f8cbf9b400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:36:57.561331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42670f5b-45b4-4163-90e6-b4f8cbf9b400 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:57.561613 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42670f5b-45b4-4163-90e6-b4f8cbf9b400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:57.561888 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42670f5b-45b4-4163-90e6-b4f8cbf9b400 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:57.562532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42670f5b-45b4-4163-90e6-b4f8cbf9b400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:36:57.564115 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42670f5b-45b4-4163-90e6-b4f8cbf9b400 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:36:57.577415 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1040/2086] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:36:57.581322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7355f-aa57-469a-a03d-330be0dfa60e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:36:57.591765 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7355f-aa57-469a-a03d-330be0dfa60e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:36:57.596346 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a4588-e805-42ef-8eba-b4d362081fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:36:57.596989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a4588-e805-42ef-8eba-b4d362081fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:57.597291 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a4588-e805-42ef-8eba-b4d362081fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:57.597562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a4588-e805-42ef-8eba-b4d362081fc8 admin admin] PATH_INFO: `/v3/projects/ad92f4444abd4234966c1d4798e614cf/users/4799f2b648de4838bffbe906eaf29d3e/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:57.613453 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a4588-e805-42ef-8eba-b4d362081fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad92f4444abd4234966c1d4798e614cf, user_id=4799f2b648de4838bffbe906eaf29d3e, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:36:57.616185 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a4588-e805-42ef-8eba-b4d362081fc8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:36:57.628532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1047/2087] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:36:57 2022] PUT /identity/v3/projects/ad92f4444abd4234966c1d4798e614cf/users/4799f2b648de4838bffbe906eaf29d3e/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:36:57.640114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e1474-c4a3-42df-a3b0-17e15d2f4476 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:57.640340 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e1474-c4a3-42df-a3b0-17e15d2f4476 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:57.640614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e1474-c4a3-42df-a3b0-17e15d2f4476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:57.669227 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-259e1474-c4a3-42df-a3b0-17e15d2f4476 None None] MFA Rules not processed for user `4799f2b648de4838bffbe906eaf29d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:36:57.670452 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-259e1474-c4a3-42df-a3b0-17e15d2f4476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:36:57.732972 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1041/2088] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:36:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:36:57.744079 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a4588-e805-42ef-8eba-b4d362081fc8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:36:57.745764 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-974a4588-e805-42ef-8eba-b4d362081fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:36:57.775805 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:36:57.803881 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a4588-e805-42ef-8eba-b4d362081fc8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:36:57.807505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f4aca-8cf3-4505-a8b6-fdc7737fef8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:36:57.808100 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f4aca-8cf3-4505-a8b6-fdc7737fef8a service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:36:57.808375 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f4aca-8cf3-4505-a8b6-fdc7737fef8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:36:57.808643 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f4aca-8cf3-4505-a8b6-fdc7737fef8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:36:57.816638 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f4aca-8cf3-4505-a8b6-fdc7737fef8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:36:57.818058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f4aca-8cf3-4505-a8b6-fdc7737fef8a service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:36:57.827142 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1048/2089] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:36:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:37:07.730037 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:07.823297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=14 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:07.866924 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e1474-c4a3-42df-a3b0-17e15d2f4476 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:07.945266 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e1474-c4a3-42df-a3b0-17e15d2f4476 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:07.950524 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158a0c6-2876-4cd7-870b-aaffceee2626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:07.951154 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158a0c6-2876-4cd7-870b-aaffceee2626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:07.951432 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158a0c6-2876-4cd7-870b-aaffceee2626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:07.951702 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158a0c6-2876-4cd7-870b-aaffceee2626 admin admin] PATH_INFO: `/v3/users/4799f2b648de4838bffbe906eaf29d3e` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:07.952818 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158a0c6-2876-4cd7-870b-aaffceee2626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4799f2b648de4838bffbe906eaf29d3e)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:07.954751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158a0c6-2876-4cd7-870b-aaffceee2626 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:08.001346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0158a0c6-2876-4cd7-870b-aaffceee2626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4799f2b648de4838bffbe906eaf29d3e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:08.001996 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0158a0c6-2876-4cd7-870b-aaffceee2626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4799f2b648de4838bffbe906eaf29d3e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:08.002651 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0158a0c6-2876-4cd7-870b-aaffceee2626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4799f2b648de4838bffbe906eaf29d3e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:08.009832 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0158a0c6-2876-4cd7-870b-aaffceee2626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4799f2b648de4838bffbe906eaf29d3e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:08.018162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0158a0c6-2876-4cd7-870b-aaffceee2626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4799f2b648de4838bffbe906eaf29d3e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:08.035801 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1042/2090] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:37:07 2022] DELETE /identity/v3/users/4799f2b648de4838bffbe906eaf29d3e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:37:08.040201 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259c791-09a8-4589-96e7-82d2fad672d1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:08.041134 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259c791-09a8-4589-96e7-82d2fad672d1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:08.041698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259c791-09a8-4589-96e7-82d2fad672d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:08.060781 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6259c791-09a8-4589-96e7-82d2fad672d1 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:37:08.062522 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6259c791-09a8-4589-96e7-82d2fad672d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:08.124033 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1049/2091] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:37:08.133793 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158a0c6-2876-4cd7-870b-aaffceee2626 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:08.135227 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0158a0c6-2876-4cd7-870b-aaffceee2626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:08.193345 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158a0c6-2876-4cd7-870b-aaffceee2626 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:08.197015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ab3b7-1de8-4480-985a-fb3b4d8d5de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:08.197672 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ab3b7-1de8-4480-985a-fb3b4d8d5de0 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:08.197953 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ab3b7-1de8-4480-985a-fb3b4d8d5de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:08.198224 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ab3b7-1de8-4480-985a-fb3b4d8d5de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:08.207448 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ab3b7-1de8-4480-985a-fb3b4d8d5de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:08.208872 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ab3b7-1de8-4480-985a-fb3b4d8d5de0 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:08.219273 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1043/2092] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:37:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:37:08.498144 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259c791-09a8-4589-96e7-82d2fad672d1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:08.499656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6259c791-09a8-4589-96e7-82d2fad672d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:08.514250 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259c791-09a8-4589-96e7-82d2fad672d1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:08.520568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205eb82-80e0-4049-9a05-a72101e6150d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:08.521516 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205eb82-80e0-4049-9a05-a72101e6150d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:08.526696 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205eb82-80e0-4049-9a05-a72101e6150d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:08.527107 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205eb82-80e0-4049-9a05-a72101e6150d admin admin] PATH_INFO: `/v3/projects/ad92f4444abd4234966c1d4798e614cf` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:08.529766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205eb82-80e0-4049-9a05-a72101e6150d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad92f4444abd4234966c1d4798e614cf)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:08.532058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205eb82-80e0-4049-9a05-a72101e6150d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:08.593379 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f205eb82-80e0-4049-9a05-a72101e6150d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad92f4444abd4234966c1d4798e614cf', 'request_id': 'req-f205eb82-80e0-4049-9a05-a72101e6150d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:08.603131 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f205eb82-80e0-4049-9a05-a72101e6150d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad92f4444abd4234966c1d4798e614cf', 'request_id': 'req-f205eb82-80e0-4049-9a05-a72101e6150d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:08.609484 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f205eb82-80e0-4049-9a05-a72101e6150d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad92f4444abd4234966c1d4798e614cf', 'request_id': 'req-f205eb82-80e0-4049-9a05-a72101e6150d'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:08.621721 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f205eb82-80e0-4049-9a05-a72101e6150d admin admin] The token cache is being invalidate because project ad92f4444abd4234966c1d4798e614cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:37:08.622014 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f205eb82-80e0-4049-9a05-a72101e6150d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:08.622670 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f205eb82-80e0-4049-9a05-a72101e6150d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:08.624170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1050/2093] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:37:08 2022] DELETE /identity/v3/projects/ad92f4444abd4234966c1d4798e614cf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:37:08.628953 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf3e5b-42a9-4132-bd20-a70bbab96c8a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:08.629272 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf3e5b-42a9-4132-bd20-a70bbab96c8a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:08.629550 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf3e5b-42a9-4132-bd20-a70bbab96c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:08.652331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-76bf3e5b-42a9-4132-bd20-a70bbab96c8a None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:37:08.655068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-76bf3e5b-42a9-4132-bd20-a70bbab96c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:08.677422 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:08.729207 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1044/2094] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:37:08.736851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c51a71-fbdb-4ed2-aa5f-0f49b3af4735 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:08.737197 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c51a71-fbdb-4ed2-aa5f-0f49b3af4735 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:08.737446 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c51a71-fbdb-4ed2-aa5f-0f49b3af4735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:08.757408 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c7c51a71-fbdb-4ed2-aa5f-0f49b3af4735 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:37:08.760814 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c7c51a71-fbdb-4ed2-aa5f-0f49b3af4735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:08.769486 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1051/2095] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:37:08.773871 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf3e5b-42a9-4132-bd20-a70bbab96c8a None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:08.786860 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf3e5b-42a9-4132-bd20-a70bbab96c8a None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:08.793251 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde1d42-0e6d-4f31-8857-78a70a3f78b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:08.793866 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde1d42-0e6d-4f31-8857-78a70a3f78b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:08.794151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde1d42-0e6d-4f31-8857-78a70a3f78b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:08.794427 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde1d42-0e6d-4f31-8857-78a70a3f78b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:08.795115 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde1d42-0e6d-4f31-8857-78a70a3f78b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:37:08.795417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde1d42-0e6d-4f31-8857-78a70a3f78b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:08.797164 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde1d42-0e6d-4f31-8857-78a70a3f78b5 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:08.813912 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1045/2096] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:37:08.818205 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c51a71-fbdb-4ed2-aa5f-0f49b3af4735 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:08.828184 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c51a71-fbdb-4ed2-aa5f-0f49b3af4735 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:08.832971 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a156134-a614-4df3-a6bb-f0af86662d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:08.833611 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a156134-a614-4df3-a6bb-f0af86662d80 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:08.833894 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a156134-a614-4df3-a6bb-f0af86662d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:08.834168 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a156134-a614-4df3-a6bb-f0af86662d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:08.834800 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a156134-a614-4df3-a6bb-f0af86662d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:08.836732 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a156134-a614-4df3-a6bb-f0af86662d80 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:08.865961 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1052/2097] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:37:08 2022] POST /identity/v3/projects => generated 397 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:37:08.871144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde1d42-0e6d-4f31-8857-78a70a3f78b5 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:08.881349 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde1d42-0e6d-4f31-8857-78a70a3f78b5 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:08.940226 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0a6a0-688b-4f57-91f8-ae204cf11244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:08.940920 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0a6a0-688b-4f57-91f8-ae204cf11244 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:08.941325 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0a6a0-688b-4f57-91f8-ae204cf11244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:08.941653 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0a6a0-688b-4f57-91f8-ae204cf11244 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:08.942410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0a6a0-688b-4f57-91f8-ae204cf11244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:08.944520 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0a6a0-688b-4f57-91f8-ae204cf11244 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:08.967374 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1046/2098] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:37:08 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:37:08.971622 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a156134-a614-4df3-a6bb-f0af86662d80 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:08.982366 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a156134-a614-4df3-a6bb-f0af86662d80 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:08.987082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aede9ff-5f31-424e-a6a4-8d8432f37b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:08.987678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aede9ff-5f31-424e-a6a4-8d8432f37b0c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:08.987958 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aede9ff-5f31-424e-a6a4-8d8432f37b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:08.988342 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aede9ff-5f31-424e-a6a4-8d8432f37b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:08.988995 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aede9ff-5f31-424e-a6a4-8d8432f37b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:08.990662 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aede9ff-5f31-424e-a6a4-8d8432f37b0c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:09.004355 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1053/2099] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:37:09.005803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0a6a0-688b-4f57-91f8-ae204cf11244 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:09.016874 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0a6a0-688b-4f57-91f8-ae204cf11244 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:09.021670 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4ce38-c424-4c7b-9f67-4ba4d1e4b1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:09.022350 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4ce38-c424-4c7b-9f67-4ba4d1e4b1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:09.022713 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4ce38-c424-4c7b-9f67-4ba4d1e4b1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:09.023004 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4ce38-c424-4c7b-9f67-4ba4d1e4b1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:09.023656 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4ce38-c424-4c7b-9f67-4ba4d1e4b1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:09.025304 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4ce38-c424-4c7b-9f67-4ba4d1e4b1b9 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:09.036120 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1047/2100] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:37:09.039991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aede9ff-5f31-424e-a6a4-8d8432f37b0c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:09.052943 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aede9ff-5f31-424e-a6a4-8d8432f37b0c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:09.059331 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316e08c-d0bf-499b-b3c8-94ce218330a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:09.060001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316e08c-d0bf-499b-b3c8-94ce218330a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:09.060291 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316e08c-d0bf-499b-b3c8-94ce218330a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:09.060576 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316e08c-d0bf-499b-b3c8-94ce218330a7 admin admin] PATH_INFO: `/v3/projects/88a3c9596eef4706a592076444b11955/users/decaff2aae60477a9f22ab7434fc75af/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:09.079282 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316e08c-d0bf-499b-b3c8-94ce218330a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a3c9596eef4706a592076444b11955, user_id=decaff2aae60477a9f22ab7434fc75af, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:09.082231 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316e08c-d0bf-499b-b3c8-94ce218330a7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:09.095491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1054/2101] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:37:09 2022] PUT /identity/v3/projects/88a3c9596eef4706a592076444b11955/users/decaff2aae60477a9f22ab7434fc75af/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:37:09.107553 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42415d-8e76-42f9-8f3e-d4f2bfbf9080 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:09.107845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42415d-8e76-42f9-8f3e-d4f2bfbf9080 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:09.108124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42415d-8e76-42f9-8f3e-d4f2bfbf9080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:09.136948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ed42415d-8e76-42f9-8f3e-d4f2bfbf9080 None None] MFA Rules not processed for user `decaff2aae60477a9f22ab7434fc75af`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:37:09.138239 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ed42415d-8e76-42f9-8f3e-d4f2bfbf9080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:09.204339 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1048/2102] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:37:09 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:37:09.215711 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316e08c-d0bf-499b-b3c8-94ce218330a7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:09.217775 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2316e08c-d0bf-499b-b3c8-94ce218330a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:09.240750 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:09.285525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316e08c-d0bf-499b-b3c8-94ce218330a7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:09.289253 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00853079-3107-4758-b32a-de8e93814c2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:09.289961 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00853079-3107-4758-b32a-de8e93814c2e service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:09.290139 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00853079-3107-4758-b32a-de8e93814c2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:09.291044 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00853079-3107-4758-b32a-de8e93814c2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:09.301302 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00853079-3107-4758-b32a-de8e93814c2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:09.302771 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00853079-3107-4758-b32a-de8e93814c2e service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:09.315502 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1055/2103] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:37:09 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:37:09.730674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e8ecd-efbf-48c4-8d87-f6173fef64c2 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:09.730932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e8ecd-efbf-48c4-8d87-f6173fef64c2 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:09.731227 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e8ecd-efbf-48c4-8d87-f6173fef64c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:09.754834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-0d6e8ecd-efbf-48c4-8d87-f6173fef64c2 None None] MFA Rules not processed for user `459bb7dfc62346c8b2081de02ccb12df`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:37:09.756302 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0d6e8ecd-efbf-48c4-8d87-f6173fef64c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:09.771400 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:09.820225 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1049/2104] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:37:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:37:14.566901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00853079-3107-4758-b32a-de8e93814c2e service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:14.653579 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00853079-3107-4758-b32a-de8e93814c2e service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:14.661516 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c407a-dd53-4c3d-9024-ed1330db09e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:14.662237 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c407a-dd53-4c3d-9024-ed1330db09e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:14.662525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c407a-dd53-4c3d-9024-ed1330db09e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:14.662802 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c407a-dd53-4c3d-9024-ed1330db09e0 admin admin] PATH_INFO: `/v3/users/decaff2aae60477a9f22ab7434fc75af` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:14.664027 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c407a-dd53-4c3d-9024-ed1330db09e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=decaff2aae60477a9f22ab7434fc75af)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:14.666910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c407a-dd53-4c3d-9024-ed1330db09e0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:14.731424 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-065c407a-dd53-4c3d-9024-ed1330db09e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'decaff2aae60477a9f22ab7434fc75af'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:14.743114 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-065c407a-dd53-4c3d-9024-ed1330db09e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'decaff2aae60477a9f22ab7434fc75af'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:14.743931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-065c407a-dd53-4c3d-9024-ed1330db09e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'decaff2aae60477a9f22ab7434fc75af'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:14.761353 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-065c407a-dd53-4c3d-9024-ed1330db09e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'decaff2aae60477a9f22ab7434fc75af'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:14.770802 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-065c407a-dd53-4c3d-9024-ed1330db09e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'decaff2aae60477a9f22ab7434fc75af'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:14.789307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1056/2105] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:37:14 2022] DELETE /identity/v3/users/decaff2aae60477a9f22ab7434fc75af => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:37:14.792534 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e689eb-94e5-4eab-a3c8-7a2e58a20d3d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:14.793042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e689eb-94e5-4eab-a3c8-7a2e58a20d3d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:14.793547 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e689eb-94e5-4eab-a3c8-7a2e58a20d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:14.815303 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-05e689eb-94e5-4eab-a3c8-7a2e58a20d3d None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:37:14.816595 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-05e689eb-94e5-4eab-a3c8-7a2e58a20d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:14.887541 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1050/2106] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:37:14.894723 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c407a-dd53-4c3d-9024-ed1330db09e0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:14.896249 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-065c407a-dd53-4c3d-9024-ed1330db09e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:14.945391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:14.959028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c407a-dd53-4c3d-9024-ed1330db09e0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:14.963302 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dae0b-e87d-4607-9214-789ce32e6f0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:14.963917 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dae0b-e87d-4607-9214-789ce32e6f0f service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:14.964200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dae0b-e87d-4607-9214-789ce32e6f0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:14.964473 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dae0b-e87d-4607-9214-789ce32e6f0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:14.973645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dae0b-e87d-4607-9214-789ce32e6f0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:14.975071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dae0b-e87d-4607-9214-789ce32e6f0f service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:14.986671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1057/2107] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:37:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:37:15.361894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e689eb-94e5-4eab-a3c8-7a2e58a20d3d None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:15.364030 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-05e689eb-94e5-4eab-a3c8-7a2e58a20d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:15.382023 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e689eb-94e5-4eab-a3c8-7a2e58a20d3d None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:15.399138 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24c428-f7ec-48b6-a671-12598b747a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:15.400529 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24c428-f7ec-48b6-a671-12598b747a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:15.401477 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24c428-f7ec-48b6-a671-12598b747a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:15.401830 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24c428-f7ec-48b6-a671-12598b747a69 admin admin] PATH_INFO: `/v3/projects/88a3c9596eef4706a592076444b11955` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:15.403191 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24c428-f7ec-48b6-a671-12598b747a69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a3c9596eef4706a592076444b11955)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:15.405268 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24c428-f7ec-48b6-a671-12598b747a69 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:15.467698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4e24c428-f7ec-48b6-a671-12598b747a69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a3c9596eef4706a592076444b11955', 'request_id': 'req-4e24c428-f7ec-48b6-a671-12598b747a69'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:15.474547 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4e24c428-f7ec-48b6-a671-12598b747a69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a3c9596eef4706a592076444b11955', 'request_id': 'req-4e24c428-f7ec-48b6-a671-12598b747a69'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:15.481200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4e24c428-f7ec-48b6-a671-12598b747a69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a3c9596eef4706a592076444b11955', 'request_id': 'req-4e24c428-f7ec-48b6-a671-12598b747a69'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:15.495594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4e24c428-f7ec-48b6-a671-12598b747a69 admin admin] The token cache is being invalidate because project 88a3c9596eef4706a592076444b11955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:37:15.495919 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4e24c428-f7ec-48b6-a671-12598b747a69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:15.496555 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-4e24c428-f7ec-48b6-a671-12598b747a69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:15.498086 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1051/2108] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:37:15 2022] DELETE /identity/v3/projects/88a3c9596eef4706a592076444b11955 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:37:20.409575 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03f5fd-80d0-4551-a8e9-99dc70261390 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:20.410063 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03f5fd-80d0-4551-a8e9-99dc70261390 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:20.410176 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03f5fd-80d0-4551-a8e9-99dc70261390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:20.431748 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3f03f5fd-80d0-4551-a8e9-99dc70261390 None None] MFA Rules not processed for user `912693f459f147a5a479ad01e2e8387a`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:37:20.432943 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3f03f5fd-80d0-4551-a8e9-99dc70261390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:20.484777 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1058/2109] 10.222.0.18 () {58 vars in 967 bytes} [Mon Oct 31 12:37:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:37:20.530257 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24c428-f7ec-48b6-a671-12598b747a69 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:20.531686 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4e24c428-f7ec-48b6-a671-12598b747a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:20.579601 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:20.600441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24c428-f7ec-48b6-a671-12598b747a69 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:20.605844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bce834-f81d-4cb4-94f2-5530d776e381 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188c4989dcfb4f99a04c3349e1a882d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:20.606441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bce834-f81d-4cb4-94f2-5530d776e381 service swift] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:20.606718 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bce834-f81d-4cb4-94f2-5530d776e381 service swift] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:20.606986 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bce834-f81d-4cb4-94f2-5530d776e381 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:20.614718 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bce834-f81d-4cb4-94f2-5530d776e381 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:20.616280 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bce834-f81d-4cb4-94f2-5530d776e381 service swift] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:20.624780 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1052/2110] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 31 12:37:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 12:37:28.943263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03f5fd-80d0-4551-a8e9-99dc70261390 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:28.945390 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3f03f5fd-80d0-4551-a8e9-99dc70261390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:29.072457 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03f5fd-80d0-4551-a8e9-99dc70261390 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:29.077679 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54483323-bd79-4651-af07-6d8a34235986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:29.078751 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54483323-bd79-4651-af07-6d8a34235986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:29.078751 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54483323-bd79-4651-af07-6d8a34235986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:29.078952 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54483323-bd79-4651-af07-6d8a34235986 admin admin] PATH_INFO: `/v3/users/05a15a786fda4c7bb0a840f58d5b4a66` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:29.080009 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54483323-bd79-4651-af07-6d8a34235986 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a15a786fda4c7bb0a840f58d5b4a66)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:29.082049 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54483323-bd79-4651-af07-6d8a34235986 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:29.132999 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-54483323-bd79-4651-af07-6d8a34235986 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a15a786fda4c7bb0a840f58d5b4a66'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:29.141542 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-54483323-bd79-4651-af07-6d8a34235986 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a15a786fda4c7bb0a840f58d5b4a66'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:29.142242 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-54483323-bd79-4651-af07-6d8a34235986 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a15a786fda4c7bb0a840f58d5b4a66'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:29.155763 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-54483323-bd79-4651-af07-6d8a34235986 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a15a786fda4c7bb0a840f58d5b4a66'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:29.163757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-54483323-bd79-4651-af07-6d8a34235986 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a15a786fda4c7bb0a840f58d5b4a66'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:29.170298 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1059/2111] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:37:28 2022] DELETE /identity/v3/users/05a15a786fda4c7bb0a840f58d5b4a66 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:37:29.354086 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bce834-f81d-4cb4-94f2-5530d776e381 service swift] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:29.371214 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bce834-f81d-4cb4-94f2-5530d776e381 service swift] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:29.432413 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c9d36-cb77-45a8-8113-16b19eb9cbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:29.433072 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c9d36-cb77-45a8-8113-16b19eb9cbfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:29.433381 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c9d36-cb77-45a8-8113-16b19eb9cbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:29.433659 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c9d36-cb77-45a8-8113-16b19eb9cbfe admin admin] PATH_INFO: `/v3/projects/f72796dfb00148c29f1a31eb4c61c61c` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:29.434785 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c9d36-cb77-45a8-8113-16b19eb9cbfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=f72796dfb00148c29f1a31eb4c61c61c)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:29.436958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c9d36-cb77-45a8-8113-16b19eb9cbfe admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:29.487176 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-170c9d36-cb77-45a8-8113-16b19eb9cbfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f72796dfb00148c29f1a31eb4c61c61c', 'request_id': 'req-170c9d36-cb77-45a8-8113-16b19eb9cbfe'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:29.497469 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-170c9d36-cb77-45a8-8113-16b19eb9cbfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f72796dfb00148c29f1a31eb4c61c61c', 'request_id': 'req-170c9d36-cb77-45a8-8113-16b19eb9cbfe'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:29.504217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-170c9d36-cb77-45a8-8113-16b19eb9cbfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f72796dfb00148c29f1a31eb4c61c61c', 'request_id': 'req-170c9d36-cb77-45a8-8113-16b19eb9cbfe'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:29.517794 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-170c9d36-cb77-45a8-8113-16b19eb9cbfe admin admin] The token cache is being invalidate because project f72796dfb00148c29f1a31eb4c61c61c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:37:29.518084 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-170c9d36-cb77-45a8-8113-16b19eb9cbfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:29.518719 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-170c9d36-cb77-45a8-8113-16b19eb9cbfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:29.520223 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1053/2112] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:37:29 2022] DELETE /identity/v3/projects/f72796dfb00148c29f1a31eb4c61c61c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:37:29.524411 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54483323-bd79-4651-af07-6d8a34235986 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:29.525850 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-54483323-bd79-4651-af07-6d8a34235986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:29.538971 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54483323-bd79-4651-af07-6d8a34235986 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:29.544276 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:29.595780 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27142ef3-52a7-49b1-a330-8a78c81be535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:29.596406 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27142ef3-52a7-49b1-a330-8a78c81be535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:29.596683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27142ef3-52a7-49b1-a330-8a78c81be535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:29.596951 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27142ef3-52a7-49b1-a330-8a78c81be535 admin admin] PATH_INFO: `/v3/users/ceeacedb9ea5485c8cdd7d6531b7d54e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:29.598078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27142ef3-52a7-49b1-a330-8a78c81be535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceeacedb9ea5485c8cdd7d6531b7d54e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:29.599988 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27142ef3-52a7-49b1-a330-8a78c81be535 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:29.645412 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-27142ef3-52a7-49b1-a330-8a78c81be535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceeacedb9ea5485c8cdd7d6531b7d54e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:29.653016 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-27142ef3-52a7-49b1-a330-8a78c81be535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceeacedb9ea5485c8cdd7d6531b7d54e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:29.653652 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-27142ef3-52a7-49b1-a330-8a78c81be535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceeacedb9ea5485c8cdd7d6531b7d54e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:29.665866 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-27142ef3-52a7-49b1-a330-8a78c81be535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceeacedb9ea5485c8cdd7d6531b7d54e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:29.672772 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-27142ef3-52a7-49b1-a330-8a78c81be535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceeacedb9ea5485c8cdd7d6531b7d54e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:29.678534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1060/2113] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:37:29 2022] DELETE /identity/v3/users/ceeacedb9ea5485c8cdd7d6531b7d54e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:37:29.848746 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c9d36-cb77-45a8-8113-16b19eb9cbfe admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:29.850209 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-170c9d36-cb77-45a8-8113-16b19eb9cbfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:29.868535 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c9d36-cb77-45a8-8113-16b19eb9cbfe admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:29.929468 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71711463-2b40-4ea5-ba85-d1071e6d5e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:29.930092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71711463-2b40-4ea5-ba85-d1071e6d5e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:29.930367 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71711463-2b40-4ea5-ba85-d1071e6d5e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:29.930681 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71711463-2b40-4ea5-ba85-d1071e6d5e24 admin admin] PATH_INFO: `/v3/projects/84c368e06f684fffb69a2bccc3834c68` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:29.931789 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71711463-2b40-4ea5-ba85-d1071e6d5e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c368e06f684fffb69a2bccc3834c68)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:29.933756 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71711463-2b40-4ea5-ba85-d1071e6d5e24 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:29.941383 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:29.980207 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-71711463-2b40-4ea5-ba85-d1071e6d5e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c368e06f684fffb69a2bccc3834c68', 'request_id': 'req-71711463-2b40-4ea5-ba85-d1071e6d5e24'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:29.985540 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-71711463-2b40-4ea5-ba85-d1071e6d5e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c368e06f684fffb69a2bccc3834c68', 'request_id': 'req-71711463-2b40-4ea5-ba85-d1071e6d5e24'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:29.991506 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-71711463-2b40-4ea5-ba85-d1071e6d5e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c368e06f684fffb69a2bccc3834c68', 'request_id': 'req-71711463-2b40-4ea5-ba85-d1071e6d5e24'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:30.003760 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-71711463-2b40-4ea5-ba85-d1071e6d5e24 admin admin] The token cache is being invalidate because project 84c368e06f684fffb69a2bccc3834c68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:37:30.004046 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-71711463-2b40-4ea5-ba85-d1071e6d5e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:30.004699 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-71711463-2b40-4ea5-ba85-d1071e6d5e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:30.006334 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1054/2114] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:37:29 2022] DELETE /identity/v3/projects/84c368e06f684fffb69a2bccc3834c68 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:37:30.011404 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42edf5-8987-4cf0-a3f4-07bd621c9c08 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:30.011856 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42edf5-8987-4cf0-a3f4-07bd621c9c08 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:30.011946 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42edf5-8987-4cf0-a3f4-07bd621c9c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:30.031714 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2d42edf5-8987-4cf0-a3f4-07bd621c9c08 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:37:30.032863 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2d42edf5-8987-4cf0-a3f4-07bd621c9c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:30.097934 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1061/2115] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:37:30.105876 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27728653-4cbe-4c7f-a8c5-33e5be866e79 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:30.106247 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27728653-4cbe-4c7f-a8c5-33e5be866e79 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:30.106640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27728653-4cbe-4c7f-a8c5-33e5be866e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:30.127295 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-27728653-4cbe-4c7f-a8c5-33e5be866e79 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:37:30.128505 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-27728653-4cbe-4c7f-a8c5-33e5be866e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:30.136879 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1055/2116] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:37:30.141091 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42edf5-8987-4cf0-a3f4-07bd621c9c08 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:30.151579 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42edf5-8987-4cf0-a3f4-07bd621c9c08 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:30.156255 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01098e-26e4-4411-8fa8-95f6ea25a600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:30.156861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01098e-26e4-4411-8fa8-95f6ea25a600 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:30.157166 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01098e-26e4-4411-8fa8-95f6ea25a600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:30.157443 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01098e-26e4-4411-8fa8-95f6ea25a600 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:30.158095 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01098e-26e4-4411-8fa8-95f6ea25a600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:37:30.158398 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01098e-26e4-4411-8fa8-95f6ea25a600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:30.160040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01098e-26e4-4411-8fa8-95f6ea25a600 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:30.173007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1062/2117] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:37:30.177335 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27728653-4cbe-4c7f-a8c5-33e5be866e79 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:30.187100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27728653-4cbe-4c7f-a8c5-33e5be866e79 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:30.191874 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88148900-f1d6-4fc1-bdcd-c5f6a178b402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:30.192654 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88148900-f1d6-4fc1-bdcd-c5f6a178b402 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:30.193014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88148900-f1d6-4fc1-bdcd-c5f6a178b402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:30.193896 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88148900-f1d6-4fc1-bdcd-c5f6a178b402 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:30.194196 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88148900-f1d6-4fc1-bdcd-c5f6a178b402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:30.196721 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88148900-f1d6-4fc1-bdcd-c5f6a178b402 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:30.233462 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1056/2118] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:37:30 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:37:30.234637 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01098e-26e4-4411-8fa8-95f6ea25a600 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:30.246719 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01098e-26e4-4411-8fa8-95f6ea25a600 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:30.259426 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:30.319672 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6c75e-4498-4272-afb7-4f9d17a5d5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:30.320307 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6c75e-4498-4272-afb7-4f9d17a5d5bf admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:30.320591 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6c75e-4498-4272-afb7-4f9d17a5d5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:30.320864 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6c75e-4498-4272-afb7-4f9d17a5d5bf admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:30.322041 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6c75e-4498-4272-afb7-4f9d17a5d5bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:30.323944 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6c75e-4498-4272-afb7-4f9d17a5d5bf admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:30.350667 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1063/2119] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:37:30 2022] POST /identity/v3/users => generated 286 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:37:30.352492 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88148900-f1d6-4fc1-bdcd-c5f6a178b402 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:30.364957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88148900-f1d6-4fc1-bdcd-c5f6a178b402 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:30.372003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66b860-b2b7-48b6-a17a-bf5720539d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:30.372925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66b860-b2b7-48b6-a17a-bf5720539d79 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:30.373450 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66b860-b2b7-48b6-a17a-bf5720539d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:30.373949 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66b860-b2b7-48b6-a17a-bf5720539d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:30.375027 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66b860-b2b7-48b6-a17a-bf5720539d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:30.379431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66b860-b2b7-48b6-a17a-bf5720539d79 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:30.392470 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1057/2120] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:37:30.397206 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6c75e-4498-4272-afb7-4f9d17a5d5bf admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:30.417786 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6c75e-4498-4272-afb7-4f9d17a5d5bf admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:30.423577 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e167f32-9108-4e02-b60b-4382a50210b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:30.424263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e167f32-9108-4e02-b60b-4382a50210b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:30.424589 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e167f32-9108-4e02-b60b-4382a50210b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:30.424934 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e167f32-9108-4e02-b60b-4382a50210b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:30.425841 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e167f32-9108-4e02-b60b-4382a50210b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:30.427528 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e167f32-9108-4e02-b60b-4382a50210b2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:30.441294 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1064/2121] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:37:30.445571 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66b860-b2b7-48b6-a17a-bf5720539d79 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:30.458223 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66b860-b2b7-48b6-a17a-bf5720539d79 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:30.469844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a477aa-e3a8-4f40-b4f0-aa5438a25d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:30.470655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a477aa-e3a8-4f40-b4f0-aa5438a25d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:30.471039 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a477aa-e3a8-4f40-b4f0-aa5438a25d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:30.471440 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a477aa-e3a8-4f40-b4f0-aa5438a25d33 admin admin] PATH_INFO: `/v3/projects/c3df72ef3154498ca266d2e3abdc7f8c/users/b5b1ccd53284448b9df415c1bc60e978/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:30.493710 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a477aa-e3a8-4f40-b4f0-aa5438a25d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3df72ef3154498ca266d2e3abdc7f8c, user_id=b5b1ccd53284448b9df415c1bc60e978, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:30.496490 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a477aa-e3a8-4f40-b4f0-aa5438a25d33 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:30.516389 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1058/2122] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:37:30 2022] PUT /identity/v3/projects/c3df72ef3154498ca266d2e3abdc7f8c/users/b5b1ccd53284448b9df415c1bc60e978/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:37:30.518202 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3df5f-21b8-4a6f-b411-567eb763557a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:30.518497 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3df5f-21b8-4a6f-b411-567eb763557a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:30.519211 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3df5f-21b8-4a6f-b411-567eb763557a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:30.548855 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-21b3df5f-21b8-4a6f-b411-567eb763557a None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:37:30.550654 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-21b3df5f-21b8-4a6f-b411-567eb763557a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:30.624008 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1065/2123] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:37:30.634393 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a477aa-e3a8-4f40-b4f0-aa5438a25d33 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:30.636136 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-10a477aa-e3a8-4f40-b4f0-aa5438a25d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:30.694461 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a477aa-e3a8-4f40-b4f0-aa5438a25d33 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:30.698855 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a55c5e-bf17-4f51-b8e3-46764a05f296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:30.699458 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a55c5e-bf17-4f51-b8e3-46764a05f296 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:30.699908 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a55c5e-bf17-4f51-b8e3-46764a05f296 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:30.700122 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a55c5e-bf17-4f51-b8e3-46764a05f296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:30.709392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a55c5e-bf17-4f51-b8e3-46764a05f296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:30.710815 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a55c5e-bf17-4f51-b8e3-46764a05f296 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:30.720434 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1059/2124] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:37:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:37:32.423158 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3df5f-21b8-4a6f-b411-567eb763557a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:32.434153 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3df5f-21b8-4a6f-b411-567eb763557a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:32.438230 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7fb45-5473-40b9-8b84-9676fca115ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:32.438965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7fb45-5473-40b9-8b84-9676fca115ad service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:32.439249 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7fb45-5473-40b9-8b84-9676fca115ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:32.439528 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7fb45-5473-40b9-8b84-9676fca115ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:32.441410 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7fb7fb45-5473-40b9-8b84-9676fca115ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:32.454931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7fb45-5473-40b9-8b84-9676fca115ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:32.456244 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7fb45-5473-40b9-8b84-9676fca115ad service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:32.467995 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1066/2125] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:37:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:37:32.900807 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a55c5e-bf17-4f51-b8e3-46764a05f296 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:32.902875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d9a55c5e-bf17-4f51-b8e3-46764a05f296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:32.954375 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:32.985945 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a55c5e-bf17-4f51-b8e3-46764a05f296 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:32.998009 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b32bf-1b72-4413-a6b7-852afd6e334e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c6b6b1cdc649dda3a9caa8d9713569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:32.999722 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b32bf-1b72-4413-a6b7-852afd6e334e service glance] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:33.001679 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b32bf-1b72-4413-a6b7-852afd6e334e service glance] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:33.002119 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b32bf-1b72-4413-a6b7-852afd6e334e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:33.011186 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-538b32bf-1b72-4413-a6b7-852afd6e334e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:33.120246 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b32bf-1b72-4413-a6b7-852afd6e334e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:33.122826 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b32bf-1b72-4413-a6b7-852afd6e334e service glance] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:33.145235 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1060/2126] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:37:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:37:35.748095 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3f2f4-1775-4769-8963-fa4ccc3fa680 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:35.748622 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3f2f4-1775-4769-8963-fa4ccc3fa680 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:35.749209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3f2f4-1775-4769-8963-fa4ccc3fa680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:35.799153 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e7e3f2f4-1775-4769-8963-fa4ccc3fa680 None None] MFA Rules not processed for user `b5b1ccd53284448b9df415c1bc60e978`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:37:35.800517 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e7e3f2f4-1775-4769-8963-fa4ccc3fa680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:35.890235 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1067/2127] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:37:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:37:35.894124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b32bf-1b72-4413-a6b7-852afd6e334e service glance] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:35.913056 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b32bf-1b72-4413-a6b7-852afd6e334e service glance] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:35.921363 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868db9b-43a2-4dc2-85ba-e334cda4cdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:35.923116 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868db9b-43a2-4dc2-85ba-e334cda4cdd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:35.923675 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868db9b-43a2-4dc2-85ba-e334cda4cdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:35.924288 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868db9b-43a2-4dc2-85ba-e334cda4cdd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:35.925370 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868db9b-43a2-4dc2-85ba-e334cda4cdd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:35.930077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868db9b-43a2-4dc2-85ba-e334cda4cdd6 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:35.972016 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1061/2128] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:37:35 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:37:35.975733 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3f2f4-1775-4769-8963-fa4ccc3fa680 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:35.990929 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3f2f4-1775-4769-8963-fa4ccc3fa680 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:36.001829 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:36.076584 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbcc00-0738-4e22-b0d5-ed369d29a8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:36.077261 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbcc00-0738-4e22-b0d5-ed369d29a8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:36.077519 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbcc00-0738-4e22-b0d5-ed369d29a8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:36.077792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbcc00-0738-4e22-b0d5-ed369d29a8d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:36.078440 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbcc00-0738-4e22-b0d5-ed369d29a8d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:36.080749 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbcc00-0738-4e22-b0d5-ed369d29a8d1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:36.120221 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868db9b-43a2-4dc2-85ba-e334cda4cdd6 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:36.120783 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1068/2129] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:37:35 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:37:36.140666 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868db9b-43a2-4dc2-85ba-e334cda4cdd6 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:36.155247 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdde4f-c37f-4bee-925e-fc89f8d3d0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:36.155879 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdde4f-c37f-4bee-925e-fc89f8d3d0fa admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:36.156164 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdde4f-c37f-4bee-925e-fc89f8d3d0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:36.156442 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdde4f-c37f-4bee-925e-fc89f8d3d0fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:36.157139 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdde4f-c37f-4bee-925e-fc89f8d3d0fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:36.158750 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdde4f-c37f-4bee-925e-fc89f8d3d0fa admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:36.161463 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbcc00-0738-4e22-b0d5-ed369d29a8d1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:36.187587 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1062/2130] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:37:36.194598 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdde4f-c37f-4bee-925e-fc89f8d3d0fa admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:36.209636 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdde4f-c37f-4bee-925e-fc89f8d3d0fa admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:36.216231 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5861bae-42dd-446b-82a1-a58f0c8de5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:36.217288 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5861bae-42dd-446b-82a1-a58f0c8de5b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:36.217793 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5861bae-42dd-446b-82a1-a58f0c8de5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:36.218251 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5861bae-42dd-446b-82a1-a58f0c8de5b7 admin admin] PATH_INFO: `/v3/projects/b08df27c491847669ff6e3a1454f0c42/users/fdb82d5de0744988a3e10d93be848e50/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:36.240875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5861bae-42dd-446b-82a1-a58f0c8de5b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b08df27c491847669ff6e3a1454f0c42, user_id=fdb82d5de0744988a3e10d93be848e50, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:36.243980 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5861bae-42dd-446b-82a1-a58f0c8de5b7 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:36.249055 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbcc00-0738-4e22-b0d5-ed369d29a8d1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:36.255299 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7dbb5-89ae-4075-9146-76618fb5b1ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:36.255995 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7dbb5-89ae-4075-9146-76618fb5b1ea service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:36.256352 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7dbb5-89ae-4075-9146-76618fb5b1ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:36.256677 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7dbb5-89ae-4075-9146-76618fb5b1ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:36.260119 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-24d7dbb5-89ae-4075-9146-76618fb5b1ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:36.268029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1063/2131] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:37:36 2022] PUT /identity/v3/projects/b08df27c491847669ff6e3a1454f0c42/users/fdb82d5de0744988a3e10d93be848e50/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:37:36.272308 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5861bae-42dd-446b-82a1-a58f0c8de5b7 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:36.367675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7dbb5-89ae-4075-9146-76618fb5b1ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:36.367897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5861bae-42dd-446b-82a1-a58f0c8de5b7 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:36.369699 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7dbb5-89ae-4075-9146-76618fb5b1ea service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:36.373087 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87223e3-8872-4547-b809-b694a120e4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:36.373827 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87223e3-8872-4547-b809-b694a120e4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:36.374515 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87223e3-8872-4547-b809-b694a120e4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:36.375382 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87223e3-8872-4547-b809-b694a120e4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:36.376810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87223e3-8872-4547-b809-b694a120e4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:36.380099 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87223e3-8872-4547-b809-b694a120e4d3 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:36.386819 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1069/2132] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:37:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:37:36.393274 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1064/2133] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:37:36.397337 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7dbb5-89ae-4075-9146-76618fb5b1ea service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:36.413024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7dbb5-89ae-4075-9146-76618fb5b1ea service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:36.420868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a912c-0245-4bd3-b7a8-03f92c98cf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:36.421660 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a912c-0245-4bd3-b7a8-03f92c98cf0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:36.422009 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a912c-0245-4bd3-b7a8-03f92c98cf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:36.422362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a912c-0245-4bd3-b7a8-03f92c98cf0f admin admin] PATH_INFO: `/v3/projects/b08df27c491847669ff6e3a1454f0c42/users/fdb82d5de0744988a3e10d93be848e50/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:36.424530 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a912c-0245-4bd3-b7a8-03f92c98cf0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b08df27c491847669ff6e3a1454f0c42, user_id=fdb82d5de0744988a3e10d93be848e50, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:36.427446 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a912c-0245-4bd3-b7a8-03f92c98cf0f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:36.442472 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1070/2134] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:37:36 2022] PUT /identity/v3/projects/b08df27c491847669ff6e3a1454f0c42/users/fdb82d5de0744988a3e10d93be848e50/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:37:37.075339 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87223e3-8872-4547-b809-b694a120e4d3 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:37.078397 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e87223e3-8872-4547-b809-b694a120e4d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:37.102930 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87223e3-8872-4547-b809-b694a120e4d3 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:37.135149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:37.202721 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb24941-c01f-4562-91e4-e125ced94dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:37.204029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb24941-c01f-4562-91e4-e125ced94dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:37.204486 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb24941-c01f-4562-91e4-e125ced94dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:37.204933 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb24941-c01f-4562-91e4-e125ced94dbe admin admin] PATH_INFO: `/v3/users/d1c036fa4872485e903820d848089e02` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:37.209072 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb24941-c01f-4562-91e4-e125ced94dbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c036fa4872485e903820d848089e02)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:37.211124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb24941-c01f-4562-91e4-e125ced94dbe admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:37.293758 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9eb24941-c01f-4562-91e4-e125ced94dbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c036fa4872485e903820d848089e02'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:37.294537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9eb24941-c01f-4562-91e4-e125ced94dbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c036fa4872485e903820d848089e02'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:37.295242 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9eb24941-c01f-4562-91e4-e125ced94dbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c036fa4872485e903820d848089e02'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:37.306373 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9eb24941-c01f-4562-91e4-e125ced94dbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c036fa4872485e903820d848089e02'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:37.335981 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9eb24941-c01f-4562-91e4-e125ced94dbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c036fa4872485e903820d848089e02'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:37.363188 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1065/2135] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:37:37 2022] DELETE /identity/v3/users/d1c036fa4872485e903820d848089e02 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:37:37.586403 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a912c-0245-4bd3-b7a8-03f92c98cf0f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:37.588701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-602a912c-0245-4bd3-b7a8-03f92c98cf0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:37.615880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a912c-0245-4bd3-b7a8-03f92c98cf0f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:37.665840 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:37.710843 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b5f24-c00c-4a5e-940b-da25e74e6431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:37.711525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b5f24-c00c-4a5e-940b-da25e74e6431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:37.712689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b5f24-c00c-4a5e-940b-da25e74e6431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:37.713226 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b5f24-c00c-4a5e-940b-da25e74e6431 admin admin] PATH_INFO: `/v3/projects/7049291835854338a73d006b1120ed6f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:37.715273 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b5f24-c00c-4a5e-940b-da25e74e6431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7049291835854338a73d006b1120ed6f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:37.717994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b5f24-c00c-4a5e-940b-da25e74e6431 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:37.782712 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f43b5f24-c00c-4a5e-940b-da25e74e6431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7049291835854338a73d006b1120ed6f', 'request_id': 'req-f43b5f24-c00c-4a5e-940b-da25e74e6431'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:37.797560 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f43b5f24-c00c-4a5e-940b-da25e74e6431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7049291835854338a73d006b1120ed6f', 'request_id': 'req-f43b5f24-c00c-4a5e-940b-da25e74e6431'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:37.809063 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f43b5f24-c00c-4a5e-940b-da25e74e6431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7049291835854338a73d006b1120ed6f', 'request_id': 'req-f43b5f24-c00c-4a5e-940b-da25e74e6431'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:37.832111 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f43b5f24-c00c-4a5e-940b-da25e74e6431 admin admin] The token cache is being invalidate because project 7049291835854338a73d006b1120ed6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:37:37.832725 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f43b5f24-c00c-4a5e-940b-da25e74e6431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:37.833681 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f43b5f24-c00c-4a5e-940b-da25e74e6431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:37:37.835881 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1071/2136] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:37:37 2022] DELETE /identity/v3/projects/7049291835854338a73d006b1120ed6f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:37:37.841395 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786af7a-67ec-47d3-bd84-9bf059d703a2 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:37.842112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786af7a-67ec-47d3-bd84-9bf059d703a2 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:37.842575 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786af7a-67ec-47d3-bd84-9bf059d703a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:37.867936 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3786af7a-67ec-47d3-bd84-9bf059d703a2 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:37:37.869829 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3786af7a-67ec-47d3-bd84-9bf059d703a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:37.969676 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1066/2137] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:37:37.970113 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772dc6a-4bba-4711-9774-ccfd956e34ad None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:37.970373 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772dc6a-4bba-4711-9774-ccfd956e34ad None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:37.970786 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772dc6a-4bba-4711-9774-ccfd956e34ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:37.996151 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7772dc6a-4bba-4711-9774-ccfd956e34ad None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:37:38.000193 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7772dc6a-4bba-4711-9774-ccfd956e34ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:38.022671 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786af7a-67ec-47d3-bd84-9bf059d703a2 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:38.035388 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1072/2138] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:37:38.036419 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786af7a-67ec-47d3-bd84-9bf059d703a2 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:38.046297 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f62b6a-d152-4438-a088-57a7b097f75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:38.047163 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f62b6a-d152-4438-a088-57a7b097f75f admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:38.048084 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f62b6a-d152-4438-a088-57a7b097f75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:38.048521 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f62b6a-d152-4438-a088-57a7b097f75f admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:38.049374 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f62b6a-d152-4438-a088-57a7b097f75f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:37:38.049832 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f62b6a-d152-4438-a088-57a7b097f75f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:38.052249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f62b6a-d152-4438-a088-57a7b097f75f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:38.088742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772dc6a-4bba-4711-9774-ccfd956e34ad None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:38.095219 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1067/2139] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:37:38.103272 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772dc6a-4bba-4711-9774-ccfd956e34ad None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:38.112402 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954db19-35fb-485d-b664-064fd5181dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:38.113447 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954db19-35fb-485d-b664-064fd5181dcd admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:38.114466 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954db19-35fb-485d-b664-064fd5181dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:38.114902 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954db19-35fb-485d-b664-064fd5181dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:38.115843 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954db19-35fb-485d-b664-064fd5181dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:38.119017 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954db19-35fb-485d-b664-064fd5181dcd admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:38.156443 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1073/2140] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:37:38 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:37:38.161728 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f62b6a-d152-4438-a088-57a7b097f75f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:38.176130 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f62b6a-d152-4438-a088-57a7b097f75f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:38.200490 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:38.302154 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e39bf9-285b-439a-8d70-310826b2faa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:38.303460 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e39bf9-285b-439a-8d70-310826b2faa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:38.303901 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e39bf9-285b-439a-8d70-310826b2faa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:38.304386 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e39bf9-285b-439a-8d70-310826b2faa5 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:38.306280 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e39bf9-285b-439a-8d70-310826b2faa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:38.309672 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e39bf9-285b-439a-8d70-310826b2faa5 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:38.334865 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1068/2141] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:37:38 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:37:38.338994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954db19-35fb-485d-b664-064fd5181dcd admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:38.349749 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954db19-35fb-485d-b664-064fd5181dcd admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:38.361251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d282a-9dea-4225-9b24-0bd24ad93931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:38.362575 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d282a-9dea-4225-9b24-0bd24ad93931 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:38.362919 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d282a-9dea-4225-9b24-0bd24ad93931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:38.363253 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d282a-9dea-4225-9b24-0bd24ad93931 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:38.364045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d282a-9dea-4225-9b24-0bd24ad93931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:38.366376 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d282a-9dea-4225-9b24-0bd24ad93931 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:38.380939 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1074/2142] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:37:38.384338 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e39bf9-285b-439a-8d70-310826b2faa5 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:38.394757 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e39bf9-285b-439a-8d70-310826b2faa5 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:38.399833 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646a560-78a2-40cf-82c0-fd56aad07cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:38.400444 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646a560-78a2-40cf-82c0-fd56aad07cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:38.400725 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646a560-78a2-40cf-82c0-fd56aad07cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:38.400997 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646a560-78a2-40cf-82c0-fd56aad07cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:38.401696 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646a560-78a2-40cf-82c0-fd56aad07cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:38.403288 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646a560-78a2-40cf-82c0-fd56aad07cb1 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:38.421015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1069/2143] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:37:38.421866 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d282a-9dea-4225-9b24-0bd24ad93931 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:38.438269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d282a-9dea-4225-9b24-0bd24ad93931 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:38.445208 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07544d3-1dc1-4e32-84d6-80a9e6318aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:38.446107 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07544d3-1dc1-4e32-84d6-80a9e6318aef admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:38.446484 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07544d3-1dc1-4e32-84d6-80a9e6318aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:38.446877 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07544d3-1dc1-4e32-84d6-80a9e6318aef admin admin] PATH_INFO: `/v3/projects/16dde6e228024e1aadc23ad49391a6e1/users/7b207b303fb64275bf26dbb70ee36473/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:38.471580 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07544d3-1dc1-4e32-84d6-80a9e6318aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=16dde6e228024e1aadc23ad49391a6e1, user_id=7b207b303fb64275bf26dbb70ee36473, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:38.476116 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07544d3-1dc1-4e32-84d6-80a9e6318aef admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:38.500812 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1075/2144] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:37:38 2022] PUT /identity/v3/projects/16dde6e228024e1aadc23ad49391a6e1/users/7b207b303fb64275bf26dbb70ee36473/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:37:38.505858 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295bd26-d2ce-4603-8663-33fd86456b55 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:38.506140 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295bd26-d2ce-4603-8663-33fd86456b55 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:38.506418 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295bd26-d2ce-4603-8663-33fd86456b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:38.540628 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3295bd26-d2ce-4603-8663-33fd86456b55 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:37:38.542426 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3295bd26-d2ce-4603-8663-33fd86456b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:38.642637 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1070/2145] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:37:38.650046 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07544d3-1dc1-4e32-84d6-80a9e6318aef admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:38.653685 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a07544d3-1dc1-4e32-84d6-80a9e6318aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:38.799162 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07544d3-1dc1-4e32-84d6-80a9e6318aef admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:38.804328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd941d7-3be7-4f15-b232-bc7bd96c60f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:38.805338 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd941d7-3be7-4f15-b232-bc7bd96c60f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:38.805772 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd941d7-3be7-4f15-b232-bc7bd96c60f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:38.806224 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd941d7-3be7-4f15-b232-bc7bd96c60f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:38.821620 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd941d7-3be7-4f15-b232-bc7bd96c60f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:38.823247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd941d7-3be7-4f15-b232-bc7bd96c60f5 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:38.829330 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:38.838415 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1076/2146] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:37:43.596731 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295bd26-d2ce-4603-8663-33fd86456b55 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:43.598242 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3295bd26-d2ce-4603-8663-33fd86456b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:43.734439 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295bd26-d2ce-4603-8663-33fd86456b55 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:43.741540 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d534c1-be5d-469e-a648-e26731d33c56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:43.742230 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d534c1-be5d-469e-a648-e26731d33c56 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:43.742581 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d534c1-be5d-469e-a648-e26731d33c56 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:43.742968 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d534c1-be5d-469e-a648-e26731d33c56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:43.744796 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b7d534c1-be5d-469e-a648-e26731d33c56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:43.799770 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:43.824758 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d534c1-be5d-469e-a648-e26731d33c56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:43.826566 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d534c1-be5d-469e-a648-e26731d33c56 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:43.838253 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1071/2147] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:37:43 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:37:44.110036 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c2fd2-426c-4f77-bd3a-739ab5e30b22 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:44.110909 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c2fd2-426c-4f77-bd3a-739ab5e30b22 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:44.111712 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c2fd2-426c-4f77-bd3a-739ab5e30b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:44.158599 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ac5c2fd2-426c-4f77-bd3a-739ab5e30b22 None None] MFA Rules not processed for user `fdb82d5de0744988a3e10d93be848e50`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:37:44.159958 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ac5c2fd2-426c-4f77-bd3a-739ab5e30b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:44.265221 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1077/2148] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:37:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:37:44.278531 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d534c1-be5d-469e-a648-e26731d33c56 service nova] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:44.280020 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b7d534c1-be5d-469e-a648-e26731d33c56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:44.296482 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d534c1-be5d-469e-a648-e26731d33c56 service nova] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:44.302487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509605a-f088-45d8-a09d-db3c226a0556 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:44.303209 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509605a-f088-45d8-a09d-db3c226a0556 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:44.303551 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509605a-f088-45d8-a09d-db3c226a0556 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:44.303891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509605a-f088-45d8-a09d-db3c226a0556 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:44.306722 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3509605a-f088-45d8-a09d-db3c226a0556 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:44.393233 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509605a-f088-45d8-a09d-db3c226a0556 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:44.395472 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509605a-f088-45d8-a09d-db3c226a0556 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:44.425360 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1072/2149] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:37:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:37:46.216021 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343631b-be8f-40b8-bed1-d0586afbee58 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:46.216565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343631b-be8f-40b8-bed1-d0586afbee58 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:46.216565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343631b-be8f-40b8-bed1-d0586afbee58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:46.246903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3343631b-be8f-40b8-bed1-d0586afbee58 None None] MFA Rules not processed for user `b5b1ccd53284448b9df415c1bc60e978`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:37:46.249265 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3343631b-be8f-40b8-bed1-d0586afbee58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:46.260069 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1078/2150] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:37:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:37:47.018159 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35d47e-c083-4966-ab00-2e3a869cfe5d None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:47.018672 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35d47e-c083-4966-ab00-2e3a869cfe5d None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:47.018783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35d47e-c083-4966-ab00-2e3a869cfe5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:47.060019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-5c35d47e-c083-4966-ab00-2e3a869cfe5d None None] MFA Rules not processed for user `7b207b303fb64275bf26dbb70ee36473`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:37:47.061499 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5c35d47e-c083-4966-ab00-2e3a869cfe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:47.153026 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1073/2151] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:37:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:37:47.168666 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343631b-be8f-40b8-bed1-d0586afbee58 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:47.185208 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343631b-be8f-40b8-bed1-d0586afbee58 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:47.192830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a28977-cff8-46f5-a5c7-b5267c9a835a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:47.193923 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a28977-cff8-46f5-a5c7-b5267c9a835a service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:47.194363 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a28977-cff8-46f5-a5c7-b5267c9a835a service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:47.194812 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a28977-cff8-46f5-a5c7-b5267c9a835a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:47.207423 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a28977-cff8-46f5-a5c7-b5267c9a835a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:47.209350 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a28977-cff8-46f5-a5c7-b5267c9a835a service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:47.234750 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1079/2152] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:37:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:37:48.856333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac639b7-eb3b-4992-9e93-4400abc6ca7c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:48.856794 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac639b7-eb3b-4992-9e93-4400abc6ca7c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:48.856878 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac639b7-eb3b-4992-9e93-4400abc6ca7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:48.878514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-bac639b7-eb3b-4992-9e93-4400abc6ca7c None None] MFA Rules not processed for user `7b207b303fb64275bf26dbb70ee36473`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:37:48.879845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-bac639b7-eb3b-4992-9e93-4400abc6ca7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:48.887334 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1074/2153] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:37:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:37:49.276045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a28977-cff8-46f5-a5c7-b5267c9a835a service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:49.287955 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a28977-cff8-46f5-a5c7-b5267c9a835a service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:49.291988 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522e28d-b9d5-4df7-9fbf-d15cbe2f9583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:49.293022 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522e28d-b9d5-4df7-9fbf-d15cbe2f9583 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:49.294056 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522e28d-b9d5-4df7-9fbf-d15cbe2f9583 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:49.294056 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522e28d-b9d5-4df7-9fbf-d15cbe2f9583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:49.296263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6522e28d-b9d5-4df7-9fbf-d15cbe2f9583 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:49.307303 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522e28d-b9d5-4df7-9fbf-d15cbe2f9583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:49.308854 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522e28d-b9d5-4df7-9fbf-d15cbe2f9583 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:49.319095 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1080/2154] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:37:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:37:51.552646 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60059a24-c145-4bcd-9e7f-14e700cf7118 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:51.553643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60059a24-c145-4bcd-9e7f-14e700cf7118 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:51.553933 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60059a24-c145-4bcd-9e7f-14e700cf7118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:51.575443 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-60059a24-c145-4bcd-9e7f-14e700cf7118 None None] MFA Rules not processed for user `912693f459f147a5a479ad01e2e8387a`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:37:51.576654 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-60059a24-c145-4bcd-9e7f-14e700cf7118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:51.639383 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1075/2155] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 31 12:37:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:37:51.652317 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522e28d-b9d5-4df7-9fbf-d15cbe2f9583 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:51.653756 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6522e28d-b9d5-4df7-9fbf-d15cbe2f9583 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:51.736738 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522e28d-b9d5-4df7-9fbf-d15cbe2f9583 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:51.741871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9afee7-c29b-4edb-b6b1-6d98f48b3c61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188c4989dcfb4f99a04c3349e1a882d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:51.742478 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9afee7-c29b-4edb-b6b1-6d98f48b3c61 service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:51.742788 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9afee7-c29b-4edb-b6b1-6d98f48b3c61 service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:51.743058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9afee7-c29b-4edb-b6b1-6d98f48b3c61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:51.751460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9afee7-c29b-4edb-b6b1-6d98f48b3c61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:51.753017 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9afee7-c29b-4edb-b6b1-6d98f48b3c61 service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:51.764950 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1081/2156] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 31 12:37:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 12:37:58.651421 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60059a24-c145-4bcd-9e7f-14e700cf7118 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:37:58.658140 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:37:58.663314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60059a24-c145-4bcd-9e7f-14e700cf7118 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:37:58.687766 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb9ff2-50a2-4183-849d-500229c48c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:37:58.687766 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb9ff2-50a2-4183-849d-500229c48c11 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:37:58.687766 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb9ff2-50a2-4183-849d-500229c48c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:37:58.687766 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb9ff2-50a2-4183-849d-500229c48c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:37:58.688184 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1beb9ff2-50a2-4183-849d-500229c48c11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:37:58.688184 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb9ff2-50a2-4183-849d-500229c48c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:37:58.688184 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb9ff2-50a2-4183-849d-500229c48c11 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:37:58.695746 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1076/2157] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:37:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:38:01.757849 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=82 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:04.518929 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9afee7-c29b-4edb-b6b1-6d98f48b3c61 service swift] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:04.531276 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9afee7-c29b-4edb-b6b1-6d98f48b3c61 service swift] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:04.536725 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723e052-bf2a-4c89-bb9a-79017f7eb4e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:04.537379 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723e052-bf2a-4c89-bb9a-79017f7eb4e7 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:04.537663 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723e052-bf2a-4c89-bb9a-79017f7eb4e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:04.537937 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723e052-bf2a-4c89-bb9a-79017f7eb4e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:04.540308 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a723e052-bf2a-4c89-bb9a-79017f7eb4e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:04.597380 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723e052-bf2a-4c89-bb9a-79017f7eb4e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:04.598943 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723e052-bf2a-4c89-bb9a-79017f7eb4e7 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:04.608247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1082/2158] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:38:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:38:07.343447 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a2c72-dff4-4984-a743-dbf8648db4cc None None] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:07.343851 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a2c72-dff4-4984-a743-dbf8648db4cc None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:07.343973 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a2c72-dff4-4984-a743-dbf8648db4cc None None] PATH_INFO: `/` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:07.345381 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1077/2159] 10.222.0.18 () {54 vars in 961 bytes} [Mon Oct 31 12:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 12:38:07.355386 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d289d2-ae7f-4410-8bc8-edc9760f74db None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:07.355913 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d289d2-ae7f-4410-8bc8-edc9760f74db None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:07.356073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d289d2-ae7f-4410-8bc8-edc9760f74db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:07.376815 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-62d289d2-ae7f-4410-8bc8-edc9760f74db None None] MFA Rules not processed for user `18c015b8317b4517911f69bef21a0573`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:07.378062 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-62d289d2-ae7f-4410-8bc8-edc9760f74db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:07.444048 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1083/2160] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Oct 31 12:38:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:38:07.451514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a2c72-dff4-4984-a743-dbf8648db4cc None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:07.466149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a2c72-dff4-4984-a743-dbf8648db4cc None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:07.471380 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632ee7f-2577-4c88-be5a-da828e3b9d87 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18c015b8317b4517911f69bef21a0573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:07.472035 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632ee7f-2577-4c88-be5a-da828e3b9d87 service placement] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:07.472372 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632ee7f-2577-4c88-be5a-da828e3b9d87 service placement] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:07.472578 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632ee7f-2577-4c88-be5a-da828e3b9d87 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:07.474529 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9632ee7f-2577-4c88-be5a-da828e3b9d87 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:07.486975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632ee7f-2577-4c88-be5a-da828e3b9d87 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:07.488568 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632ee7f-2577-4c88-be5a-da828e3b9d87 service placement] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:07.498566 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1078/2161] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:38:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:38:10.555739 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac8d31-62d6-447b-a32a-c5fc68b0736a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:10.556191 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac8d31-62d6-447b-a32a-c5fc68b0736a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:10.556284 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac8d31-62d6-447b-a32a-c5fc68b0736a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:10.575652 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-63ac8d31-62d6-447b-a32a-c5fc68b0736a None None] MFA Rules not processed for user `912693f459f147a5a479ad01e2e8387a`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:10.576843 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-63ac8d31-62d6-447b-a32a-c5fc68b0736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:10.583967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1084/2162] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 31 12:38:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:38:10.596272 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632ee7f-2577-4c88-be5a-da828e3b9d87 service placement] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:10.607604 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632ee7f-2577-4c88-be5a-da828e3b9d87 service placement] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:10.612835 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da634e-e21f-47aa-b461-2b5982f47765 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188c4989dcfb4f99a04c3349e1a882d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:10.613609 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da634e-e21f-47aa-b461-2b5982f47765 service swift] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:10.613894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da634e-e21f-47aa-b461-2b5982f47765 service swift] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:10.614173 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da634e-e21f-47aa-b461-2b5982f47765 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:10.626043 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da634e-e21f-47aa-b461-2b5982f47765 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:10.627658 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da634e-e21f-47aa-b461-2b5982f47765 service swift] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:10.636919 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1079/2163] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 31 12:38:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 12:38:11.818170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac8d31-62d6-447b-a32a-c5fc68b0736a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:11.833441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac8d31-62d6-447b-a32a-c5fc68b0736a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:11.840423 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1bfad2-d19d-4f47-b61b-44c2e87cfcea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:11.841339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bfad2-d19d-4f47-b61b-44c2e87cfcea service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:11.841818 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bfad2-d19d-4f47-b61b-44c2e87cfcea service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:11.842089 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bfad2-d19d-4f47-b61b-44c2e87cfcea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:11.844048 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9a1bfad2-d19d-4f47-b61b-44c2e87cfcea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:11.858779 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1bfad2-d19d-4f47-b61b-44c2e87cfcea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:11.861216 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1bfad2-d19d-4f47-b61b-44c2e87cfcea service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:11.884390 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1085/2164] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:38:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:38:20.633257 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=16 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:21.871640 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=66 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:24.464604 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da634e-e21f-47aa-b461-2b5982f47765 service swift] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:24.476965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da634e-e21f-47aa-b461-2b5982f47765 service swift] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:24.482957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c26e91-7645-4555-a66b-568c0a75faf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:24.483560 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c26e91-7645-4555-a66b-568c0a75faf3 service nova] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:24.483839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c26e91-7645-4555-a66b-568c0a75faf3 service nova] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:24.484112 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c26e91-7645-4555-a66b-568c0a75faf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:24.485878 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b9c26e91-7645-4555-a66b-568c0a75faf3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:24.498879 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c26e91-7645-4555-a66b-568c0a75faf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:24.500453 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c26e91-7645-4555-a66b-568c0a75faf3 service nova] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:24.511617 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1080/2165] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:38:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:38:25.172526 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1bfad2-d19d-4f47-b61b-44c2e87cfcea service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:25.173941 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9a1bfad2-d19d-4f47-b61b-44c2e87cfcea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:25.185098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1bfad2-d19d-4f47-b61b-44c2e87cfcea service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:25.188684 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca947fe7-412d-45a7-92bd-423459a418bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:25.189315 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca947fe7-412d-45a7-92bd-423459a418bb service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:25.189598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca947fe7-412d-45a7-92bd-423459a418bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:25.189872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca947fe7-412d-45a7-92bd-423459a418bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:25.191520 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ca947fe7-412d-45a7-92bd-423459a418bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:25.203259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca947fe7-412d-45a7-92bd-423459a418bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:25.204661 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca947fe7-412d-45a7-92bd-423459a418bb service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:25.214682 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1086/2166] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:38:25.853921 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3848dd-f897-4196-94e2-c317b3f4eb46 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:25.854401 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3848dd-f897-4196-94e2-c317b3f4eb46 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:25.854602 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3848dd-f897-4196-94e2-c317b3f4eb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:25.874621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-1a3848dd-f897-4196-94e2-c317b3f4eb46 None None] MFA Rules not processed for user `912693f459f147a5a479ad01e2e8387a`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:25.875920 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1a3848dd-f897-4196-94e2-c317b3f4eb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:25.883617 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1081/2167] 10.222.0.18 () {58 vars in 967 bytes} [Mon Oct 31 12:38:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:38:25.906953 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca947fe7-412d-45a7-92bd-423459a418bb service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:25.918321 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca947fe7-412d-45a7-92bd-423459a418bb service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:25.923304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d5dc4-f513-47c0-8171-8f565f2ac9e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188c4989dcfb4f99a04c3349e1a882d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:25.923902 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d5dc4-f513-47c0-8171-8f565f2ac9e3 service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:25.924185 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d5dc4-f513-47c0-8171-8f565f2ac9e3 service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:25.924459 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d5dc4-f513-47c0-8171-8f565f2ac9e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:25.932983 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d5dc4-f513-47c0-8171-8f565f2ac9e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:25.934575 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d5dc4-f513-47c0-8171-8f565f2ac9e3 service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:25.942975 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1087/2168] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 31 12:38:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 12:38:28.428233 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3848dd-f897-4196-94e2-c317b3f4eb46 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:28.429760 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1a3848dd-f897-4196-94e2-c317b3f4eb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:28.444141 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3848dd-f897-4196-94e2-c317b3f4eb46 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:28.448685 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d152aa3-ab0d-4f9e-8893-529bbe9c27ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:28.449342 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d152aa3-ab0d-4f9e-8893-529bbe9c27ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:28.449623 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d152aa3-ab0d-4f9e-8893-529bbe9c27ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:28.449897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d152aa3-ab0d-4f9e-8893-529bbe9c27ef admin admin] PATH_INFO: `/v3/users/459bb7dfc62346c8b2081de02ccb12df` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:28.451031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d152aa3-ab0d-4f9e-8893-529bbe9c27ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=459bb7dfc62346c8b2081de02ccb12df)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:28.452988 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d152aa3-ab0d-4f9e-8893-529bbe9c27ef admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:28.499477 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6d152aa3-ab0d-4f9e-8893-529bbe9c27ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '459bb7dfc62346c8b2081de02ccb12df'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:28.500116 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6d152aa3-ab0d-4f9e-8893-529bbe9c27ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '459bb7dfc62346c8b2081de02ccb12df'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:28.500714 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6d152aa3-ab0d-4f9e-8893-529bbe9c27ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '459bb7dfc62346c8b2081de02ccb12df'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:28.507553 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6d152aa3-ab0d-4f9e-8893-529bbe9c27ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '459bb7dfc62346c8b2081de02ccb12df'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:28.514434 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-6d152aa3-ab0d-4f9e-8893-529bbe9c27ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '459bb7dfc62346c8b2081de02ccb12df'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:28.532109 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1082/2169] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:38:28 2022] DELETE /identity/v3/users/459bb7dfc62346c8b2081de02ccb12df => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:38:28.705409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d5dc4-f513-47c0-8171-8f565f2ac9e3 service swift] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:28.716960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d5dc4-f513-47c0-8171-8f565f2ac9e3 service swift] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:28.775182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d9944-c0eb-4395-b24c-55b49e1cb492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:28.775807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d9944-c0eb-4395-b24c-55b49e1cb492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:28.776089 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d9944-c0eb-4395-b24c-55b49e1cb492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:28.776367 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d9944-c0eb-4395-b24c-55b49e1cb492 admin admin] PATH_INFO: `/v3/projects/0211992b4f9646c2acb9db584e79ae3b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:28.777506 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d9944-c0eb-4395-b24c-55b49e1cb492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0211992b4f9646c2acb9db584e79ae3b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:28.779389 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d9944-c0eb-4395-b24c-55b49e1cb492 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:28.825599 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fd1d9944-c0eb-4395-b24c-55b49e1cb492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0211992b4f9646c2acb9db584e79ae3b', 'request_id': 'req-fd1d9944-c0eb-4395-b24c-55b49e1cb492'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:28.833603 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fd1d9944-c0eb-4395-b24c-55b49e1cb492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0211992b4f9646c2acb9db584e79ae3b', 'request_id': 'req-fd1d9944-c0eb-4395-b24c-55b49e1cb492'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:28.844712 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fd1d9944-c0eb-4395-b24c-55b49e1cb492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0211992b4f9646c2acb9db584e79ae3b', 'request_id': 'req-fd1d9944-c0eb-4395-b24c-55b49e1cb492'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:28.856075 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fd1d9944-c0eb-4395-b24c-55b49e1cb492 admin admin] The token cache is being invalidate because project 0211992b4f9646c2acb9db584e79ae3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:38:28.856367 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fd1d9944-c0eb-4395-b24c-55b49e1cb492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:28.857015 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fd1d9944-c0eb-4395-b24c-55b49e1cb492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:28.858797 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1088/2170] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:38:28 2022] DELETE /identity/v3/projects/0211992b4f9646c2acb9db584e79ae3b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:38:28.863726 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc9a5e-053c-45bc-88a6-08b15a2d3379 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:28.864097 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc9a5e-053c-45bc-88a6-08b15a2d3379 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:28.864289 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc9a5e-053c-45bc-88a6-08b15a2d3379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:28.886430 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-83cc9a5e-053c-45bc-88a6-08b15a2d3379 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:28.887694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-83cc9a5e-053c-45bc-88a6-08b15a2d3379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:28.949746 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1083/2171] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:38:28.957010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b9146-c4c4-498e-a4a7-c4fb5243648a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:28.957337 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b9146-c4c4-498e-a4a7-c4fb5243648a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:28.957611 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b9146-c4c4-498e-a4a7-c4fb5243648a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:28.977092 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-df8b9146-c4c4-498e-a4a7-c4fb5243648a None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:28.978336 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-df8b9146-c4c4-498e-a4a7-c4fb5243648a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:28.986392 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1089/2172] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:38:28.990567 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc9a5e-053c-45bc-88a6-08b15a2d3379 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:29.000759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc9a5e-053c-45bc-88a6-08b15a2d3379 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:29.005272 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd980da-0e71-4cc8-9fde-b91d864dfda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:29.005864 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd980da-0e71-4cc8-9fde-b91d864dfda4 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:29.006145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd980da-0e71-4cc8-9fde-b91d864dfda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:29.006421 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd980da-0e71-4cc8-9fde-b91d864dfda4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:29.007075 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd980da-0e71-4cc8-9fde-b91d864dfda4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:38:29.007365 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd980da-0e71-4cc8-9fde-b91d864dfda4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:29.009656 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd980da-0e71-4cc8-9fde-b91d864dfda4 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:29.021037 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1084/2173] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:38:29.025310 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b9146-c4c4-498e-a4a7-c4fb5243648a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:29.034346 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b9146-c4c4-498e-a4a7-c4fb5243648a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:29.038917 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36725451-6830-4dce-bc86-7b5e4a8d0633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:29.039533 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36725451-6830-4dce-bc86-7b5e4a8d0633 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:29.039807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36725451-6830-4dce-bc86-7b5e4a8d0633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:29.040080 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36725451-6830-4dce-bc86-7b5e4a8d0633 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:29.040714 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36725451-6830-4dce-bc86-7b5e4a8d0633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:29.042896 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36725451-6830-4dce-bc86-7b5e4a8d0633 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:29.075639 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1090/2174] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:38:29 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:38:29.076919 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd980da-0e71-4cc8-9fde-b91d864dfda4 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:29.087389 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd980da-0e71-4cc8-9fde-b91d864dfda4 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:29.124361 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:29.144625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a23dca-dffb-4508-adfe-4769063ce18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:29.145345 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a23dca-dffb-4508-adfe-4769063ce18b admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:29.145752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a23dca-dffb-4508-adfe-4769063ce18b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:29.146023 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a23dca-dffb-4508-adfe-4769063ce18b admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:29.146784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a23dca-dffb-4508-adfe-4769063ce18b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:29.149009 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a23dca-dffb-4508-adfe-4769063ce18b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:29.170412 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1085/2175] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:38:29 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:38:29.174558 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36725451-6830-4dce-bc86-7b5e4a8d0633 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:29.185374 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36725451-6830-4dce-bc86-7b5e4a8d0633 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:29.190082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2836655-4385-4e56-9b1b-427e86438671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:29.190670 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2836655-4385-4e56-9b1b-427e86438671 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:29.190947 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2836655-4385-4e56-9b1b-427e86438671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:29.191217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2836655-4385-4e56-9b1b-427e86438671 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:29.191857 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2836655-4385-4e56-9b1b-427e86438671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:29.193463 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2836655-4385-4e56-9b1b-427e86438671 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:29.203660 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1091/2176] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:38:29.207439 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a23dca-dffb-4508-adfe-4769063ce18b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:29.217350 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a23dca-dffb-4508-adfe-4769063ce18b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:29.221855 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb1ebf-fbbe-4f54-a876-4381757e9e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:29.222438 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb1ebf-fbbe-4f54-a876-4381757e9e3b admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:29.222715 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb1ebf-fbbe-4f54-a876-4381757e9e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:29.222987 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb1ebf-fbbe-4f54-a876-4381757e9e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:29.223621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb1ebf-fbbe-4f54-a876-4381757e9e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:29.225215 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb1ebf-fbbe-4f54-a876-4381757e9e3b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:29.235483 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1086/2177] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:38:29.239348 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2836655-4385-4e56-9b1b-427e86438671 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:29.249871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2836655-4385-4e56-9b1b-427e86438671 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:29.254471 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298fccc-b655-470a-81c8-6657d54e01fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:29.255105 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298fccc-b655-470a-81c8-6657d54e01fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:29.255389 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298fccc-b655-470a-81c8-6657d54e01fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:29.255667 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298fccc-b655-470a-81c8-6657d54e01fb admin admin] PATH_INFO: `/v3/projects/595a58ef3b094ab4918b82dbfb856d51/users/a81b5116b131415e8c0ae6cbbad3b655/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:29.271387 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298fccc-b655-470a-81c8-6657d54e01fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=595a58ef3b094ab4918b82dbfb856d51, user_id=a81b5116b131415e8c0ae6cbbad3b655, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:29.274078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298fccc-b655-470a-81c8-6657d54e01fb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:29.282621 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:29.287616 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1092/2178] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:38:29 2022] PUT /identity/v3/projects/595a58ef3b094ab4918b82dbfb856d51/users/a81b5116b131415e8c0ae6cbbad3b655/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:38:29.298224 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb834218-15fe-4592-9c8c-906240460b32 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:29.298512 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb834218-15fe-4592-9c8c-906240460b32 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:29.298807 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb834218-15fe-4592-9c8c-906240460b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:29.326445 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-fb834218-15fe-4592-9c8c-906240460b32 None None] MFA Rules not processed for user `a81b5116b131415e8c0ae6cbbad3b655`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:29.327655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-fb834218-15fe-4592-9c8c-906240460b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:29.389881 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1087/2179] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:38:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:38:29.401007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298fccc-b655-470a-81c8-6657d54e01fb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:29.402627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2298fccc-b655-470a-81c8-6657d54e01fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:29.473808 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298fccc-b655-470a-81c8-6657d54e01fb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:29.479869 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df4f5e-68cd-44fd-8bdf-de23b74fb295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd93ce5759e0648a1934ff4d9c9d8fe61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:29.480469 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df4f5e-68cd-44fd-8bdf-de23b74fb295 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:29.480749 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df4f5e-68cd-44fd-8bdf-de23b74fb295 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:29.481022 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df4f5e-68cd-44fd-8bdf-de23b74fb295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:29.488503 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df4f5e-68cd-44fd-8bdf-de23b74fb295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:29.490089 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df4f5e-68cd-44fd-8bdf-de23b74fb295 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:29.499207 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1093/2180] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:38:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:38:34.644180 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb834218-15fe-4592-9c8c-906240460b32 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:34.704442 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb834218-15fe-4592-9c8c-906240460b32 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:34.709038 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a6652-b8db-4c1d-a99a-91c4ead896f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:34.709687 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a6652-b8db-4c1d-a99a-91c4ead896f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:34.709965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a6652-b8db-4c1d-a99a-91c4ead896f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:34.710237 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a6652-b8db-4c1d-a99a-91c4ead896f1 admin admin] PATH_INFO: `/v3/users/a81b5116b131415e8c0ae6cbbad3b655` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:34.711344 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a6652-b8db-4c1d-a99a-91c4ead896f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a81b5116b131415e8c0ae6cbbad3b655)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:34.713289 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a6652-b8db-4c1d-a99a-91c4ead896f1 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:34.758389 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-672a6652-b8db-4c1d-a99a-91c4ead896f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a81b5116b131415e8c0ae6cbbad3b655'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:34.759031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-672a6652-b8db-4c1d-a99a-91c4ead896f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a81b5116b131415e8c0ae6cbbad3b655'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:34.759633 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-672a6652-b8db-4c1d-a99a-91c4ead896f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a81b5116b131415e8c0ae6cbbad3b655'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:34.761617 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:34.768703 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-672a6652-b8db-4c1d-a99a-91c4ead896f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a81b5116b131415e8c0ae6cbbad3b655'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:34.779045 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-672a6652-b8db-4c1d-a99a-91c4ead896f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a81b5116b131415e8c0ae6cbbad3b655'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:34.800952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1088/2181] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:38:34 2022] DELETE /identity/v3/users/a81b5116b131415e8c0ae6cbbad3b655 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:38:34.806040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f4ef0-056c-46af-9d06-41a9cbabc5c4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:34.806520 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f4ef0-056c-46af-9d06-41a9cbabc5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:34.806638 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f4ef0-056c-46af-9d06-41a9cbabc5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:34.825485 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-627f4ef0-056c-46af-9d06-41a9cbabc5c4 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:34.826697 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-627f4ef0-056c-46af-9d06-41a9cbabc5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:34.884675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1094/2182] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:38:34.894663 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a6652-b8db-4c1d-a99a-91c4ead896f1 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:34.896036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-672a6652-b8db-4c1d-a99a-91c4ead896f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:34.952895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a6652-b8db-4c1d-a99a-91c4ead896f1 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:34.956537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1e29a-e049-42ea-8a13-1ff02dd1b466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:34.957161 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1e29a-e049-42ea-8a13-1ff02dd1b466 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:34.957445 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1e29a-e049-42ea-8a13-1ff02dd1b466 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:34.957716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1e29a-e049-42ea-8a13-1ff02dd1b466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:34.967079 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1e29a-e049-42ea-8a13-1ff02dd1b466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:34.968486 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1e29a-e049-42ea-8a13-1ff02dd1b466 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:34.978471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1089/2183] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:38:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:38:35.241830 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f4ef0-056c-46af-9d06-41a9cbabc5c4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:35.243247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-627f4ef0-056c-46af-9d06-41a9cbabc5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:35.255333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f4ef0-056c-46af-9d06-41a9cbabc5c4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:35.259923 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29751d44-5f9c-4412-9f5b-c0506d250036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:35.260557 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29751d44-5f9c-4412-9f5b-c0506d250036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:35.260837 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29751d44-5f9c-4412-9f5b-c0506d250036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:35.261142 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29751d44-5f9c-4412-9f5b-c0506d250036 admin admin] PATH_INFO: `/v3/projects/595a58ef3b094ab4918b82dbfb856d51` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:35.262363 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29751d44-5f9c-4412-9f5b-c0506d250036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=595a58ef3b094ab4918b82dbfb856d51)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:35.264397 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29751d44-5f9c-4412-9f5b-c0506d250036 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:35.310795 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-29751d44-5f9c-4412-9f5b-c0506d250036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '595a58ef3b094ab4918b82dbfb856d51', 'request_id': 'req-29751d44-5f9c-4412-9f5b-c0506d250036'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:35.317648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-29751d44-5f9c-4412-9f5b-c0506d250036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '595a58ef3b094ab4918b82dbfb856d51', 'request_id': 'req-29751d44-5f9c-4412-9f5b-c0506d250036'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:35.323719 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-29751d44-5f9c-4412-9f5b-c0506d250036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '595a58ef3b094ab4918b82dbfb856d51', 'request_id': 'req-29751d44-5f9c-4412-9f5b-c0506d250036'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:35.334694 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-29751d44-5f9c-4412-9f5b-c0506d250036 admin admin] The token cache is being invalidate because project 595a58ef3b094ab4918b82dbfb856d51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:38:35.334984 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-29751d44-5f9c-4412-9f5b-c0506d250036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:35.335611 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-29751d44-5f9c-4412-9f5b-c0506d250036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:35.337742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1095/2184] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:38:35 2022] DELETE /identity/v3/projects/595a58ef3b094ab4918b82dbfb856d51 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:38:35.342651 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83575198-edd3-4128-a3fd-a5cb1c5ae541 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:35.342943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83575198-edd3-4128-a3fd-a5cb1c5ae541 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:35.343222 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83575198-edd3-4128-a3fd-a5cb1c5ae541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:35.362276 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-83575198-edd3-4128-a3fd-a5cb1c5ae541 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:35.363476 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-83575198-edd3-4128-a3fd-a5cb1c5ae541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:35.421913 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1090/2185] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:38:35.430894 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fdd28-e5bb-4595-816c-fbe5098ba4b7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:35.431186 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fdd28-e5bb-4595-816c-fbe5098ba4b7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:35.431462 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fdd28-e5bb-4595-816c-fbe5098ba4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:35.451249 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4a8fdd28-e5bb-4595-816c-fbe5098ba4b7 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:35.452455 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4a8fdd28-e5bb-4595-816c-fbe5098ba4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:35.460529 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1096/2186] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:38:35.465214 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83575198-edd3-4128-a3fd-a5cb1c5ae541 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:35.474763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83575198-edd3-4128-a3fd-a5cb1c5ae541 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:35.479367 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a8bb6-e87e-4530-9fc7-c2b263a3b5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:35.479959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a8bb6-e87e-4530-9fc7-c2b263a3b5ca admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:35.480241 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a8bb6-e87e-4530-9fc7-c2b263a3b5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:35.480517 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a8bb6-e87e-4530-9fc7-c2b263a3b5ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:35.481199 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a8bb6-e87e-4530-9fc7-c2b263a3b5ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:38:35.481503 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a8bb6-e87e-4530-9fc7-c2b263a3b5ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:35.483088 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a8bb6-e87e-4530-9fc7-c2b263a3b5ca admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:35.494553 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1091/2187] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:38:35.498636 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fdd28-e5bb-4595-816c-fbe5098ba4b7 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:35.502977 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:35.509517 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fdd28-e5bb-4595-816c-fbe5098ba4b7 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:35.515204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80148a1c-3e96-46db-a65a-481a3ee3087e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:35.515806 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80148a1c-3e96-46db-a65a-481a3ee3087e admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:35.516084 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80148a1c-3e96-46db-a65a-481a3ee3087e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:35.516362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80148a1c-3e96-46db-a65a-481a3ee3087e admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:35.516987 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80148a1c-3e96-46db-a65a-481a3ee3087e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:35.518935 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80148a1c-3e96-46db-a65a-481a3ee3087e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:35.546335 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1097/2188] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:38:35 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:38:35.550589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a8bb6-e87e-4530-9fc7-c2b263a3b5ca admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:35.561521 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a8bb6-e87e-4530-9fc7-c2b263a3b5ca admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:35.615906 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:35.622960 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95688075-fa53-4fd1-a080-9eae531f20c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:35.623648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95688075-fa53-4fd1-a080-9eae531f20c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:35.624135 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95688075-fa53-4fd1-a080-9eae531f20c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:35.624581 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95688075-fa53-4fd1-a080-9eae531f20c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:35.625461 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95688075-fa53-4fd1-a080-9eae531f20c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:35.627414 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95688075-fa53-4fd1-a080-9eae531f20c1 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:35.649536 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1092/2189] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:38:35 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:38:35.653775 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80148a1c-3e96-46db-a65a-481a3ee3087e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:35.663897 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80148a1c-3e96-46db-a65a-481a3ee3087e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:35.668710 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9458da-f086-4f8d-9467-4a11ac9c1fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:35.669339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9458da-f086-4f8d-9467-4a11ac9c1fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:35.669618 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9458da-f086-4f8d-9467-4a11ac9c1fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:35.669888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9458da-f086-4f8d-9467-4a11ac9c1fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:35.670529 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9458da-f086-4f8d-9467-4a11ac9c1fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:35.672099 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9458da-f086-4f8d-9467-4a11ac9c1fb1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:35.682674 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1098/2190] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:38:35.686501 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95688075-fa53-4fd1-a080-9eae531f20c1 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:35.697164 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95688075-fa53-4fd1-a080-9eae531f20c1 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:35.701789 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2fcdf-df17-41eb-a1fe-0c25b18fc33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:35.702378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2fcdf-df17-41eb-a1fe-0c25b18fc33c admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:35.702655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2fcdf-df17-41eb-a1fe-0c25b18fc33c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:35.702927 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2fcdf-df17-41eb-a1fe-0c25b18fc33c admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:35.703573 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2fcdf-df17-41eb-a1fe-0c25b18fc33c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:35.705165 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2fcdf-df17-41eb-a1fe-0c25b18fc33c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:35.715572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1093/2191] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:38:35.719504 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9458da-f086-4f8d-9467-4a11ac9c1fb1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:35.729280 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9458da-f086-4f8d-9467-4a11ac9c1fb1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:35.733857 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43b5cb-ae88-481f-9a0e-8fe6df0970ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:35.734495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43b5cb-ae88-481f-9a0e-8fe6df0970ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:35.734776 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43b5cb-ae88-481f-9a0e-8fe6df0970ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:35.735052 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43b5cb-ae88-481f-9a0e-8fe6df0970ad admin admin] PATH_INFO: `/v3/projects/84a2cd5cf23b4a8d81f4f0d055881ea5/users/359047c1bc18422cbd704001b940bd52/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:35.749619 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43b5cb-ae88-481f-9a0e-8fe6df0970ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a2cd5cf23b4a8d81f4f0d055881ea5, user_id=359047c1bc18422cbd704001b940bd52, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:35.752224 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43b5cb-ae88-481f-9a0e-8fe6df0970ad admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:35.765696 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1099/2192] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:38:35 2022] PUT /identity/v3/projects/84a2cd5cf23b4a8d81f4f0d055881ea5/users/359047c1bc18422cbd704001b940bd52/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:38:35.770494 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71404a-4c53-4f87-bda0-d8828636eb08 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:35.770780 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71404a-4c53-4f87-bda0-d8828636eb08 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:35.771056 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71404a-4c53-4f87-bda0-d8828636eb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:35.789510 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-1b71404a-4c53-4f87-bda0-d8828636eb08 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:35.790726 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1b71404a-4c53-4f87-bda0-d8828636eb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:35.848876 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1094/2193] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:38:35.858477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43b5cb-ae88-481f-9a0e-8fe6df0970ad admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:35.860157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ee43b5cb-ae88-481f-9a0e-8fe6df0970ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:35.916501 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43b5cb-ae88-481f-9a0e-8fe6df0970ad admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:35.920292 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccacc5-f8cc-4c30-b344-ce518465b944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:35.920896 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccacc5-f8cc-4c30-b344-ce518465b944 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:35.921211 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccacc5-f8cc-4c30-b344-ce518465b944 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:35.921491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccacc5-f8cc-4c30-b344-ce518465b944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:35.930968 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ccacc5-f8cc-4c30-b344-ce518465b944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:35.932371 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ccacc5-f8cc-4c30-b344-ce518465b944 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:35.941682 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1100/2194] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:38:36.554882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce5e5c-b32f-456d-8369-4a4301eedd7b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:36.555171 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce5e5c-b32f-456d-8369-4a4301eedd7b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:36.555447 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce5e5c-b32f-456d-8369-4a4301eedd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:36.583343 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-28ce5e5c-b32f-456d-8369-4a4301eedd7b None None] MFA Rules not processed for user `359047c1bc18422cbd704001b940bd52`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:36.584801 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-28ce5e5c-b32f-456d-8369-4a4301eedd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:36.654108 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1095/2195] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:38:36 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:38:36.658664 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccacc5-f8cc-4c30-b344-ce518465b944 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:36.669047 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccacc5-f8cc-4c30-b344-ce518465b944 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:36.673659 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffb24a-9f18-4a9b-89fa-56a0a891a67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:36.674192 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffb24a-9f18-4a9b-89fa-56a0a891a67a admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:36.674471 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffb24a-9f18-4a9b-89fa-56a0a891a67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:36.674739 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffb24a-9f18-4a9b-89fa-56a0a891a67a admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:36.675359 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffb24a-9f18-4a9b-89fa-56a0a891a67a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:36.677282 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffb24a-9f18-4a9b-89fa-56a0a891a67a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:36.706738 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1101/2196] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:38:36 2022] POST /identity/v3/projects => generated 401 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:38:36.707993 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce5e5c-b32f-456d-8369-4a4301eedd7b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:36.719525 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce5e5c-b32f-456d-8369-4a4301eedd7b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:36.776393 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f0afa-5806-455d-b644-c55af63a83a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:36.776991 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f0afa-5806-455d-b644-c55af63a83a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:36.777300 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f0afa-5806-455d-b644-c55af63a83a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:36.777571 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f0afa-5806-455d-b644-c55af63a83a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:36.778187 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f0afa-5806-455d-b644-c55af63a83a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:36.780071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f0afa-5806-455d-b644-c55af63a83a1 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:36.792377 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:36.803163 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1096/2197] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:38:36 2022] POST /identity/v3/users => generated 307 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:38:36.807295 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffb24a-9f18-4a9b-89fa-56a0a891a67a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:36.817701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffb24a-9f18-4a9b-89fa-56a0a891a67a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:36.822767 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df546cb8-7965-48ad-b9ee-bac78baef345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:36.823378 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df546cb8-7965-48ad-b9ee-bac78baef345 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:36.823658 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df546cb8-7965-48ad-b9ee-bac78baef345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:36.823927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df546cb8-7965-48ad-b9ee-bac78baef345 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:36.824562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df546cb8-7965-48ad-b9ee-bac78baef345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:36.826163 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df546cb8-7965-48ad-b9ee-bac78baef345 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:36.837130 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1102/2198] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:38:36.841227 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f0afa-5806-455d-b644-c55af63a83a1 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:36.851110 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f0afa-5806-455d-b644-c55af63a83a1 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:36.855692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f7714-cf69-46df-adc3-ad039bced2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:36.856332 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f7714-cf69-46df-adc3-ad039bced2ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:36.856613 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f7714-cf69-46df-adc3-ad039bced2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:36.856892 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f7714-cf69-46df-adc3-ad039bced2ca admin admin] PATH_INFO: `/v3/projects/13da9d156a414011a2df795e0bf6d9c9/users/dcd097399cf04ef98e2c42427d77784e/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:36.871432 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f7714-cf69-46df-adc3-ad039bced2ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=13da9d156a414011a2df795e0bf6d9c9, user_id=dcd097399cf04ef98e2c42427d77784e, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:36.873991 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f7714-cf69-46df-adc3-ad039bced2ca admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:36.886622 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1097/2199] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:38:36 2022] PUT /identity/v3/projects/13da9d156a414011a2df795e0bf6d9c9/users/dcd097399cf04ef98e2c42427d77784e/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:38:36.890659 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df546cb8-7965-48ad-b9ee-bac78baef345 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:36.901404 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df546cb8-7965-48ad-b9ee-bac78baef345 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:36.955998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e725a8-6dac-406d-927b-2c57479d8a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:36.956529 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e725a8-6dac-406d-927b-2c57479d8a38 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:36.956810 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e725a8-6dac-406d-927b-2c57479d8a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:36.957083 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e725a8-6dac-406d-927b-2c57479d8a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:36.957753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e725a8-6dac-406d-927b-2c57479d8a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:36.959354 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e725a8-6dac-406d-927b-2c57479d8a38 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:36.969444 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1103/2200] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:38:36.973512 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f7714-cf69-46df-adc3-ad039bced2ca admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:36.983759 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f7714-cf69-46df-adc3-ad039bced2ca admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:36.988420 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138a625-d3cd-4534-8fbc-f4919dd2e532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:36.989113 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138a625-d3cd-4534-8fbc-f4919dd2e532 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:36.989410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138a625-d3cd-4534-8fbc-f4919dd2e532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:36.989685 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138a625-d3cd-4534-8fbc-f4919dd2e532 admin admin] PATH_INFO: `/v3/projects/13da9d156a414011a2df795e0bf6d9c9/users/dcd097399cf04ef98e2c42427d77784e/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:36.991599 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138a625-d3cd-4534-8fbc-f4919dd2e532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13da9d156a414011a2df795e0bf6d9c9, user_id=dcd097399cf04ef98e2c42427d77784e, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:36.994331 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138a625-d3cd-4534-8fbc-f4919dd2e532 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:37.004523 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1098/2201] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:38:36 2022] PUT /identity/v3/projects/13da9d156a414011a2df795e0bf6d9c9/users/dcd097399cf04ef98e2c42427d77784e/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:38:37.625496 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e807fac-3401-420d-ab0b-0b18dfed8fa8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:37.625943 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e807fac-3401-420d-ab0b-0b18dfed8fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:37.626322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e807fac-3401-420d-ab0b-0b18dfed8fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:37.650641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:37.660130 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5e807fac-3401-420d-ab0b-0b18dfed8fa8 None None] MFA Rules not processed for user `dcd097399cf04ef98e2c42427d77784e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:37.662352 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5e807fac-3401-420d-ab0b-0b18dfed8fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:37.742983 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1104/2202] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:38:37 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:38:38.758240 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138a625-d3cd-4534-8fbc-f4919dd2e532 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:38.824268 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138a625-d3cd-4534-8fbc-f4919dd2e532 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:38.828839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf5665-2b90-4289-a505-19249de7b635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:38.829495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf5665-2b90-4289-a505-19249de7b635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:38.829778 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf5665-2b90-4289-a505-19249de7b635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:38.830056 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf5665-2b90-4289-a505-19249de7b635 admin admin] PATH_INFO: `/v3/users/359047c1bc18422cbd704001b940bd52` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:38.831196 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf5665-2b90-4289-a505-19249de7b635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=359047c1bc18422cbd704001b940bd52)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:38.833124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf5665-2b90-4289-a505-19249de7b635 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:38.879431 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ffdf5665-2b90-4289-a505-19249de7b635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '359047c1bc18422cbd704001b940bd52'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:38.880089 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ffdf5665-2b90-4289-a505-19249de7b635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '359047c1bc18422cbd704001b940bd52'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:38.880676 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ffdf5665-2b90-4289-a505-19249de7b635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '359047c1bc18422cbd704001b940bd52'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:38.888376 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ffdf5665-2b90-4289-a505-19249de7b635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '359047c1bc18422cbd704001b940bd52'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:38.895635 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ffdf5665-2b90-4289-a505-19249de7b635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '359047c1bc18422cbd704001b940bd52'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:38.912673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1099/2203] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:38:38 2022] DELETE /identity/v3/users/359047c1bc18422cbd704001b940bd52 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:38:39.086677 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e807fac-3401-420d-ab0b-0b18dfed8fa8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:39.098088 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e807fac-3401-420d-ab0b-0b18dfed8fa8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:39.158122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3ee56-99fb-42e7-a109-832e4b240bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:39.158763 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3ee56-99fb-42e7-a109-832e4b240bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:39.159046 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3ee56-99fb-42e7-a109-832e4b240bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:39.159322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3ee56-99fb-42e7-a109-832e4b240bd1 admin admin] PATH_INFO: `/v3/projects/84a2cd5cf23b4a8d81f4f0d055881ea5` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:39.160447 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3ee56-99fb-42e7-a109-832e4b240bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84a2cd5cf23b4a8d81f4f0d055881ea5)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:39.162396 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3ee56-99fb-42e7-a109-832e4b240bd1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:39.208400 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-39d3ee56-99fb-42e7-a109-832e4b240bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84a2cd5cf23b4a8d81f4f0d055881ea5', 'request_id': 'req-39d3ee56-99fb-42e7-a109-832e4b240bd1'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:39.215392 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-39d3ee56-99fb-42e7-a109-832e4b240bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84a2cd5cf23b4a8d81f4f0d055881ea5', 'request_id': 'req-39d3ee56-99fb-42e7-a109-832e4b240bd1'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:39.220838 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-39d3ee56-99fb-42e7-a109-832e4b240bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84a2cd5cf23b4a8d81f4f0d055881ea5', 'request_id': 'req-39d3ee56-99fb-42e7-a109-832e4b240bd1'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:39.232206 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-39d3ee56-99fb-42e7-a109-832e4b240bd1 admin admin] The token cache is being invalidate because project 84a2cd5cf23b4a8d81f4f0d055881ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:38:39.232493 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-39d3ee56-99fb-42e7-a109-832e4b240bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:39.233132 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-39d3ee56-99fb-42e7-a109-832e4b240bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:39.234599 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1105/2204] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:38:39 2022] DELETE /identity/v3/projects/84a2cd5cf23b4a8d81f4f0d055881ea5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:38:39.238627 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf5665-2b90-4289-a505-19249de7b635 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:39.240055 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ffdf5665-2b90-4289-a505-19249de7b635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:39.253573 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf5665-2b90-4289-a505-19249de7b635 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:39.285994 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:39.312545 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad7038-9d92-4cc0-8885-4161ebb9c5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:39.313197 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad7038-9d92-4cc0-8885-4161ebb9c5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:39.313505 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad7038-9d92-4cc0-8885-4161ebb9c5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:39.313917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad7038-9d92-4cc0-8885-4161ebb9c5ac admin admin] PATH_INFO: `/v3/users/dcd097399cf04ef98e2c42427d77784e` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:39.315041 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad7038-9d92-4cc0-8885-4161ebb9c5ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd097399cf04ef98e2c42427d77784e)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:39.316949 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad7038-9d92-4cc0-8885-4161ebb9c5ac admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:39.362414 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0bad7038-9d92-4cc0-8885-4161ebb9c5ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd097399cf04ef98e2c42427d77784e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:39.363056 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0bad7038-9d92-4cc0-8885-4161ebb9c5ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd097399cf04ef98e2c42427d77784e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:39.363654 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0bad7038-9d92-4cc0-8885-4161ebb9c5ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd097399cf04ef98e2c42427d77784e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:39.371579 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0bad7038-9d92-4cc0-8885-4161ebb9c5ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd097399cf04ef98e2c42427d77784e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:39.379462 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0bad7038-9d92-4cc0-8885-4161ebb9c5ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd097399cf04ef98e2c42427d77784e'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:39.397750 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1100/2205] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:38:39 2022] DELETE /identity/v3/users/dcd097399cf04ef98e2c42427d77784e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:38:39.584578 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3ee56-99fb-42e7-a109-832e4b240bd1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:39.586739 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-39d3ee56-99fb-42e7-a109-832e4b240bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:39.616265 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3ee56-99fb-42e7-a109-832e4b240bd1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:39.656162 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:39.696281 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401419ab-c880-4804-a1a7-de68fdc5dabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:39.697005 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401419ab-c880-4804-a1a7-de68fdc5dabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:39.697416 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401419ab-c880-4804-a1a7-de68fdc5dabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:39.697771 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401419ab-c880-4804-a1a7-de68fdc5dabe admin admin] PATH_INFO: `/v3/projects/13da9d156a414011a2df795e0bf6d9c9` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:39.698944 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401419ab-c880-4804-a1a7-de68fdc5dabe admin admin] RBAC: Authorizing `identity:delete_project(project_id=13da9d156a414011a2df795e0bf6d9c9)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:39.700941 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401419ab-c880-4804-a1a7-de68fdc5dabe admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:39.749362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-401419ab-c880-4804-a1a7-de68fdc5dabe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13da9d156a414011a2df795e0bf6d9c9', 'request_id': 'req-401419ab-c880-4804-a1a7-de68fdc5dabe'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:39.756625 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-401419ab-c880-4804-a1a7-de68fdc5dabe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13da9d156a414011a2df795e0bf6d9c9', 'request_id': 'req-401419ab-c880-4804-a1a7-de68fdc5dabe'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:39.762274 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-401419ab-c880-4804-a1a7-de68fdc5dabe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13da9d156a414011a2df795e0bf6d9c9', 'request_id': 'req-401419ab-c880-4804-a1a7-de68fdc5dabe'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:39.773632 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-401419ab-c880-4804-a1a7-de68fdc5dabe admin admin] The token cache is being invalidate because project 13da9d156a414011a2df795e0bf6d9c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:38:39.773925 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-401419ab-c880-4804-a1a7-de68fdc5dabe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:39.774564 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-401419ab-c880-4804-a1a7-de68fdc5dabe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:39.776061 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1106/2206] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:38:39 2022] DELETE /identity/v3/projects/13da9d156a414011a2df795e0bf6d9c9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:38:39.781852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680b4e4-9e0a-4e2a-a33d-a3adc6813e91 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:39.782361 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680b4e4-9e0a-4e2a-a33d-a3adc6813e91 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:39.782460 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680b4e4-9e0a-4e2a-a33d-a3adc6813e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:39.803101 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-6680b4e4-9e0a-4e2a-a33d-a3adc6813e91 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:39.804323 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6680b4e4-9e0a-4e2a-a33d-a3adc6813e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:39.863125 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1101/2207] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:38:39.870873 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3b8c2-e65d-425d-8a75-e2463ed175c7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:39.871110 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3b8c2-e65d-425d-8a75-e2463ed175c7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:39.871508 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3b8c2-e65d-425d-8a75-e2463ed175c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:39.892685 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-76b3b8c2-e65d-425d-8a75-e2463ed175c7 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:39.893936 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-76b3b8c2-e65d-425d-8a75-e2463ed175c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:39.903239 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1107/2208] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:38:39.907481 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680b4e4-9e0a-4e2a-a33d-a3adc6813e91 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:39.917438 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680b4e4-9e0a-4e2a-a33d-a3adc6813e91 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:39.922339 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe8a3c-fe06-40da-9786-7ecdf1af4817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:39.922936 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe8a3c-fe06-40da-9786-7ecdf1af4817 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:39.923219 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe8a3c-fe06-40da-9786-7ecdf1af4817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:39.923497 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe8a3c-fe06-40da-9786-7ecdf1af4817 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:39.924190 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe8a3c-fe06-40da-9786-7ecdf1af4817 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:38:39.924535 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe8a3c-fe06-40da-9786-7ecdf1af4817 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:39.926319 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe8a3c-fe06-40da-9786-7ecdf1af4817 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:39.939339 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1102/2209] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:38:39.944115 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3b8c2-e65d-425d-8a75-e2463ed175c7 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:39.953946 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3b8c2-e65d-425d-8a75-e2463ed175c7 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:39.958668 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74579728-0700-439c-8ba6-fbd50006fdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:39.959265 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74579728-0700-439c-8ba6-fbd50006fdb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:39.959549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74579728-0700-439c-8ba6-fbd50006fdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:39.959824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74579728-0700-439c-8ba6-fbd50006fdb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:39.960459 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74579728-0700-439c-8ba6-fbd50006fdb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:39.962960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74579728-0700-439c-8ba6-fbd50006fdb1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:39.989034 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1108/2210] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:38:39 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:38:39.993122 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe8a3c-fe06-40da-9786-7ecdf1af4817 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:40.003099 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe8a3c-fe06-40da-9786-7ecdf1af4817 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:40.043899 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:40.059781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e15d5-4bb4-409b-930b-e383e044bd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:40.060370 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e15d5-4bb4-409b-930b-e383e044bd6f admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:40.060648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e15d5-4bb4-409b-930b-e383e044bd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:40.060919 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e15d5-4bb4-409b-930b-e383e044bd6f admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:40.061578 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e15d5-4bb4-409b-930b-e383e044bd6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:40.063496 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e15d5-4bb4-409b-930b-e383e044bd6f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:40.085238 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1103/2211] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:38:39 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:38:40.089954 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74579728-0700-439c-8ba6-fbd50006fdb1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:40.100572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74579728-0700-439c-8ba6-fbd50006fdb1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:40.105429 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ba4d7-2540-430d-b4b1-d91a037de71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:40.106037 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ba4d7-2540-430d-b4b1-d91a037de71c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:40.106319 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ba4d7-2540-430d-b4b1-d91a037de71c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:40.106596 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ba4d7-2540-430d-b4b1-d91a037de71c admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:40.107247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ba4d7-2540-430d-b4b1-d91a037de71c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:40.108835 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ba4d7-2540-430d-b4b1-d91a037de71c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:40.118853 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1109/2212] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:38:40.122891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e15d5-4bb4-409b-930b-e383e044bd6f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:40.133063 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e15d5-4bb4-409b-930b-e383e044bd6f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:40.137610 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89316d0d-bea1-4eec-9c83-837bdc9b5d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:40.138196 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89316d0d-bea1-4eec-9c83-837bdc9b5d3d admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:40.138471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89316d0d-bea1-4eec-9c83-837bdc9b5d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:40.138742 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89316d0d-bea1-4eec-9c83-837bdc9b5d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:40.139386 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89316d0d-bea1-4eec-9c83-837bdc9b5d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:40.140948 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89316d0d-bea1-4eec-9c83-837bdc9b5d3d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:40.151866 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1104/2213] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:38:40.156086 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ba4d7-2540-430d-b4b1-d91a037de71c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:40.166158 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ba4d7-2540-430d-b4b1-d91a037de71c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:40.170987 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29702310-af68-4986-be30-a12d76e89f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:40.171631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29702310-af68-4986-be30-a12d76e89f72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:40.171913 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29702310-af68-4986-be30-a12d76e89f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:40.172189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29702310-af68-4986-be30-a12d76e89f72 admin admin] PATH_INFO: `/v3/projects/4b554f5b0fc64cbf829d574f66508a5e/users/23e6da023a3c43178743babb9679947e/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:40.186882 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29702310-af68-4986-be30-a12d76e89f72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b554f5b0fc64cbf829d574f66508a5e, user_id=23e6da023a3c43178743babb9679947e, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:40.189545 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29702310-af68-4986-be30-a12d76e89f72 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:40.202623 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1110/2214] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:38:40 2022] PUT /identity/v3/projects/4b554f5b0fc64cbf829d574f66508a5e/users/23e6da023a3c43178743babb9679947e/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:38:40.212921 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ec75a-5713-4752-b07f-9fe2285692e9 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:40.213238 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ec75a-5713-4752-b07f-9fe2285692e9 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:40.213510 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ec75a-5713-4752-b07f-9fe2285692e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:40.240090 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f26ec75a-5713-4752-b07f-9fe2285692e9 None None] MFA Rules not processed for user `23e6da023a3c43178743babb9679947e`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:40.241318 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f26ec75a-5713-4752-b07f-9fe2285692e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:40.304178 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1105/2215] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:38:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:38:40.309304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29702310-af68-4986-be30-a12d76e89f72 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:40.358917 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:40.371241 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29702310-af68-4986-be30-a12d76e89f72 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:40.376225 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40b866-8c03-4a07-b331-3e881813b304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:40.376851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40b866-8c03-4a07-b331-3e881813b304 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:40.377153 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40b866-8c03-4a07-b331-3e881813b304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:40.377430 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40b866-8c03-4a07-b331-3e881813b304 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:40.378102 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40b866-8c03-4a07-b331-3e881813b304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:40.380008 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40b866-8c03-4a07-b331-3e881813b304 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:40.405708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1111/2216] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:38:40 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:38:40.409952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ec75a-5713-4752-b07f-9fe2285692e9 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:40.420997 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ec75a-5713-4752-b07f-9fe2285692e9 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:40.476784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1e555-85c3-4c6a-8473-df92f689ef40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:40.477409 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1e555-85c3-4c6a-8473-df92f689ef40 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:40.477691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1e555-85c3-4c6a-8473-df92f689ef40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:40.477967 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1e555-85c3-4c6a-8473-df92f689ef40 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:40.478598 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1e555-85c3-4c6a-8473-df92f689ef40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:40.480503 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1e555-85c3-4c6a-8473-df92f689ef40 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:40.500512 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1106/2217] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:38:40 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:38:40.504446 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40b866-8c03-4a07-b331-3e881813b304 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:40.515306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40b866-8c03-4a07-b331-3e881813b304 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:40.519925 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad02c56-9a21-473f-996f-c12887486ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:40.520518 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad02c56-9a21-473f-996f-c12887486ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:40.520797 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad02c56-9a21-473f-996f-c12887486ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:40.521071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad02c56-9a21-473f-996f-c12887486ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:40.521747 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad02c56-9a21-473f-996f-c12887486ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:40.523323 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad02c56-9a21-473f-996f-c12887486ff9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:40.533523 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1112/2218] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:38:40.537516 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1e555-85c3-4c6a-8473-df92f689ef40 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:40.547999 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1e555-85c3-4c6a-8473-df92f689ef40 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:40.552514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7c108-78fb-4458-b5a0-e0d3f83379bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:40.553167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7c108-78fb-4458-b5a0-e0d3f83379bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:40.553447 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7c108-78fb-4458-b5a0-e0d3f83379bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:40.553719 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7c108-78fb-4458-b5a0-e0d3f83379bb admin admin] PATH_INFO: `/v3/projects/ee46c867d7874599b8eff1d4484de9b5/users/5e99f9f49ae342fc9c978e0cff00f32f/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:40.569546 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7c108-78fb-4458-b5a0-e0d3f83379bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee46c867d7874599b8eff1d4484de9b5, user_id=5e99f9f49ae342fc9c978e0cff00f32f, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:40.572241 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7c108-78fb-4458-b5a0-e0d3f83379bb admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:40.584792 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1107/2219] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:38:40 2022] PUT /identity/v3/projects/ee46c867d7874599b8eff1d4484de9b5/users/5e99f9f49ae342fc9c978e0cff00f32f/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:38:40.588745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad02c56-9a21-473f-996f-c12887486ff9 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:40.598779 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad02c56-9a21-473f-996f-c12887486ff9 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:40.658756 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8ae20-facf-43b8-9e69-a25f66e4d779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:40.659276 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8ae20-facf-43b8-9e69-a25f66e4d779 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:40.659560 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8ae20-facf-43b8-9e69-a25f66e4d779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:40.659837 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8ae20-facf-43b8-9e69-a25f66e4d779 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:40.660482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8ae20-facf-43b8-9e69-a25f66e4d779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:40.662470 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8ae20-facf-43b8-9e69-a25f66e4d779 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:40.673261 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1113/2220] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:38:40.677500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7c108-78fb-4458-b5a0-e0d3f83379bb admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:40.688129 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7c108-78fb-4458-b5a0-e0d3f83379bb admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:40.693140 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b758810-cfd3-4d93-85b7-62e7a1d18ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:40.693414 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b758810-cfd3-4d93-85b7-62e7a1d18ded admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:40.693691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b758810-cfd3-4d93-85b7-62e7a1d18ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:40.693958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b758810-cfd3-4d93-85b7-62e7a1d18ded admin admin] PATH_INFO: `/v3/projects/ee46c867d7874599b8eff1d4484de9b5/users/5e99f9f49ae342fc9c978e0cff00f32f/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:40.695851 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b758810-cfd3-4d93-85b7-62e7a1d18ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee46c867d7874599b8eff1d4484de9b5, user_id=5e99f9f49ae342fc9c978e0cff00f32f, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:40.698506 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b758810-cfd3-4d93-85b7-62e7a1d18ded admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:40.708825 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1108/2221] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:38:40 2022] PUT /identity/v3/projects/ee46c867d7874599b8eff1d4484de9b5/users/5e99f9f49ae342fc9c978e0cff00f32f/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:38:40.720570 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a606932-45fb-4982-824b-86980e6dae7a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:40.721000 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a606932-45fb-4982-824b-86980e6dae7a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:40.721315 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a606932-45fb-4982-824b-86980e6dae7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:40.752221 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9a606932-45fb-4982-824b-86980e6dae7a None None] MFA Rules not processed for user `5e99f9f49ae342fc9c978e0cff00f32f`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:40.753806 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9a606932-45fb-4982-824b-86980e6dae7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:40.826754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1114/2222] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:38:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:38:40.838905 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b758810-cfd3-4d93-85b7-62e7a1d18ded admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:40.840694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3b758810-cfd3-4d93-85b7-62e7a1d18ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:40.847149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:40.904584 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b758810-cfd3-4d93-85b7-62e7a1d18ded admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:40.908545 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c7785-5d0c-443d-ae58-5157968cf3e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:40.909258 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c7785-5d0c-443d-ae58-5157968cf3e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:40.909475 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c7785-5d0c-443d-ae58-5157968cf3e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:40.909734 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c7785-5d0c-443d-ae58-5157968cf3e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:40.919843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c7785-5d0c-443d-ae58-5157968cf3e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:40.921320 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c7785-5d0c-443d-ae58-5157968cf3e3 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:40.932937 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1109/2223] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:38:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:38:40.967079 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a606932-45fb-4982-824b-86980e6dae7a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:41.024166 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:41.041700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a606932-45fb-4982-824b-86980e6dae7a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:41.046962 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e0a6f-d0b1-46eb-91f9-40f65cc291f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:41.047626 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e0a6f-d0b1-46eb-91f9-40f65cc291f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:41.047906 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e0a6f-d0b1-46eb-91f9-40f65cc291f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:41.048177 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e0a6f-d0b1-46eb-91f9-40f65cc291f7 admin admin] PATH_INFO: `/v3/users/23e6da023a3c43178743babb9679947e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:41.049330 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e0a6f-d0b1-46eb-91f9-40f65cc291f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23e6da023a3c43178743babb9679947e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:41.051213 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e0a6f-d0b1-46eb-91f9-40f65cc291f7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:41.105419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a6e0a6f-d0b1-46eb-91f9-40f65cc291f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23e6da023a3c43178743babb9679947e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:41.113263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a6e0a6f-d0b1-46eb-91f9-40f65cc291f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23e6da023a3c43178743babb9679947e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:41.113871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a6e0a6f-d0b1-46eb-91f9-40f65cc291f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23e6da023a3c43178743babb9679947e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:41.126090 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a6e0a6f-d0b1-46eb-91f9-40f65cc291f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23e6da023a3c43178743babb9679947e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:41.132873 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a6e0a6f-d0b1-46eb-91f9-40f65cc291f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23e6da023a3c43178743babb9679947e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:41.141045 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1115/2224] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:38:40 2022] DELETE /identity/v3/users/23e6da023a3c43178743babb9679947e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:38:41.145488 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694338a6-bf07-44b7-9e3b-252e4776d3ae None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:41.145792 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694338a6-bf07-44b7-9e3b-252e4776d3ae None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:41.146065 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694338a6-bf07-44b7-9e3b-252e4776d3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:41.165842 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-694338a6-bf07-44b7-9e3b-252e4776d3ae None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:41.167026 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-694338a6-bf07-44b7-9e3b-252e4776d3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:41.227765 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1110/2225] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:38:41.237584 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e0a6f-d0b1-46eb-91f9-40f65cc291f7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:41.239437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0a6e0a6f-d0b1-46eb-91f9-40f65cc291f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:41.298365 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e0a6f-d0b1-46eb-91f9-40f65cc291f7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:41.302010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e825806-91a1-4c65-911d-e9c8e65247f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:41.302617 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e825806-91a1-4c65-911d-e9c8e65247f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:41.302893 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e825806-91a1-4c65-911d-e9c8e65247f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:41.303167 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e825806-91a1-4c65-911d-e9c8e65247f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:41.312698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e825806-91a1-4c65-911d-e9c8e65247f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:41.314164 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e825806-91a1-4c65-911d-e9c8e65247f6 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:41.324074 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1116/2226] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:38:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:38:41.592974 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694338a6-bf07-44b7-9e3b-252e4776d3ae None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:41.594552 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-694338a6-bf07-44b7-9e3b-252e4776d3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:41.608650 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694338a6-bf07-44b7-9e3b-252e4776d3ae None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:41.614524 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299c91e-4bc6-488b-9b77-7f4978234d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:41.615515 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299c91e-4bc6-488b-9b77-7f4978234d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:41.615922 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299c91e-4bc6-488b-9b77-7f4978234d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:41.616399 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299c91e-4bc6-488b-9b77-7f4978234d1b admin admin] PATH_INFO: `/v3/projects/4b554f5b0fc64cbf829d574f66508a5e` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:41.617716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299c91e-4bc6-488b-9b77-7f4978234d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b554f5b0fc64cbf829d574f66508a5e)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:41.619802 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299c91e-4bc6-488b-9b77-7f4978234d1b admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:41.669843 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-2299c91e-4bc6-488b-9b77-7f4978234d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b554f5b0fc64cbf829d574f66508a5e', 'request_id': 'req-2299c91e-4bc6-488b-9b77-7f4978234d1b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:41.675297 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-2299c91e-4bc6-488b-9b77-7f4978234d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b554f5b0fc64cbf829d574f66508a5e', 'request_id': 'req-2299c91e-4bc6-488b-9b77-7f4978234d1b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:41.682089 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-2299c91e-4bc6-488b-9b77-7f4978234d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b554f5b0fc64cbf829d574f66508a5e', 'request_id': 'req-2299c91e-4bc6-488b-9b77-7f4978234d1b'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:41.694323 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-2299c91e-4bc6-488b-9b77-7f4978234d1b admin admin] The token cache is being invalidate because project 4b554f5b0fc64cbf829d574f66508a5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:38:41.694614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-2299c91e-4bc6-488b-9b77-7f4978234d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:41.695783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-2299c91e-4bc6-488b-9b77-7f4978234d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:41.697290 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1111/2227] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:38:41 2022] DELETE /identity/v3/projects/4b554f5b0fc64cbf829d574f66508a5e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:38:41.701656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e825806-91a1-4c65-911d-e9c8e65247f6 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:41.711215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e825806-91a1-4c65-911d-e9c8e65247f6 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:41.765721 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc0dcb-99f6-485b-ab40-cb2861da8884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:41.766341 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc0dcb-99f6-485b-ab40-cb2861da8884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:41.766622 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc0dcb-99f6-485b-ab40-cb2861da8884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:41.766897 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc0dcb-99f6-485b-ab40-cb2861da8884 admin admin] PATH_INFO: `/v3/users/5e99f9f49ae342fc9c978e0cff00f32f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:41.768024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc0dcb-99f6-485b-ab40-cb2861da8884 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e99f9f49ae342fc9c978e0cff00f32f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:41.769968 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc0dcb-99f6-485b-ab40-cb2861da8884 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:41.781851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:41.814969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8edc0dcb-99f6-485b-ab40-cb2861da8884 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e99f9f49ae342fc9c978e0cff00f32f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:41.822847 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8edc0dcb-99f6-485b-ab40-cb2861da8884 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e99f9f49ae342fc9c978e0cff00f32f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:41.823497 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8edc0dcb-99f6-485b-ab40-cb2861da8884 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e99f9f49ae342fc9c978e0cff00f32f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:41.842514 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8edc0dcb-99f6-485b-ab40-cb2861da8884 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e99f9f49ae342fc9c978e0cff00f32f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:41.850453 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8edc0dcb-99f6-485b-ab40-cb2861da8884 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e99f9f49ae342fc9c978e0cff00f32f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:41.856331 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1117/2228] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:38:41 2022] DELETE /identity/v3/users/5e99f9f49ae342fc9c978e0cff00f32f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:38:42.145496 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299c91e-4bc6-488b-9b77-7f4978234d1b admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:42.145496 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2299c91e-4bc6-488b-9b77-7f4978234d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:42.153461 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299c91e-4bc6-488b-9b77-7f4978234d1b admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:42.192170 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:42.227618 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064c862-043e-4fd4-bad5-2066b5560165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:42.228343 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064c862-043e-4fd4-bad5-2066b5560165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:42.228688 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064c862-043e-4fd4-bad5-2066b5560165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:42.228968 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064c862-043e-4fd4-bad5-2066b5560165 admin admin] PATH_INFO: `/v3/projects/ee46c867d7874599b8eff1d4484de9b5` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:42.232457 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064c862-043e-4fd4-bad5-2066b5560165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee46c867d7874599b8eff1d4484de9b5)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:42.234423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064c862-043e-4fd4-bad5-2066b5560165 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:42.287321 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e064c862-043e-4fd4-bad5-2066b5560165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee46c867d7874599b8eff1d4484de9b5', 'request_id': 'req-e064c862-043e-4fd4-bad5-2066b5560165'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:42.294432 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e064c862-043e-4fd4-bad5-2066b5560165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee46c867d7874599b8eff1d4484de9b5', 'request_id': 'req-e064c862-043e-4fd4-bad5-2066b5560165'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:42.300511 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e064c862-043e-4fd4-bad5-2066b5560165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee46c867d7874599b8eff1d4484de9b5', 'request_id': 'req-e064c862-043e-4fd4-bad5-2066b5560165'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:42.314492 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e064c862-043e-4fd4-bad5-2066b5560165 admin admin] The token cache is being invalidate because project ee46c867d7874599b8eff1d4484de9b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:38:42.314777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e064c862-043e-4fd4-bad5-2066b5560165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:42.315387 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-e064c862-043e-4fd4-bad5-2066b5560165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:42.316859 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1112/2229] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:38:42 2022] DELETE /identity/v3/projects/ee46c867d7874599b8eff1d4484de9b5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:38:42.322338 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b682f-0f49-4b51-b6fc-2a2d2b594c77 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:42.322842 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b682f-0f49-4b51-b6fc-2a2d2b594c77 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:42.322941 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b682f-0f49-4b51-b6fc-2a2d2b594c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:42.342641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c52b682f-0f49-4b51-b6fc-2a2d2b594c77 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:42.343828 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c52b682f-0f49-4b51-b6fc-2a2d2b594c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:42.400752 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1118/2230] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:38:42.408894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb3ed3-f50d-417c-860c-75cc2bdb9bdb None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:42.409214 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb3ed3-f50d-417c-860c-75cc2bdb9bdb None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:42.409531 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb3ed3-f50d-417c-860c-75cc2bdb9bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:42.429975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-89eb3ed3-f50d-417c-860c-75cc2bdb9bdb None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:42.431182 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-89eb3ed3-f50d-417c-860c-75cc2bdb9bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:42.439009 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1113/2231] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:38:42.443221 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b682f-0f49-4b51-b6fc-2a2d2b594c77 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:42.452855 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b682f-0f49-4b51-b6fc-2a2d2b594c77 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:42.457542 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719d308-e4da-4fff-8191-8ba94e64f275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:42.458078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719d308-e4da-4fff-8191-8ba94e64f275 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:42.458356 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719d308-e4da-4fff-8191-8ba94e64f275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:42.458631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719d308-e4da-4fff-8191-8ba94e64f275 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:42.459278 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719d308-e4da-4fff-8191-8ba94e64f275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:38:42.459582 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719d308-e4da-4fff-8191-8ba94e64f275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:42.461710 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719d308-e4da-4fff-8191-8ba94e64f275 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:42.473393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1119/2232] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:38:42.478145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb3ed3-f50d-417c-860c-75cc2bdb9bdb None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:42.487311 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb3ed3-f50d-417c-860c-75cc2bdb9bdb None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:42.492046 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdadc79-f5e2-4db2-8dd5-518399306c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:42.492629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdadc79-f5e2-4db2-8dd5-518399306c57 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:42.492905 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdadc79-f5e2-4db2-8dd5-518399306c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:42.493205 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdadc79-f5e2-4db2-8dd5-518399306c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:42.493825 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdadc79-f5e2-4db2-8dd5-518399306c57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:42.495745 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdadc79-f5e2-4db2-8dd5-518399306c57 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:42.524209 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1114/2233] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:38:42 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:38:42.528428 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719d308-e4da-4fff-8191-8ba94e64f275 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:42.538507 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719d308-e4da-4fff-8191-8ba94e64f275 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:42.593576 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5ec7b-eddb-404c-9bc7-bde596cdf295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:42.594174 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5ec7b-eddb-404c-9bc7-bde596cdf295 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:42.594459 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5ec7b-eddb-404c-9bc7-bde596cdf295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:42.594731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5ec7b-eddb-404c-9bc7-bde596cdf295 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:42.595366 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5ec7b-eddb-404c-9bc7-bde596cdf295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:42.597306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5ec7b-eddb-404c-9bc7-bde596cdf295 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:42.618383 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1120/2234] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:38:42 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:38:42.622777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdadc79-f5e2-4db2-8dd5-518399306c57 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:42.632956 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdadc79-f5e2-4db2-8dd5-518399306c57 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:42.637531 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4cc48e-4c6b-407b-b87a-11ee1f8479d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:42.638120 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cc48e-4c6b-407b-b87a-11ee1f8479d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:42.638400 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cc48e-4c6b-407b-b87a-11ee1f8479d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:42.638671 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cc48e-4c6b-407b-b87a-11ee1f8479d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:42.639316 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4cc48e-4c6b-407b-b87a-11ee1f8479d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:42.640897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4cc48e-4c6b-407b-b87a-11ee1f8479d2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:42.651295 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1115/2235] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:38:42.655177 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5ec7b-eddb-404c-9bc7-bde596cdf295 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:42.665877 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5ec7b-eddb-404c-9bc7-bde596cdf295 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:42.670773 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82289731-030c-4949-bc71-27e408cd2dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:42.671365 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82289731-030c-4949-bc71-27e408cd2dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:42.671650 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82289731-030c-4949-bc71-27e408cd2dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:42.671927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82289731-030c-4949-bc71-27e408cd2dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:42.672569 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82289731-030c-4949-bc71-27e408cd2dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:42.674185 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82289731-030c-4949-bc71-27e408cd2dd3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:42.675416 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:42.688820 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1121/2236] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:38:42.690022 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4cc48e-4c6b-407b-b87a-11ee1f8479d2 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:42.700038 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4cc48e-4c6b-407b-b87a-11ee1f8479d2 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:42.704647 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba77c5-1255-47fc-96fe-88a697be17ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:42.705522 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba77c5-1255-47fc-96fe-88a697be17ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:42.705838 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba77c5-1255-47fc-96fe-88a697be17ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:42.706231 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba77c5-1255-47fc-96fe-88a697be17ba admin admin] PATH_INFO: `/v3/projects/20711abe790241be8bbe0e292e3ee7f1/users/f0680eabce12461cb4d8607637dc295f/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:42.720984 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba77c5-1255-47fc-96fe-88a697be17ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=20711abe790241be8bbe0e292e3ee7f1, user_id=f0680eabce12461cb4d8607637dc295f, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:42.723649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba77c5-1255-47fc-96fe-88a697be17ba admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:42.736742 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1116/2237] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:38:42 2022] PUT /identity/v3/projects/20711abe790241be8bbe0e292e3ee7f1/users/f0680eabce12461cb4d8607637dc295f/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:38:42.746803 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb33717-b621-40c7-b69b-c091d413c045 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:42.747122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb33717-b621-40c7-b69b-c091d413c045 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:42.747397 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb33717-b621-40c7-b69b-c091d413c045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:42.774789 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-deb33717-b621-40c7-b69b-c091d413c045 None None] MFA Rules not processed for user `f0680eabce12461cb4d8607637dc295f`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:42.776028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-deb33717-b621-40c7-b69b-c091d413c045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:42.839292 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1122/2238] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:38:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:38:42.843642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba77c5-1255-47fc-96fe-88a697be17ba admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:42.900308 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:42.904083 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba77c5-1255-47fc-96fe-88a697be17ba admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:42.909707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4abf3-449b-45da-8f98-c1e2bc7b66f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:42.910491 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4abf3-449b-45da-8f98-c1e2bc7b66f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:42.910950 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4abf3-449b-45da-8f98-c1e2bc7b66f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:42.911286 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4abf3-449b-45da-8f98-c1e2bc7b66f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:42.912057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4abf3-449b-45da-8f98-c1e2bc7b66f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:42.914015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4abf3-449b-45da-8f98-c1e2bc7b66f7 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:42.938960 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1117/2239] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:38:42 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:38:42.942980 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb33717-b621-40c7-b69b-c091d413c045 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:42.953941 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb33717-b621-40c7-b69b-c091d413c045 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:43.009802 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de2500-9bfa-4508-9018-c35b839da755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:43.010334 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de2500-9bfa-4508-9018-c35b839da755 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:43.010613 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de2500-9bfa-4508-9018-c35b839da755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:43.010889 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de2500-9bfa-4508-9018-c35b839da755 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:43.011529 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de2500-9bfa-4508-9018-c35b839da755 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:43.013442 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de2500-9bfa-4508-9018-c35b839da755 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:43.034259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1123/2240] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:38:42 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:38:43.038230 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4abf3-449b-45da-8f98-c1e2bc7b66f7 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:43.048653 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4abf3-449b-45da-8f98-c1e2bc7b66f7 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:43.053328 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6af7b-fe3c-4a4b-b49c-1ceeb684a2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:43.053921 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6af7b-fe3c-4a4b-b49c-1ceeb684a2ed admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:43.054199 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6af7b-fe3c-4a4b-b49c-1ceeb684a2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:43.054495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6af7b-fe3c-4a4b-b49c-1ceeb684a2ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:43.055139 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6af7b-fe3c-4a4b-b49c-1ceeb684a2ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:43.056705 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6af7b-fe3c-4a4b-b49c-1ceeb684a2ed admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:43.068242 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1118/2241] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:38:43.071760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de2500-9bfa-4508-9018-c35b839da755 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:43.082811 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de2500-9bfa-4508-9018-c35b839da755 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:43.087932 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b437b-812e-43c2-8480-6321870e1bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:43.088582 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b437b-812e-43c2-8480-6321870e1bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:43.088864 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b437b-812e-43c2-8480-6321870e1bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:43.089255 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b437b-812e-43c2-8480-6321870e1bf6 admin admin] PATH_INFO: `/v3/projects/457d1f4c98be4b0e8289bf2ce88db3ee/users/616a2dd2bccf4b14a38b017d29291407/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:43.103516 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b437b-812e-43c2-8480-6321870e1bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=457d1f4c98be4b0e8289bf2ce88db3ee, user_id=616a2dd2bccf4b14a38b017d29291407, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:43.106231 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b437b-812e-43c2-8480-6321870e1bf6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:43.118800 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1124/2242] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:38:43 2022] PUT /identity/v3/projects/457d1f4c98be4b0e8289bf2ce88db3ee/users/616a2dd2bccf4b14a38b017d29291407/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:38:43.122651 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6af7b-fe3c-4a4b-b49c-1ceeb684a2ed admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:43.132887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6af7b-fe3c-4a4b-b49c-1ceeb684a2ed admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:43.188647 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274b11e-11de-46aa-bc8e-c826d1168544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:43.189285 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274b11e-11de-46aa-bc8e-c826d1168544 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:43.189608 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274b11e-11de-46aa-bc8e-c826d1168544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:43.189823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274b11e-11de-46aa-bc8e-c826d1168544 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:43.190464 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274b11e-11de-46aa-bc8e-c826d1168544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:43.192030 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274b11e-11de-46aa-bc8e-c826d1168544 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:43.206342 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1119/2243] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:38:43.207299 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b437b-812e-43c2-8480-6321870e1bf6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:43.217826 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b437b-812e-43c2-8480-6321870e1bf6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:43.222436 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf04aa-18bc-4446-83d4-d9debd489e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:43.223087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf04aa-18bc-4446-83d4-d9debd489e4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:43.223368 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf04aa-18bc-4446-83d4-d9debd489e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:43.223682 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf04aa-18bc-4446-83d4-d9debd489e4d admin admin] PATH_INFO: `/v3/projects/457d1f4c98be4b0e8289bf2ce88db3ee/users/616a2dd2bccf4b14a38b017d29291407/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:43.225885 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf04aa-18bc-4446-83d4-d9debd489e4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=457d1f4c98be4b0e8289bf2ce88db3ee, user_id=616a2dd2bccf4b14a38b017d29291407, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:43.228609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf04aa-18bc-4446-83d4-d9debd489e4d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:43.239256 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1125/2244] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:38:43 2022] PUT /identity/v3/projects/457d1f4c98be4b0e8289bf2ce88db3ee/users/616a2dd2bccf4b14a38b017d29291407/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:38:43.250892 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2c1bf-4b54-4327-9638-016233c4daf1 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:43.251184 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2c1bf-4b54-4327-9638-016233c4daf1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:43.251456 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2c1bf-4b54-4327-9638-016233c4daf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:43.279756 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e4b2c1bf-4b54-4327-9638-016233c4daf1 None None] MFA Rules not processed for user `616a2dd2bccf4b14a38b017d29291407`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:43.280947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e4b2c1bf-4b54-4327-9638-016233c4daf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:43.349348 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1120/2245] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:38:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:38:43.359749 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf04aa-18bc-4446-83d4-d9debd489e4d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:43.361518 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6fbf04aa-18bc-4446-83d4-d9debd489e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:43.406143 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:43.425175 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf04aa-18bc-4446-83d4-d9debd489e4d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:43.429965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d5dbe-7d46-4ace-a828-f1691a903f66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:43.430573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d5dbe-7d46-4ace-a828-f1691a903f66 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:43.430854 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d5dbe-7d46-4ace-a828-f1691a903f66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:43.431149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d5dbe-7d46-4ace-a828-f1691a903f66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:43.491190 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d5dbe-7d46-4ace-a828-f1691a903f66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:43.493182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d5dbe-7d46-4ace-a828-f1691a903f66 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:43.502985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1126/2246] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:38:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:38:47.687668 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2c1bf-4b54-4327-9638-016233c4daf1 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:47.689197 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e4b2c1bf-4b54-4327-9638-016233c4daf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:47.701681 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2c1bf-4b54-4327-9638-016233c4daf1 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:47.705199 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756936a-13c8-4fff-9500-8424684b25fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:47.705790 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756936a-13c8-4fff-9500-8424684b25fe service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:47.706068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756936a-13c8-4fff-9500-8424684b25fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:47.706340 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756936a-13c8-4fff-9500-8424684b25fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:47.715028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756936a-13c8-4fff-9500-8424684b25fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:47.716449 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756936a-13c8-4fff-9500-8424684b25fe service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:47.726014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1121/2247] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:38:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:38:52.626875 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d5dbe-7d46-4ace-a828-f1691a903f66 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:52.687268 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d5dbe-7d46-4ace-a828-f1691a903f66 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:52.692763 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196f296-4fe9-41db-a347-810380a82447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:52.693411 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196f296-4fe9-41db-a347-810380a82447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:52.693688 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196f296-4fe9-41db-a347-810380a82447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:52.693954 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196f296-4fe9-41db-a347-810380a82447 admin admin] PATH_INFO: `/v3/users/f0680eabce12461cb4d8607637dc295f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:52.695054 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196f296-4fe9-41db-a347-810380a82447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0680eabce12461cb4d8607637dc295f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:52.697560 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196f296-4fe9-41db-a347-810380a82447 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:52.743368 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9196f296-4fe9-41db-a347-810380a82447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0680eabce12461cb4d8607637dc295f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:52.750288 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9196f296-4fe9-41db-a347-810380a82447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0680eabce12461cb4d8607637dc295f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:52.750940 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9196f296-4fe9-41db-a347-810380a82447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0680eabce12461cb4d8607637dc295f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:52.763016 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9196f296-4fe9-41db-a347-810380a82447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0680eabce12461cb4d8607637dc295f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:52.769654 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9196f296-4fe9-41db-a347-810380a82447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0680eabce12461cb4d8607637dc295f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:52.775903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1127/2248] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:38:52 2022] DELETE /identity/v3/users/f0680eabce12461cb4d8607637dc295f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:38:52.780295 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c960270-1507-4d96-af3b-596938548b3f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:52.780786 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c960270-1507-4d96-af3b-596938548b3f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:52.780902 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c960270-1507-4d96-af3b-596938548b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:52.800857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-1c960270-1507-4d96-af3b-596938548b3f None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:52.802088 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1c960270-1507-4d96-af3b-596938548b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:52.835707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:52.864370 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1122/2249] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:38:52.874566 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196f296-4fe9-41db-a347-810380a82447 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:52.876444 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9196f296-4fe9-41db-a347-810380a82447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:52.890831 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:52.937971 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196f296-4fe9-41db-a347-810380a82447 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:52.942464 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e9984-b012-4447-84d4-b989bf7a48bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:52.943179 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e9984-b012-4447-84d4-b989bf7a48bb service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:52.943456 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e9984-b012-4447-84d4-b989bf7a48bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:52.943728 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e9984-b012-4447-84d4-b989bf7a48bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:52.954026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e9984-b012-4447-84d4-b989bf7a48bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:52.955477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e9984-b012-4447-84d4-b989bf7a48bb service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:52.965421 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1128/2250] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:38:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:38:53.226198 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c960270-1507-4d96-af3b-596938548b3f None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:53.227801 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1c960270-1507-4d96-af3b-596938548b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:53.240492 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c960270-1507-4d96-af3b-596938548b3f None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:53.246691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99349865-eb7f-4d9e-8f47-a11b90d2119c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:53.247395 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99349865-eb7f-4d9e-8f47-a11b90d2119c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:53.247808 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99349865-eb7f-4d9e-8f47-a11b90d2119c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:53.248200 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99349865-eb7f-4d9e-8f47-a11b90d2119c admin admin] PATH_INFO: `/v3/projects/20711abe790241be8bbe0e292e3ee7f1` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:53.249514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99349865-eb7f-4d9e-8f47-a11b90d2119c admin admin] RBAC: Authorizing `identity:delete_project(project_id=20711abe790241be8bbe0e292e3ee7f1)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:53.251496 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99349865-eb7f-4d9e-8f47-a11b90d2119c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:53.300500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-99349865-eb7f-4d9e-8f47-a11b90d2119c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20711abe790241be8bbe0e292e3ee7f1', 'request_id': 'req-99349865-eb7f-4d9e-8f47-a11b90d2119c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:53.306629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-99349865-eb7f-4d9e-8f47-a11b90d2119c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20711abe790241be8bbe0e292e3ee7f1', 'request_id': 'req-99349865-eb7f-4d9e-8f47-a11b90d2119c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:53.312637 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-99349865-eb7f-4d9e-8f47-a11b90d2119c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20711abe790241be8bbe0e292e3ee7f1', 'request_id': 'req-99349865-eb7f-4d9e-8f47-a11b90d2119c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:53.324966 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-99349865-eb7f-4d9e-8f47-a11b90d2119c admin admin] The token cache is being invalidate because project 20711abe790241be8bbe0e292e3ee7f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:38:53.325206 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-99349865-eb7f-4d9e-8f47-a11b90d2119c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:53.325824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-99349865-eb7f-4d9e-8f47-a11b90d2119c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:53.327280 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1123/2251] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:38:53 2022] DELETE /identity/v3/projects/20711abe790241be8bbe0e292e3ee7f1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:38:53.331298 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e9984-b012-4447-84d4-b989bf7a48bb service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:53.341686 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e9984-b012-4447-84d4-b989bf7a48bb service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:53.396257 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9e773-37bb-4922-b10e-bd01fa0f6d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:53.396883 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9e773-37bb-4922-b10e-bd01fa0f6d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:53.397195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9e773-37bb-4922-b10e-bd01fa0f6d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:53.397479 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9e773-37bb-4922-b10e-bd01fa0f6d3f admin admin] PATH_INFO: `/v3/users/616a2dd2bccf4b14a38b017d29291407` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:53.398629 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9e773-37bb-4922-b10e-bd01fa0f6d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=616a2dd2bccf4b14a38b017d29291407)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:53.401188 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9e773-37bb-4922-b10e-bd01fa0f6d3f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:53.450028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8cc9e773-37bb-4922-b10e-bd01fa0f6d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '616a2dd2bccf4b14a38b017d29291407'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:53.457188 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8cc9e773-37bb-4922-b10e-bd01fa0f6d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '616a2dd2bccf4b14a38b017d29291407'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:53.457802 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8cc9e773-37bb-4922-b10e-bd01fa0f6d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '616a2dd2bccf4b14a38b017d29291407'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:53.469975 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8cc9e773-37bb-4922-b10e-bd01fa0f6d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '616a2dd2bccf4b14a38b017d29291407'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:53.476605 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8cc9e773-37bb-4922-b10e-bd01fa0f6d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '616a2dd2bccf4b14a38b017d29291407'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:53.482421 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1129/2252] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:38:53 2022] DELETE /identity/v3/users/616a2dd2bccf4b14a38b017d29291407 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:38:53.749091 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99349865-eb7f-4d9e-8f47-a11b90d2119c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:53.750605 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-99349865-eb7f-4d9e-8f47-a11b90d2119c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:53.766037 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99349865-eb7f-4d9e-8f47-a11b90d2119c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:53.822871 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0ad44-1015-4af6-b3b8-85e556f843c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:53.823563 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0ad44-1015-4af6-b3b8-85e556f843c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:53.823770 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0ad44-1015-4af6-b3b8-85e556f843c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:53.824045 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0ad44-1015-4af6-b3b8-85e556f843c2 admin admin] PATH_INFO: `/v3/projects/457d1f4c98be4b0e8289bf2ce88db3ee` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:53.825184 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0ad44-1015-4af6-b3b8-85e556f843c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=457d1f4c98be4b0e8289bf2ce88db3ee)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:53.827061 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0ad44-1015-4af6-b3b8-85e556f843c2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:53.871650 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7be0ad44-1015-4af6-b3b8-85e556f843c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '457d1f4c98be4b0e8289bf2ce88db3ee', 'request_id': 'req-7be0ad44-1015-4af6-b3b8-85e556f843c2'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:53.878738 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7be0ad44-1015-4af6-b3b8-85e556f843c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '457d1f4c98be4b0e8289bf2ce88db3ee', 'request_id': 'req-7be0ad44-1015-4af6-b3b8-85e556f843c2'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:53.885377 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7be0ad44-1015-4af6-b3b8-85e556f843c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '457d1f4c98be4b0e8289bf2ce88db3ee', 'request_id': 'req-7be0ad44-1015-4af6-b3b8-85e556f843c2'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:53.887801 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:53.899124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7be0ad44-1015-4af6-b3b8-85e556f843c2 admin admin] The token cache is being invalidate because project 457d1f4c98be4b0e8289bf2ce88db3ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:38:53.899451 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7be0ad44-1015-4af6-b3b8-85e556f843c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:53.900087 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-7be0ad44-1015-4af6-b3b8-85e556f843c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:53.901605 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1124/2253] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:38:53 2022] DELETE /identity/v3/projects/457d1f4c98be4b0e8289bf2ce88db3ee => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:38:53.907500 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d6c55-226a-4a6b-86de-23dff2041cca None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:53.907961 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d6c55-226a-4a6b-86de-23dff2041cca None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:53.908088 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d6c55-226a-4a6b-86de-23dff2041cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:53.928255 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-957d6c55-226a-4a6b-86de-23dff2041cca None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:53.929424 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-957d6c55-226a-4a6b-86de-23dff2041cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:53.958782 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:53.990533 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1130/2254] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:38:53.999617 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7ee89-ab01-448a-9d4b-11b5427842cd None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:53.999902 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7ee89-ab01-448a-9d4b-11b5427842cd None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:54.000174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7ee89-ab01-448a-9d4b-11b5427842cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:54.020423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-cfb7ee89-ab01-448a-9d4b-11b5427842cd None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:54.021654 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-cfb7ee89-ab01-448a-9d4b-11b5427842cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:54.029547 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1125/2255] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:38:54.033802 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d6c55-226a-4a6b-86de-23dff2041cca None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:54.044009 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d6c55-226a-4a6b-86de-23dff2041cca None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:54.048518 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adbd47-229a-44ed-8683-a531582da6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:54.049134 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adbd47-229a-44ed-8683-a531582da6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:54.049422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adbd47-229a-44ed-8683-a531582da6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:54.049701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adbd47-229a-44ed-8683-a531582da6a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:54.050348 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adbd47-229a-44ed-8683-a531582da6a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:38:54.050648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adbd47-229a-44ed-8683-a531582da6a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:54.052217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adbd47-229a-44ed-8683-a531582da6a0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:54.067230 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1131/2256] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:38:54.072633 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7ee89-ab01-448a-9d4b-11b5427842cd None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:54.082061 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7ee89-ab01-448a-9d4b-11b5427842cd None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:54.087030 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fc76e-3eb6-4fdd-a936-13926c07c57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:54.087629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fc76e-3eb6-4fdd-a936-13926c07c57d admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:54.087908 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fc76e-3eb6-4fdd-a936-13926c07c57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:54.088178 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fc76e-3eb6-4fdd-a936-13926c07c57d admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:54.088817 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fc76e-3eb6-4fdd-a936-13926c07c57d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:54.090738 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fc76e-3eb6-4fdd-a936-13926c07c57d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:54.119077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1126/2257] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:38:54 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:38:54.123209 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adbd47-229a-44ed-8683-a531582da6a0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:54.133502 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adbd47-229a-44ed-8683-a531582da6a0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:54.192393 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ea568-5cbb-4c4d-9eb6-c7b0859bc01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:54.192925 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ea568-5cbb-4c4d-9eb6-c7b0859bc01a admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:54.193241 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ea568-5cbb-4c4d-9eb6-c7b0859bc01a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:54.193514 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ea568-5cbb-4c4d-9eb6-c7b0859bc01a admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:54.194153 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ea568-5cbb-4c4d-9eb6-c7b0859bc01a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:54.196072 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ea568-5cbb-4c4d-9eb6-c7b0859bc01a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:54.216780 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1132/2258] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:38:54 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:38:54.220931 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fc76e-3eb6-4fdd-a936-13926c07c57d admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:54.231768 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fc76e-3eb6-4fdd-a936-13926c07c57d admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:54.236315 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3434b-5cfb-4ba6-956d-1e8f361ac93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:54.236906 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3434b-5cfb-4ba6-956d-1e8f361ac93a admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:54.237223 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3434b-5cfb-4ba6-956d-1e8f361ac93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:54.237498 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3434b-5cfb-4ba6-956d-1e8f361ac93a admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:54.238142 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3434b-5cfb-4ba6-956d-1e8f361ac93a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:54.239719 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3434b-5cfb-4ba6-956d-1e8f361ac93a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:54.250171 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1127/2259] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:38:54.253839 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ea568-5cbb-4c4d-9eb6-c7b0859bc01a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:54.264093 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ea568-5cbb-4c4d-9eb6-c7b0859bc01a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:54.268739 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec69f2-1e36-4056-8472-193f1e3ed4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:54.269359 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec69f2-1e36-4056-8472-193f1e3ed4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:54.269640 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec69f2-1e36-4056-8472-193f1e3ed4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:54.269914 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec69f2-1e36-4056-8472-193f1e3ed4e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:54.270553 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec69f2-1e36-4056-8472-193f1e3ed4e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:54.272123 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec69f2-1e36-4056-8472-193f1e3ed4e1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:54.282565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1133/2260] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:38:54.286485 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3434b-5cfb-4ba6-956d-1e8f361ac93a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:54.297137 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3434b-5cfb-4ba6-956d-1e8f361ac93a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:54.301724 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4569c-4316-4de0-af95-5445a0613a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:54.302362 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4569c-4316-4de0-af95-5445a0613a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:54.302648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4569c-4316-4de0-af95-5445a0613a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:54.302922 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4569c-4316-4de0-af95-5445a0613a42 admin admin] PATH_INFO: `/v3/projects/498a2d8fd5b04e79a6fd13c3735b07c6/users/c391d0a469574b9ea6881ff33a3882b0/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:54.318594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4569c-4316-4de0-af95-5445a0613a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=498a2d8fd5b04e79a6fd13c3735b07c6, user_id=c391d0a469574b9ea6881ff33a3882b0, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:54.321578 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4569c-4316-4de0-af95-5445a0613a42 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:54.334958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1128/2261] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:38:54 2022] PUT /identity/v3/projects/498a2d8fd5b04e79a6fd13c3735b07c6/users/c391d0a469574b9ea6881ff33a3882b0/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:38:54.346229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065cb6c-a6a5-4d90-a343-2d5110f744ff None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:54.346513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065cb6c-a6a5-4d90-a343-2d5110f744ff None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:54.346784 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065cb6c-a6a5-4d90-a343-2d5110f744ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:54.374621 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4065cb6c-a6a5-4d90-a343-2d5110f744ff None None] MFA Rules not processed for user `c391d0a469574b9ea6881ff33a3882b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:38:54.375863 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4065cb6c-a6a5-4d90-a343-2d5110f744ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:54.437695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1134/2262] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:38:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:38:54.448772 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4569c-4316-4de0-af95-5445a0613a42 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:54.450533 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-cca4569c-4316-4de0-af95-5445a0613a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:38:54.505636 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4569c-4316-4de0-af95-5445a0613a42 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:54.509158 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a30be-63a1-497b-a8a5-50a0604181c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:54.509757 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a30be-63a1-497b-a8a5-50a0604181c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:54.510032 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a30be-63a1-497b-a8a5-50a0604181c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:54.510326 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a30be-63a1-497b-a8a5-50a0604181c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:54.518294 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a30be-63a1-497b-a8a5-50a0604181c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:54.519699 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a30be-63a1-497b-a8a5-50a0604181c1 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:54.528691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1129/2263] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:38:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:38:59.845687 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065cb6c-a6a5-4d90-a343-2d5110f744ff None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:38:59.876929 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:38:59.910111 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065cb6c-a6a5-4d90-a343-2d5110f744ff None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:38:59.914502 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e19de-652e-451c-a6c3-8efda23ae905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:38:59.915127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e19de-652e-451c-a6c3-8efda23ae905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:38:59.915403 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e19de-652e-451c-a6c3-8efda23ae905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:38:59.915675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e19de-652e-451c-a6c3-8efda23ae905 admin admin] PATH_INFO: `/v3/users/c391d0a469574b9ea6881ff33a3882b0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:38:59.916776 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e19de-652e-451c-a6c3-8efda23ae905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c391d0a469574b9ea6881ff33a3882b0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:38:59.918962 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e19de-652e-451c-a6c3-8efda23ae905 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:38:59.963640 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9d5e19de-652e-451c-a6c3-8efda23ae905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c391d0a469574b9ea6881ff33a3882b0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:59.971615 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9d5e19de-652e-451c-a6c3-8efda23ae905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c391d0a469574b9ea6881ff33a3882b0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:59.972365 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9d5e19de-652e-451c-a6c3-8efda23ae905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c391d0a469574b9ea6881ff33a3882b0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:59.984530 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9d5e19de-652e-451c-a6c3-8efda23ae905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c391d0a469574b9ea6881ff33a3882b0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:59.991364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9d5e19de-652e-451c-a6c3-8efda23ae905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c391d0a469574b9ea6881ff33a3882b0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:38:59.997946 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1135/2264] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:38:59 2022] DELETE /identity/v3/users/c391d0a469574b9ea6881ff33a3882b0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:00.002333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c649c-958e-49a9-b434-b26cf03e4c13 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:00.002826 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c649c-958e-49a9-b434-b26cf03e4c13 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:00.003585 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c649c-958e-49a9-b434-b26cf03e4c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:00.022228 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-547c649c-958e-49a9-b434-b26cf03e4c13 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:00.023423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-547c649c-958e-49a9-b434-b26cf03e4c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:00.084230 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1130/2265] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:00.095818 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e19de-652e-451c-a6c3-8efda23ae905 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:00.097253 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9d5e19de-652e-451c-a6c3-8efda23ae905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:00.160064 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e19de-652e-451c-a6c3-8efda23ae905 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:00.166834 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9ea8d-0337-456e-9894-aba5c3293a88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:00.168036 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9ea8d-0337-456e-9894-aba5c3293a88 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:00.168821 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9ea8d-0337-456e-9894-aba5c3293a88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:00.169207 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9ea8d-0337-456e-9894-aba5c3293a88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:00.181452 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f9ea8d-0337-456e-9894-aba5c3293a88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:00.184039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f9ea8d-0337-456e-9894-aba5c3293a88 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:00.200171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1136/2266] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:39:00.491070 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c649c-958e-49a9-b434-b26cf03e4c13 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:00.492570 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-547c649c-958e-49a9-b434-b26cf03e4c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:00.510237 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c649c-958e-49a9-b434-b26cf03e4c13 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:00.515076 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9b830-a67f-4174-900c-5ec818f3d1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:00.515697 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9b830-a67f-4174-900c-5ec818f3d1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:00.515957 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9b830-a67f-4174-900c-5ec818f3d1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:00.516231 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9b830-a67f-4174-900c-5ec818f3d1b8 admin admin] PATH_INFO: `/v3/projects/498a2d8fd5b04e79a6fd13c3735b07c6` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:00.517479 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9b830-a67f-4174-900c-5ec818f3d1b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=498a2d8fd5b04e79a6fd13c3735b07c6)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:00.519387 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9b830-a67f-4174-900c-5ec818f3d1b8 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:00.554102 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:00.571849 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3ea9b830-a67f-4174-900c-5ec818f3d1b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '498a2d8fd5b04e79a6fd13c3735b07c6', 'request_id': 'req-3ea9b830-a67f-4174-900c-5ec818f3d1b8'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:00.579462 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3ea9b830-a67f-4174-900c-5ec818f3d1b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '498a2d8fd5b04e79a6fd13c3735b07c6', 'request_id': 'req-3ea9b830-a67f-4174-900c-5ec818f3d1b8'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:00.586045 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3ea9b830-a67f-4174-900c-5ec818f3d1b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '498a2d8fd5b04e79a6fd13c3735b07c6', 'request_id': 'req-3ea9b830-a67f-4174-900c-5ec818f3d1b8'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:00.600553 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3ea9b830-a67f-4174-900c-5ec818f3d1b8 admin admin] The token cache is being invalidate because project 498a2d8fd5b04e79a6fd13c3735b07c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:39:00.600852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3ea9b830-a67f-4174-900c-5ec818f3d1b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:00.601712 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3ea9b830-a67f-4174-900c-5ec818f3d1b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:00.603870 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1131/2267] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:39:00 2022] DELETE /identity/v3/projects/498a2d8fd5b04e79a6fd13c3735b07c6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:00.608797 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907663a-0f98-480e-ab87-d127942a6288 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:00.609085 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907663a-0f98-480e-ab87-d127942a6288 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:00.609399 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907663a-0f98-480e-ab87-d127942a6288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:00.630634 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b907663a-0f98-480e-ab87-d127942a6288 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:00.632493 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b907663a-0f98-480e-ab87-d127942a6288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:00.693436 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:00.714002 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1137/2268] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:00.721646 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364efbab-104e-46d9-9fcd-99566398c1b4 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:00.722000 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364efbab-104e-46d9-9fcd-99566398c1b4 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:00.722348 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364efbab-104e-46d9-9fcd-99566398c1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:00.744146 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-364efbab-104e-46d9-9fcd-99566398c1b4 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:00.745392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-364efbab-104e-46d9-9fcd-99566398c1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:00.754266 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1132/2269] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:00.759105 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907663a-0f98-480e-ab87-d127942a6288 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:00.768716 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907663a-0f98-480e-ab87-d127942a6288 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:00.773230 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b5230-3c05-4010-b353-abfb309de3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:00.773904 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b5230-3c05-4010-b353-abfb309de3ab admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:00.774207 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b5230-3c05-4010-b353-abfb309de3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:00.774993 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b5230-3c05-4010-b353-abfb309de3ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:00.775640 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b5230-3c05-4010-b353-abfb309de3ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:39:00.775940 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b5230-3c05-4010-b353-abfb309de3ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:00.777545 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b5230-3c05-4010-b353-abfb309de3ab admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:00.789160 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1138/2270] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:39:00.793732 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364efbab-104e-46d9-9fcd-99566398c1b4 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:00.802862 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364efbab-104e-46d9-9fcd-99566398c1b4 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:00.807590 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf09ca1-f11b-43e7-bc22-899bb8b8910f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:00.808192 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf09ca1-f11b-43e7-bc22-899bb8b8910f admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:00.808470 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf09ca1-f11b-43e7-bc22-899bb8b8910f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:00.808764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf09ca1-f11b-43e7-bc22-899bb8b8910f admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:00.809435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf09ca1-f11b-43e7-bc22-899bb8b8910f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:00.811314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf09ca1-f11b-43e7-bc22-899bb8b8910f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:00.844170 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1133/2271] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:39:00 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:39:00.845328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b5230-3c05-4010-b353-abfb309de3ab admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:00.855475 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b5230-3c05-4010-b353-abfb309de3ab admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:00.914772 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fb4d7-5a91-441a-9c9b-4cf9a0c3a77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:00.915387 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fb4d7-5a91-441a-9c9b-4cf9a0c3a77c admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:00.915683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fb4d7-5a91-441a-9c9b-4cf9a0c3a77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:00.915943 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fb4d7-5a91-441a-9c9b-4cf9a0c3a77c admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:00.916877 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999fb4d7-5a91-441a-9c9b-4cf9a0c3a77c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:00.919294 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999fb4d7-5a91-441a-9c9b-4cf9a0c3a77c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:00.944191 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1139/2272] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:39:00 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:39:00.948493 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf09ca1-f11b-43e7-bc22-899bb8b8910f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:00.960165 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf09ca1-f11b-43e7-bc22-899bb8b8910f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:00.966458 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af917775-33dd-4480-ba63-058f42e36a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:00.967067 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af917775-33dd-4480-ba63-058f42e36a36 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:00.967344 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af917775-33dd-4480-ba63-058f42e36a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:00.967611 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af917775-33dd-4480-ba63-058f42e36a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:00.968255 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af917775-33dd-4480-ba63-058f42e36a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:00.969879 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af917775-33dd-4480-ba63-058f42e36a36 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:00.980530 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1134/2273] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:00.984609 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fb4d7-5a91-441a-9c9b-4cf9a0c3a77c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:00.995159 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fb4d7-5a91-441a-9c9b-4cf9a0c3a77c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:01.000096 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa3845-e1b3-4887-b5b8-f29cb3ceb9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:01.000712 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa3845-e1b3-4887-b5b8-f29cb3ceb9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:01.000997 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa3845-e1b3-4887-b5b8-f29cb3ceb9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:01.001462 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa3845-e1b3-4887-b5b8-f29cb3ceb9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:01.002454 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa3845-e1b3-4887-b5b8-f29cb3ceb9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:01.003808 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa3845-e1b3-4887-b5b8-f29cb3ceb9c0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:01.019055 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1140/2274] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:01.020280 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af917775-33dd-4480-ba63-058f42e36a36 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:01.031220 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af917775-33dd-4480-ba63-058f42e36a36 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:01.035980 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a04b6-62dc-408a-bf1f-9c6cc67279cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:01.036623 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a04b6-62dc-408a-bf1f-9c6cc67279cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:01.036898 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a04b6-62dc-408a-bf1f-9c6cc67279cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:01.037193 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a04b6-62dc-408a-bf1f-9c6cc67279cd admin admin] PATH_INFO: `/v3/projects/48328f3810984dea92ff1119e2a222b6/users/a664e0d0f771468d86cf4c3636aa6b71/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:01.052284 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a04b6-62dc-408a-bf1f-9c6cc67279cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=48328f3810984dea92ff1119e2a222b6, user_id=a664e0d0f771468d86cf4c3636aa6b71, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:01.055089 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a04b6-62dc-408a-bf1f-9c6cc67279cd admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:01.074817 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1135/2275] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:39:01 2022] PUT /identity/v3/projects/48328f3810984dea92ff1119e2a222b6/users/a664e0d0f771468d86cf4c3636aa6b71/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:01.086120 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8948d4-e765-4e00-824b-3eea4e2c88fc None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:01.086418 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8948d4-e765-4e00-824b-3eea4e2c88fc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:01.086776 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8948d4-e765-4e00-824b-3eea4e2c88fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:01.116549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5c8948d4-e765-4e00-824b-3eea4e2c88fc None None] MFA Rules not processed for user `a664e0d0f771468d86cf4c3636aa6b71`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:01.117855 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5c8948d4-e765-4e00-824b-3eea4e2c88fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:01.189419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1141/2276] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:01.202093 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a04b6-62dc-408a-bf1f-9c6cc67279cd admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:01.203699 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9e2a04b6-62dc-408a-bf1f-9c6cc67279cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:01.261485 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a04b6-62dc-408a-bf1f-9c6cc67279cd admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:01.265044 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340cfa9-15f1-47f7-a8b7-524c6f329ac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:01.265677 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340cfa9-15f1-47f7-a8b7-524c6f329ac1 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:01.265956 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340cfa9-15f1-47f7-a8b7-524c6f329ac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:01.266227 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340cfa9-15f1-47f7-a8b7-524c6f329ac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:01.274767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340cfa9-15f1-47f7-a8b7-524c6f329ac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:01.276180 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340cfa9-15f1-47f7-a8b7-524c6f329ac1 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:01.285652 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1136/2277] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:39:04.222001 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8948d4-e765-4e00-824b-3eea4e2c88fc None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:04.310433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:04.341482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8948d4-e765-4e00-824b-3eea4e2c88fc None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:04.353988 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26827d-aff8-4569-a93d-46d3d745a3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:04.354645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26827d-aff8-4569-a93d-46d3d745a3ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:04.354934 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26827d-aff8-4569-a93d-46d3d745a3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:04.355214 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26827d-aff8-4569-a93d-46d3d745a3ed admin admin] PATH_INFO: `/v3/users/a664e0d0f771468d86cf4c3636aa6b71` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:04.356409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26827d-aff8-4569-a93d-46d3d745a3ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=a664e0d0f771468d86cf4c3636aa6b71)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:04.358944 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26827d-aff8-4569-a93d-46d3d745a3ed admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:04.437603 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6a26827d-aff8-4569-a93d-46d3d745a3ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a664e0d0f771468d86cf4c3636aa6b71'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:04.464971 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6a26827d-aff8-4569-a93d-46d3d745a3ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a664e0d0f771468d86cf4c3636aa6b71'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:04.466530 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6a26827d-aff8-4569-a93d-46d3d745a3ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a664e0d0f771468d86cf4c3636aa6b71'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:04.501945 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6a26827d-aff8-4569-a93d-46d3d745a3ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a664e0d0f771468d86cf4c3636aa6b71'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:04.511747 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6a26827d-aff8-4569-a93d-46d3d745a3ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a664e0d0f771468d86cf4c3636aa6b71'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:04.523266 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1142/2278] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:39:04 2022] DELETE /identity/v3/users/a664e0d0f771468d86cf4c3636aa6b71 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:04.528152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174c537-eb35-4654-8dd1-4ebe1036d5b1 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:04.528678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174c537-eb35-4654-8dd1-4ebe1036d5b1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:04.528880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174c537-eb35-4654-8dd1-4ebe1036d5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:04.554810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-6174c537-eb35-4654-8dd1-4ebe1036d5b1 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:04.556866 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6174c537-eb35-4654-8dd1-4ebe1036d5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:04.610613 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:04.638151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1137/2279] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:04.646685 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26827d-aff8-4569-a93d-46d3d745a3ed admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:04.652066 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6a26827d-aff8-4569-a93d-46d3d745a3ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:04.757449 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26827d-aff8-4569-a93d-46d3d745a3ed admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:04.767932 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f6ca4-9ee5-4813-8290-75c7bf568637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:04.768634 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f6ca4-9ee5-4813-8290-75c7bf568637 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:04.768984 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f6ca4-9ee5-4813-8290-75c7bf568637 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:04.769436 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f6ca4-9ee5-4813-8290-75c7bf568637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:04.783945 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f6ca4-9ee5-4813-8290-75c7bf568637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:04.785593 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f6ca4-9ee5-4813-8290-75c7bf568637 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:04.806675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1143/2280] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:39:04.905822 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174c537-eb35-4654-8dd1-4ebe1036d5b1 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:04.908057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-6174c537-eb35-4654-8dd1-4ebe1036d5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:05.059627 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174c537-eb35-4654-8dd1-4ebe1036d5b1 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:05.066071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0576255-2a4d-4529-b5f0-6e7a0a4ba3ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18c015b8317b4517911f69bef21a0573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:05.067205 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0576255-2a4d-4529-b5f0-6e7a0a4ba3ba service placement] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:05.067645 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0576255-2a4d-4529-b5f0-6e7a0a4ba3ba service placement] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:05.068109 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0576255-2a4d-4529-b5f0-6e7a0a4ba3ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:05.070666 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e0576255-2a4d-4529-b5f0-6e7a0a4ba3ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:05.086677 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0576255-2a4d-4529-b5f0-6e7a0a4ba3ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:05.088629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0576255-2a4d-4529-b5f0-6e7a0a4ba3ba service placement] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:05.100055 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1138/2281] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:39:05.463317 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f6ca4-9ee5-4813-8290-75c7bf568637 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:05.465430 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-992f6ca4-9ee5-4813-8290-75c7bf568637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:05.478689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f6ca4-9ee5-4813-8290-75c7bf568637 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:05.483432 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a29ba2-762d-4012-a6c8-5a53429d5f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:05.484136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a29ba2-762d-4012-a6c8-5a53429d5f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:05.484483 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a29ba2-762d-4012-a6c8-5a53429d5f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:05.484970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a29ba2-762d-4012-a6c8-5a53429d5f3b admin admin] PATH_INFO: `/v3/projects/48328f3810984dea92ff1119e2a222b6` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:05.486186 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a29ba2-762d-4012-a6c8-5a53429d5f3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=48328f3810984dea92ff1119e2a222b6)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:05.488078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a29ba2-762d-4012-a6c8-5a53429d5f3b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:05.538491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-30a29ba2-762d-4012-a6c8-5a53429d5f3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48328f3810984dea92ff1119e2a222b6', 'request_id': 'req-30a29ba2-762d-4012-a6c8-5a53429d5f3b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:05.546545 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-30a29ba2-762d-4012-a6c8-5a53429d5f3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48328f3810984dea92ff1119e2a222b6', 'request_id': 'req-30a29ba2-762d-4012-a6c8-5a53429d5f3b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:05.552401 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:05.553692 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-30a29ba2-762d-4012-a6c8-5a53429d5f3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48328f3810984dea92ff1119e2a222b6', 'request_id': 'req-30a29ba2-762d-4012-a6c8-5a53429d5f3b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:05.567218 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-30a29ba2-762d-4012-a6c8-5a53429d5f3b admin admin] The token cache is being invalidate because project 48328f3810984dea92ff1119e2a222b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:39:05.567499 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-30a29ba2-762d-4012-a6c8-5a53429d5f3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:05.568158 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-30a29ba2-762d-4012-a6c8-5a53429d5f3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:05.569721 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1144/2282] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:39:05 2022] DELETE /identity/v3/projects/48328f3810984dea92ff1119e2a222b6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:07.161055 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0576255-2a4d-4529-b5f0-6e7a0a4ba3ba service placement] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:07.163006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e0576255-2a4d-4529-b5f0-6e7a0a4ba3ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:07.176534 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0576255-2a4d-4529-b5f0-6e7a0a4ba3ba service placement] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:07.233168 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afee61-dcf5-4455-9aa9-faa3a00ae33c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:07.234382 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afee61-dcf5-4455-9aa9-faa3a00ae33c service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:07.234382 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afee61-dcf5-4455-9aa9-faa3a00ae33c service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:07.234637 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afee61-dcf5-4455-9aa9-faa3a00ae33c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:07.236527 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e8afee61-dcf5-4455-9aa9-faa3a00ae33c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:07.338084 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afee61-dcf5-4455-9aa9-faa3a00ae33c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:07.339768 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afee61-dcf5-4455-9aa9-faa3a00ae33c service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:07.349878 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1139/2283] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:39:08.711970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a29ba2-762d-4012-a6c8-5a53429d5f3b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:08.713639 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-30a29ba2-762d-4012-a6c8-5a53429d5f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:08.729264 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a29ba2-762d-4012-a6c8-5a53429d5f3b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:08.734644 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6654b6-229c-43fd-9cf5-1cad6a5b877a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:08.735533 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6654b6-229c-43fd-9cf5-1cad6a5b877a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:08.735980 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6654b6-229c-43fd-9cf5-1cad6a5b877a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:08.736538 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6654b6-229c-43fd-9cf5-1cad6a5b877a admin admin] PATH_INFO: `/v3/users/b5b1ccd53284448b9df415c1bc60e978` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:08.737965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6654b6-229c-43fd-9cf5-1cad6a5b877a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5b1ccd53284448b9df415c1bc60e978)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:08.740265 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6654b6-229c-43fd-9cf5-1cad6a5b877a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:08.796386 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2c6654b6-229c-43fd-9cf5-1cad6a5b877a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5b1ccd53284448b9df415c1bc60e978'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:08.806772 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2c6654b6-229c-43fd-9cf5-1cad6a5b877a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5b1ccd53284448b9df415c1bc60e978'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:08.807458 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2c6654b6-229c-43fd-9cf5-1cad6a5b877a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5b1ccd53284448b9df415c1bc60e978'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:08.822857 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2c6654b6-229c-43fd-9cf5-1cad6a5b877a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5b1ccd53284448b9df415c1bc60e978'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:08.830854 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2c6654b6-229c-43fd-9cf5-1cad6a5b877a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5b1ccd53284448b9df415c1bc60e978'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:08.853142 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1145/2284] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:39:08 2022] DELETE /identity/v3/users/b5b1ccd53284448b9df415c1bc60e978 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:09.115670 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afee61-dcf5-4455-9aa9-faa3a00ae33c service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:09.129442 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afee61-dcf5-4455-9aa9-faa3a00ae33c service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:09.189049 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:09.218655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5b6e6-9f04-4c85-a540-851372fe7fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:09.219294 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5b6e6-9f04-4c85-a540-851372fe7fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:09.219577 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5b6e6-9f04-4c85-a540-851372fe7fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:09.219854 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5b6e6-9f04-4c85-a540-851372fe7fb5 admin admin] PATH_INFO: `/v3/projects/c3df72ef3154498ca266d2e3abdc7f8c` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:09.220980 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5b6e6-9f04-4c85-a540-851372fe7fb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3df72ef3154498ca266d2e3abdc7f8c)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:09.222941 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5b6e6-9f04-4c85-a540-851372fe7fb5 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:09.294882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-21d5b6e6-9f04-4c85-a540-851372fe7fb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3df72ef3154498ca266d2e3abdc7f8c', 'request_id': 'req-21d5b6e6-9f04-4c85-a540-851372fe7fb5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:09.301008 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-21d5b6e6-9f04-4c85-a540-851372fe7fb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3df72ef3154498ca266d2e3abdc7f8c', 'request_id': 'req-21d5b6e6-9f04-4c85-a540-851372fe7fb5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:09.308663 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-21d5b6e6-9f04-4c85-a540-851372fe7fb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3df72ef3154498ca266d2e3abdc7f8c', 'request_id': 'req-21d5b6e6-9f04-4c85-a540-851372fe7fb5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:09.324621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-21d5b6e6-9f04-4c85-a540-851372fe7fb5 admin admin] The token cache is being invalidate because project c3df72ef3154498ca266d2e3abdc7f8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:39:09.324621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-21d5b6e6-9f04-4c85-a540-851372fe7fb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:09.325242 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-21d5b6e6-9f04-4c85-a540-851372fe7fb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:09.330304 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1140/2285] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:39:09 2022] DELETE /identity/v3/projects/c3df72ef3154498ca266d2e3abdc7f8c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:09.331646 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6654b6-229c-43fd-9cf5-1cad6a5b877a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:09.333867 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2c6654b6-229c-43fd-9cf5-1cad6a5b877a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:09.349012 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6654b6-229c-43fd-9cf5-1cad6a5b877a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:09.425896 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6975b-1179-4fb2-b422-05dc16f147b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:09.427320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6975b-1179-4fb2-b422-05dc16f147b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:09.428019 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6975b-1179-4fb2-b422-05dc16f147b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:09.428573 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6975b-1179-4fb2-b422-05dc16f147b0 admin admin] PATH_INFO: `/v3/users/fdb82d5de0744988a3e10d93be848e50` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:09.430091 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6975b-1179-4fb2-b422-05dc16f147b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb82d5de0744988a3e10d93be848e50)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:09.433648 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6975b-1179-4fb2-b422-05dc16f147b0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:09.505285 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0ab6975b-1179-4fb2-b422-05dc16f147b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb82d5de0744988a3e10d93be848e50'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:09.515136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0ab6975b-1179-4fb2-b422-05dc16f147b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb82d5de0744988a3e10d93be848e50'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:09.515763 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0ab6975b-1179-4fb2-b422-05dc16f147b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb82d5de0744988a3e10d93be848e50'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:09.533631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:09.539667 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0ab6975b-1179-4fb2-b422-05dc16f147b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb82d5de0744988a3e10d93be848e50'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:09.550357 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0ab6975b-1179-4fb2-b422-05dc16f147b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb82d5de0744988a3e10d93be848e50'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:09.562334 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1146/2286] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:39:09 2022] DELETE /identity/v3/users/fdb82d5de0744988a3e10d93be848e50 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:39:10.152319 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5b6e6-9f04-4c85-a540-851372fe7fb5 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:10.153919 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-21d5b6e6-9f04-4c85-a540-851372fe7fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:10.169227 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5b6e6-9f04-4c85-a540-851372fe7fb5 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:10.242300 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31454c-3339-4d03-8723-ef58adad5c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:10.242300 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31454c-3339-4d03-8723-ef58adad5c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:10.242300 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31454c-3339-4d03-8723-ef58adad5c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:10.242300 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31454c-3339-4d03-8723-ef58adad5c8f admin admin] PATH_INFO: `/v3/projects/b08df27c491847669ff6e3a1454f0c42` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:10.247805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31454c-3339-4d03-8723-ef58adad5c8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b08df27c491847669ff6e3a1454f0c42)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:10.250298 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31454c-3339-4d03-8723-ef58adad5c8f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:10.305148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0e31454c-3339-4d03-8723-ef58adad5c8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b08df27c491847669ff6e3a1454f0c42', 'request_id': 'req-0e31454c-3339-4d03-8723-ef58adad5c8f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:10.311467 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0e31454c-3339-4d03-8723-ef58adad5c8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b08df27c491847669ff6e3a1454f0c42', 'request_id': 'req-0e31454c-3339-4d03-8723-ef58adad5c8f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:10.318514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0e31454c-3339-4d03-8723-ef58adad5c8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b08df27c491847669ff6e3a1454f0c42', 'request_id': 'req-0e31454c-3339-4d03-8723-ef58adad5c8f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:10.322684 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:10.333407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0e31454c-3339-4d03-8723-ef58adad5c8f admin admin] The token cache is being invalidate because project b08df27c491847669ff6e3a1454f0c42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:39:10.333996 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0e31454c-3339-4d03-8723-ef58adad5c8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:10.335031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-0e31454c-3339-4d03-8723-ef58adad5c8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:10.337639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1141/2287] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:39:10 2022] DELETE /identity/v3/projects/b08df27c491847669ff6e3a1454f0c42 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:11.266470 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6975b-1179-4fb2-b422-05dc16f147b0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:11.267980 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0ab6975b-1179-4fb2-b422-05dc16f147b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:11.283149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6975b-1179-4fb2-b422-05dc16f147b0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:11.338986 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59caa05f-a9a2-4e80-a735-d3ebe0c306b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:11.339634 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caa05f-a9a2-4e80-a735-d3ebe0c306b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:11.339912 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caa05f-a9a2-4e80-a735-d3ebe0c306b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:11.340181 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caa05f-a9a2-4e80-a735-d3ebe0c306b4 admin admin] PATH_INFO: `/v3/users/5a9e86876ed8467cb1fad623af5c8d5b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:11.341314 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59caa05f-a9a2-4e80-a735-d3ebe0c306b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a9e86876ed8467cb1fad623af5c8d5b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:11.343216 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59caa05f-a9a2-4e80-a735-d3ebe0c306b4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:11.388561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-59caa05f-a9a2-4e80-a735-d3ebe0c306b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a9e86876ed8467cb1fad623af5c8d5b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:11.395088 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-59caa05f-a9a2-4e80-a735-d3ebe0c306b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a9e86876ed8467cb1fad623af5c8d5b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:11.395712 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-59caa05f-a9a2-4e80-a735-d3ebe0c306b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a9e86876ed8467cb1fad623af5c8d5b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:11.407755 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-59caa05f-a9a2-4e80-a735-d3ebe0c306b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a9e86876ed8467cb1fad623af5c8d5b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:11.415213 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-59caa05f-a9a2-4e80-a735-d3ebe0c306b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a9e86876ed8467cb1fad623af5c8d5b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:11.421362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1147/2288] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:39:11 2022] DELETE /identity/v3/users/5a9e86876ed8467cb1fad623af5c8d5b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:11.833673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31454c-3339-4d03-8723-ef58adad5c8f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:11.835190 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0e31454c-3339-4d03-8723-ef58adad5c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:11.849966 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31454c-3339-4d03-8723-ef58adad5c8f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:11.907970 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08fb6d-862b-4f7c-8916-d60e2370a302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:11.908598 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08fb6d-862b-4f7c-8916-d60e2370a302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:11.908874 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08fb6d-862b-4f7c-8916-d60e2370a302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:11.909169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08fb6d-862b-4f7c-8916-d60e2370a302 admin admin] PATH_INFO: `/v3/projects/303f4ada97514dbd9175db972f5fa5e8` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:11.910260 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08fb6d-862b-4f7c-8916-d60e2370a302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=303f4ada97514dbd9175db972f5fa5e8)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:11.912132 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08fb6d-862b-4f7c-8916-d60e2370a302 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:11.957350 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3f08fb6d-862b-4f7c-8916-d60e2370a302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '303f4ada97514dbd9175db972f5fa5e8', 'request_id': 'req-3f08fb6d-862b-4f7c-8916-d60e2370a302'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:11.963481 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3f08fb6d-862b-4f7c-8916-d60e2370a302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '303f4ada97514dbd9175db972f5fa5e8', 'request_id': 'req-3f08fb6d-862b-4f7c-8916-d60e2370a302'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:11.969634 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3f08fb6d-862b-4f7c-8916-d60e2370a302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '303f4ada97514dbd9175db972f5fa5e8', 'request_id': 'req-3f08fb6d-862b-4f7c-8916-d60e2370a302'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:11.981449 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3f08fb6d-862b-4f7c-8916-d60e2370a302 admin admin] The token cache is being invalidate because project 303f4ada97514dbd9175db972f5fa5e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:39:11.981737 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3f08fb6d-862b-4f7c-8916-d60e2370a302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:11.982366 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-3f08fb6d-862b-4f7c-8916-d60e2370a302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:11.983836 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1142/2289] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:39:11 2022] DELETE /identity/v3/projects/303f4ada97514dbd9175db972f5fa5e8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:11.988688 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113bc21-043b-466c-a78e-93738d9a069f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:11.988979 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113bc21-043b-466c-a78e-93738d9a069f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:11.989290 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113bc21-043b-466c-a78e-93738d9a069f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:12.009214 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1113bc21-043b-466c-a78e-93738d9a069f None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:12.010443 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1113bc21-043b-466c-a78e-93738d9a069f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:12.068798 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1148/2290] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:12.077094 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5d8c5-5e2c-47d4-a834-203424d1d3af None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:12.077408 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5d8c5-5e2c-47d4-a834-203424d1d3af None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:12.077682 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5d8c5-5e2c-47d4-a834-203424d1d3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:12.097039 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-b5e5d8c5-5e2c-47d4-a834-203424d1d3af None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:12.098256 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b5e5d8c5-5e2c-47d4-a834-203424d1d3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:12.105940 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1143/2291] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:12.110182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113bc21-043b-466c-a78e-93738d9a069f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:12.115049 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:12.121630 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113bc21-043b-466c-a78e-93738d9a069f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:12.126880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845aab27-980c-4303-956e-91828aac3a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:12.127481 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845aab27-980c-4303-956e-91828aac3a25 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:12.127761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845aab27-980c-4303-956e-91828aac3a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:12.128034 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845aab27-980c-4303-956e-91828aac3a25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:12.128678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845aab27-980c-4303-956e-91828aac3a25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:39:12.128997 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845aab27-980c-4303-956e-91828aac3a25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:12.130596 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845aab27-980c-4303-956e-91828aac3a25 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:12.142534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1149/2292] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:39:12.146679 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5d8c5-5e2c-47d4-a834-203424d1d3af None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:12.155728 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5d8c5-5e2c-47d4-a834-203424d1d3af None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:12.160265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817063d1-2527-4964-a4d0-fd62b4f44332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:12.160848 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817063d1-2527-4964-a4d0-fd62b4f44332 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:12.161185 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817063d1-2527-4964-a4d0-fd62b4f44332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:12.161455 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817063d1-2527-4964-a4d0-fd62b4f44332 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:12.162077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817063d1-2527-4964-a4d0-fd62b4f44332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:12.163932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817063d1-2527-4964-a4d0-fd62b4f44332 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:12.190308 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1144/2293] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:39:12 2022] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:39:12.194347 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845aab27-980c-4303-956e-91828aac3a25 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:12.204865 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845aab27-980c-4303-956e-91828aac3a25 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:12.260493 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09219d4f-abe1-4e99-95f6-d5339f69ce29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:12.261085 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09219d4f-abe1-4e99-95f6-d5339f69ce29 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:12.261394 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09219d4f-abe1-4e99-95f6-d5339f69ce29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:12.261663 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09219d4f-abe1-4e99-95f6-d5339f69ce29 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:12.262285 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09219d4f-abe1-4e99-95f6-d5339f69ce29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:12.264152 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09219d4f-abe1-4e99-95f6-d5339f69ce29 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:12.285436 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1150/2294] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:39:12 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:39:12.289640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817063d1-2527-4964-a4d0-fd62b4f44332 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:12.300091 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817063d1-2527-4964-a4d0-fd62b4f44332 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:12.304653 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9a541-5530-477c-8de3-449b12b2d990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:12.305845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9a541-5530-477c-8de3-449b12b2d990 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:12.306125 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9a541-5530-477c-8de3-449b12b2d990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:12.306419 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9a541-5530-477c-8de3-449b12b2d990 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:12.307061 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9a541-5530-477c-8de3-449b12b2d990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:12.308618 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9a541-5530-477c-8de3-449b12b2d990 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:12.318254 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1145/2295] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:12.322651 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09219d4f-abe1-4e99-95f6-d5339f69ce29 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:12.332448 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09219d4f-abe1-4e99-95f6-d5339f69ce29 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:12.337126 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8ff0c-ff27-4078-930d-8f4db74283db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:12.337719 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8ff0c-ff27-4078-930d-8f4db74283db admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:12.338018 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8ff0c-ff27-4078-930d-8f4db74283db admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:12.338395 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8ff0c-ff27-4078-930d-8f4db74283db admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:12.338919 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8ff0c-ff27-4078-930d-8f4db74283db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:12.340501 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8ff0c-ff27-4078-930d-8f4db74283db admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:12.350918 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1151/2296] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:39:12.354865 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9a541-5530-477c-8de3-449b12b2d990 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:12.364679 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9a541-5530-477c-8de3-449b12b2d990 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:12.370006 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f09bf-50b3-49da-8fd3-8a987fa7dd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:12.370647 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f09bf-50b3-49da-8fd3-8a987fa7dd2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:12.370928 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f09bf-50b3-49da-8fd3-8a987fa7dd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:12.371202 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f09bf-50b3-49da-8fd3-8a987fa7dd2c admin admin] PATH_INFO: `/v3/projects/b714a76efd54431480a504eb0f74abb6/users/d4ceb0f156ef4be88a2ad9b18d1ee809/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:12.386265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f09bf-50b3-49da-8fd3-8a987fa7dd2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b714a76efd54431480a504eb0f74abb6, user_id=d4ceb0f156ef4be88a2ad9b18d1ee809, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:12.388897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f09bf-50b3-49da-8fd3-8a987fa7dd2c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:12.402409 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1146/2297] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:39:12 2022] PUT /identity/v3/projects/b714a76efd54431480a504eb0f74abb6/users/d4ceb0f156ef4be88a2ad9b18d1ee809/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:12.412781 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679905e-a574-403d-b470-29dcce31dda3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:12.413077 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679905e-a574-403d-b470-29dcce31dda3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:12.413391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679905e-a574-403d-b470-29dcce31dda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:12.442191 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0679905e-a574-403d-b470-29dcce31dda3 None None] MFA Rules not processed for user `d4ceb0f156ef4be88a2ad9b18d1ee809`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:12.443391 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0679905e-a574-403d-b470-29dcce31dda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:12.505785 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1152/2298] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:12 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:12.510440 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f09bf-50b3-49da-8fd3-8a987fa7dd2c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:12.535325 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:12.574254 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f09bf-50b3-49da-8fd3-8a987fa7dd2c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:12.578829 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac42f3-8ff9-4e9d-b32c-cb0035f3baa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:12.579426 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac42f3-8ff9-4e9d-b32c-cb0035f3baa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:12.579708 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac42f3-8ff9-4e9d-b32c-cb0035f3baa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:12.579983 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac42f3-8ff9-4e9d-b32c-cb0035f3baa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:12.580605 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac42f3-8ff9-4e9d-b32c-cb0035f3baa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:12.582511 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac42f3-8ff9-4e9d-b32c-cb0035f3baa0 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:12.608460 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1147/2299] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:39:12 2022] POST /identity/v3/projects => generated 403 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:39:12.612531 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679905e-a574-403d-b470-29dcce31dda3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:12.624165 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679905e-a574-403d-b470-29dcce31dda3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:12.673854 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:12.681275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460d814-bd78-429e-8fc1-d5879f77e17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:12.682095 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460d814-bd78-429e-8fc1-d5879f77e17d admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:12.682406 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460d814-bd78-429e-8fc1-d5879f77e17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:12.682680 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460d814-bd78-429e-8fc1-d5879f77e17d admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:12.683304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460d814-bd78-429e-8fc1-d5879f77e17d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:12.685259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460d814-bd78-429e-8fc1-d5879f77e17d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:12.705384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1153/2300] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:39:12 2022] POST /identity/v3/users => generated 308 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:39:12.709376 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac42f3-8ff9-4e9d-b32c-cb0035f3baa0 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:12.719605 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac42f3-8ff9-4e9d-b32c-cb0035f3baa0 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:12.724232 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d9d82-d3fe-4a23-b57f-0f6977e51e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:12.724818 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d9d82-d3fe-4a23-b57f-0f6977e51e52 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:12.725097 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d9d82-d3fe-4a23-b57f-0f6977e51e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:12.725396 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d9d82-d3fe-4a23-b57f-0f6977e51e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:12.726039 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d9d82-d3fe-4a23-b57f-0f6977e51e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:12.728126 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d9d82-d3fe-4a23-b57f-0f6977e51e52 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:12.738641 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1148/2301] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:12.742678 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460d814-bd78-429e-8fc1-d5879f77e17d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:12.752995 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460d814-bd78-429e-8fc1-d5879f77e17d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:12.757559 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb805b-c40d-4767-90d2-afdfa9315937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:12.758195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb805b-c40d-4767-90d2-afdfa9315937 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:12.758474 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb805b-c40d-4767-90d2-afdfa9315937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:12.758747 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb805b-c40d-4767-90d2-afdfa9315937 admin admin] PATH_INFO: `/v3/projects/39ec335eac584cd8b2fd863a48e96523/users/6971fef449b24f7abc11d8f4c10f5602/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:12.772911 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb805b-c40d-4767-90d2-afdfa9315937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ec335eac584cd8b2fd863a48e96523, user_id=6971fef449b24f7abc11d8f4c10f5602, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:12.776069 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb805b-c40d-4767-90d2-afdfa9315937 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:12.789081 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1154/2302] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:39:12 2022] PUT /identity/v3/projects/39ec335eac584cd8b2fd863a48e96523/users/6971fef449b24f7abc11d8f4c10f5602/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:12.793752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d9d82-d3fe-4a23-b57f-0f6977e51e52 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:12.803622 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d9d82-d3fe-4a23-b57f-0f6977e51e52 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:12.859929 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a90bd0-0999-4860-ae6e-9845a6b663b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:12.860548 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a90bd0-0999-4860-ae6e-9845a6b663b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:12.860807 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a90bd0-0999-4860-ae6e-9845a6b663b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:12.861077 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a90bd0-0999-4860-ae6e-9845a6b663b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:12.861758 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a90bd0-0999-4860-ae6e-9845a6b663b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:12.863333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a90bd0-0999-4860-ae6e-9845a6b663b9 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:12.873379 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1149/2303] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:12.877765 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb805b-c40d-4767-90d2-afdfa9315937 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:12.888062 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb805b-c40d-4767-90d2-afdfa9315937 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:12.893162 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1543eb-b7e1-4f8d-a491-b215bb03eade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:12.894275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1543eb-b7e1-4f8d-a491-b215bb03eade admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:12.894275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1543eb-b7e1-4f8d-a491-b215bb03eade admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:12.894465 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1543eb-b7e1-4f8d-a491-b215bb03eade admin admin] PATH_INFO: `/v3/projects/39ec335eac584cd8b2fd863a48e96523/users/6971fef449b24f7abc11d8f4c10f5602/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:12.896409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1543eb-b7e1-4f8d-a491-b215bb03eade admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ec335eac584cd8b2fd863a48e96523, user_id=6971fef449b24f7abc11d8f4c10f5602, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:12.899606 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1543eb-b7e1-4f8d-a491-b215bb03eade admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:12.910512 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1155/2304] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:39:12 2022] PUT /identity/v3/projects/39ec335eac584cd8b2fd863a48e96523/users/6971fef449b24f7abc11d8f4c10f5602/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:12.922950 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba8e88-21b7-4f03-bd72-eae0b9114b28 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:12.923240 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba8e88-21b7-4f03-bd72-eae0b9114b28 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:12.923515 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba8e88-21b7-4f03-bd72-eae0b9114b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:12.951161 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-43ba8e88-21b7-4f03-bd72-eae0b9114b28 None None] MFA Rules not processed for user `6971fef449b24f7abc11d8f4c10f5602`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:12.952385 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-43ba8e88-21b7-4f03-bd72-eae0b9114b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:13.018644 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1150/2305] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:12 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:13.029861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1543eb-b7e1-4f8d-a491-b215bb03eade admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:13.031552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6f1543eb-b7e1-4f8d-a491-b215bb03eade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:13.088963 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1543eb-b7e1-4f8d-a491-b215bb03eade admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:13.092684 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c51426-30bc-4734-98a9-2174b0148dbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:13.093338 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c51426-30bc-4734-98a9-2174b0148dbb service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:13.093624 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c51426-30bc-4734-98a9-2174b0148dbb service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:13.093902 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c51426-30bc-4734-98a9-2174b0148dbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:13.103348 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c51426-30bc-4734-98a9-2174b0148dbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:13.104764 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c51426-30bc-4734-98a9-2174b0148dbb service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:13.114166 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1156/2306] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:13 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:39:13.245810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba8e88-21b7-4f03-bd72-eae0b9114b28 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:13.264748 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:13.308511 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba8e88-21b7-4f03-bd72-eae0b9114b28 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:13.312942 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a49122-1877-4ea8-99de-76595106b511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:13.313708 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a49122-1877-4ea8-99de-76595106b511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:13.315015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a49122-1877-4ea8-99de-76595106b511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:13.315015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a49122-1877-4ea8-99de-76595106b511 admin admin] PATH_INFO: `/v3/users/d4ceb0f156ef4be88a2ad9b18d1ee809` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:13.315242 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a49122-1877-4ea8-99de-76595106b511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4ceb0f156ef4be88a2ad9b18d1ee809)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:13.317149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a49122-1877-4ea8-99de-76595106b511 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:13.363853 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b2a49122-1877-4ea8-99de-76595106b511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4ceb0f156ef4be88a2ad9b18d1ee809'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:13.364494 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b2a49122-1877-4ea8-99de-76595106b511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4ceb0f156ef4be88a2ad9b18d1ee809'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:13.365148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b2a49122-1877-4ea8-99de-76595106b511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4ceb0f156ef4be88a2ad9b18d1ee809'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:13.371852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b2a49122-1877-4ea8-99de-76595106b511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4ceb0f156ef4be88a2ad9b18d1ee809'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:13.378774 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b2a49122-1877-4ea8-99de-76595106b511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4ceb0f156ef4be88a2ad9b18d1ee809'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:13.396482 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1151/2307] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:39:13 2022] DELETE /identity/v3/users/d4ceb0f156ef4be88a2ad9b18d1ee809 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:13.401552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0bc0a-70da-4519-b2f8-49f2f1060024 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:13.402038 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0bc0a-70da-4519-b2f8-49f2f1060024 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:13.402136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0bc0a-70da-4519-b2f8-49f2f1060024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:13.421485 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-cff0bc0a-70da-4519-b2f8-49f2f1060024 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:13.422698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cff0bc0a-70da-4519-b2f8-49f2f1060024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:13.480705 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1157/2308] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:13.490380 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a49122-1877-4ea8-99de-76595106b511 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:13.491780 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b2a49122-1877-4ea8-99de-76595106b511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:13.549707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a49122-1877-4ea8-99de-76595106b511 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:13.553358 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5081f-0ad1-4225-a2e0-004959d93689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:13.553956 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5081f-0ad1-4225-a2e0-004959d93689 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:13.554242 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5081f-0ad1-4225-a2e0-004959d93689 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:13.554509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5081f-0ad1-4225-a2e0-004959d93689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:13.563800 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5081f-0ad1-4225-a2e0-004959d93689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:13.565237 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5081f-0ad1-4225-a2e0-004959d93689 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:13.575118 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1152/2309] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:39:13.839227 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0bc0a-70da-4519-b2f8-49f2f1060024 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:13.840697 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cff0bc0a-70da-4519-b2f8-49f2f1060024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:13.852604 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0bc0a-70da-4519-b2f8-49f2f1060024 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:13.857396 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b21aaf-bf50-427e-9f1f-0c39b068b3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:13.858040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b21aaf-bf50-427e-9f1f-0c39b068b3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:13.858326 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b21aaf-bf50-427e-9f1f-0c39b068b3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:13.858603 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b21aaf-bf50-427e-9f1f-0c39b068b3fe admin admin] PATH_INFO: `/v3/projects/b714a76efd54431480a504eb0f74abb6` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:13.859726 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b21aaf-bf50-427e-9f1f-0c39b068b3fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b714a76efd54431480a504eb0f74abb6)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:13.861669 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b21aaf-bf50-427e-9f1f-0c39b068b3fe admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:13.907518 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:13.908817 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-34b21aaf-bf50-427e-9f1f-0c39b068b3fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b714a76efd54431480a504eb0f74abb6', 'request_id': 'req-34b21aaf-bf50-427e-9f1f-0c39b068b3fe'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:13.917821 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-34b21aaf-bf50-427e-9f1f-0c39b068b3fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b714a76efd54431480a504eb0f74abb6', 'request_id': 'req-34b21aaf-bf50-427e-9f1f-0c39b068b3fe'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:13.923642 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-34b21aaf-bf50-427e-9f1f-0c39b068b3fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b714a76efd54431480a504eb0f74abb6', 'request_id': 'req-34b21aaf-bf50-427e-9f1f-0c39b068b3fe'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:13.934953 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-34b21aaf-bf50-427e-9f1f-0c39b068b3fe admin admin] The token cache is being invalidate because project b714a76efd54431480a504eb0f74abb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:39:13.935244 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-34b21aaf-bf50-427e-9f1f-0c39b068b3fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:13.935897 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-34b21aaf-bf50-427e-9f1f-0c39b068b3fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:13.937640 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1158/2310] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:39:13 2022] DELETE /identity/v3/projects/b714a76efd54431480a504eb0f74abb6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:39:13.941637 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5081f-0ad1-4225-a2e0-004959d93689 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:13.951352 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5081f-0ad1-4225-a2e0-004959d93689 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:13.988522 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:14.008242 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0b48f-4cc5-4a99-bf54-574f07018053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:14.008918 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0b48f-4cc5-4a99-bf54-574f07018053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:14.009239 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0b48f-4cc5-4a99-bf54-574f07018053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:14.009511 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0b48f-4cc5-4a99-bf54-574f07018053 admin admin] PATH_INFO: `/v3/users/6971fef449b24f7abc11d8f4c10f5602` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:14.010617 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0b48f-4cc5-4a99-bf54-574f07018053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6971fef449b24f7abc11d8f4c10f5602)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:14.012521 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0b48f-4cc5-4a99-bf54-574f07018053 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:14.058044 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-15c0b48f-4cc5-4a99-bf54-574f07018053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6971fef449b24f7abc11d8f4c10f5602'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:14.058680 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-15c0b48f-4cc5-4a99-bf54-574f07018053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6971fef449b24f7abc11d8f4c10f5602'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:14.059276 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-15c0b48f-4cc5-4a99-bf54-574f07018053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6971fef449b24f7abc11d8f4c10f5602'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:14.066118 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-15c0b48f-4cc5-4a99-bf54-574f07018053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6971fef449b24f7abc11d8f4c10f5602'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:14.073405 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-15c0b48f-4cc5-4a99-bf54-574f07018053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6971fef449b24f7abc11d8f4c10f5602'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:14.090819 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1153/2311] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:39:13 2022] DELETE /identity/v3/users/6971fef449b24f7abc11d8f4c10f5602 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:14.357024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b21aaf-bf50-427e-9f1f-0c39b068b3fe admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:14.358615 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-34b21aaf-bf50-427e-9f1f-0c39b068b3fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:14.372476 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b21aaf-bf50-427e-9f1f-0c39b068b3fe admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:14.428171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecc8ce-2586-42ed-acb0-5cf4f1e2abbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:14.428787 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecc8ce-2586-42ed-acb0-5cf4f1e2abbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:14.429082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecc8ce-2586-42ed-acb0-5cf4f1e2abbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:14.429371 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecc8ce-2586-42ed-acb0-5cf4f1e2abbc admin admin] PATH_INFO: `/v3/projects/39ec335eac584cd8b2fd863a48e96523` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:14.430562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecc8ce-2586-42ed-acb0-5cf4f1e2abbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=39ec335eac584cd8b2fd863a48e96523)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:14.432458 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecc8ce-2586-42ed-acb0-5cf4f1e2abbc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:14.478448 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-37ecc8ce-2586-42ed-acb0-5cf4f1e2abbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39ec335eac584cd8b2fd863a48e96523', 'request_id': 'req-37ecc8ce-2586-42ed-acb0-5cf4f1e2abbc'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:14.485262 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-37ecc8ce-2586-42ed-acb0-5cf4f1e2abbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39ec335eac584cd8b2fd863a48e96523', 'request_id': 'req-37ecc8ce-2586-42ed-acb0-5cf4f1e2abbc'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:14.490688 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-37ecc8ce-2586-42ed-acb0-5cf4f1e2abbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39ec335eac584cd8b2fd863a48e96523', 'request_id': 'req-37ecc8ce-2586-42ed-acb0-5cf4f1e2abbc'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:14.501247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-37ecc8ce-2586-42ed-acb0-5cf4f1e2abbc admin admin] The token cache is being invalidate because project 39ec335eac584cd8b2fd863a48e96523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:39:14.501538 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-37ecc8ce-2586-42ed-acb0-5cf4f1e2abbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:14.502166 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-37ecc8ce-2586-42ed-acb0-5cf4f1e2abbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:14.503620 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1159/2312] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:39:14 2022] DELETE /identity/v3/projects/39ec335eac584cd8b2fd863a48e96523 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:14.508606 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1575d39-4e17-4d66-8fad-13965bf52a37 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:14.508892 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1575d39-4e17-4d66-8fad-13965bf52a37 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:14.509199 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1575d39-4e17-4d66-8fad-13965bf52a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:14.528993 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e1575d39-4e17-4d66-8fad-13965bf52a37 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:14.530217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e1575d39-4e17-4d66-8fad-13965bf52a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:14.587269 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1154/2313] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:14.594672 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c59088-fa84-4add-b9bd-ab2d5ff37d9e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:14.594960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c59088-fa84-4add-b9bd-ab2d5ff37d9e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:14.595236 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c59088-fa84-4add-b9bd-ab2d5ff37d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:14.615356 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-32c59088-fa84-4add-b9bd-ab2d5ff37d9e None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:14.616549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-32c59088-fa84-4add-b9bd-ab2d5ff37d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:14.624253 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1160/2314] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:39:14.628225 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1575d39-4e17-4d66-8fad-13965bf52a37 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:14.638230 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1575d39-4e17-4d66-8fad-13965bf52a37 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:14.642725 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636e9c4-97c6-440c-a141-7a2478321feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:14.643308 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636e9c4-97c6-440c-a141-7a2478321feb admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:14.643584 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636e9c4-97c6-440c-a141-7a2478321feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:14.643852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636e9c4-97c6-440c-a141-7a2478321feb admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:14.644490 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636e9c4-97c6-440c-a141-7a2478321feb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:39:14.644788 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636e9c4-97c6-440c-a141-7a2478321feb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:14.646391 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636e9c4-97c6-440c-a141-7a2478321feb admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:14.658269 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1155/2315] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:39:14.662395 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c59088-fa84-4add-b9bd-ab2d5ff37d9e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:14.671723 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c59088-fa84-4add-b9bd-ab2d5ff37d9e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:14.676280 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7c0ad-40f4-4f22-b644-f48d618140b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:14.676890 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7c0ad-40f4-4f22-b644-f48d618140b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:14.677202 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7c0ad-40f4-4f22-b644-f48d618140b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:14.677476 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7c0ad-40f4-4f22-b644-f48d618140b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:14.678099 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7c0ad-40f4-4f22-b644-f48d618140b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:14.679974 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7c0ad-40f4-4f22-b644-f48d618140b6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:14.706294 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1161/2316] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:39:14 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:39:14.710201 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636e9c4-97c6-440c-a141-7a2478321feb admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:14.720639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636e9c4-97c6-440c-a141-7a2478321feb admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:14.763314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:14.780606 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66a20a-37db-45eb-93e2-e6314de18e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:14.781511 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66a20a-37db-45eb-93e2-e6314de18e4f admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:14.781807 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66a20a-37db-45eb-93e2-e6314de18e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:14.782211 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66a20a-37db-45eb-93e2-e6314de18e4f admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:14.782848 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66a20a-37db-45eb-93e2-e6314de18e4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:14.785406 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66a20a-37db-45eb-93e2-e6314de18e4f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:14.807004 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1156/2317] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:39:14 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:39:14.811151 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7c0ad-40f4-4f22-b644-f48d618140b6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:14.821997 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7c0ad-40f4-4f22-b644-f48d618140b6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:14.826575 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8ed6d-1798-4c5e-95fb-320698efe939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:14.827168 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8ed6d-1798-4c5e-95fb-320698efe939 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:14.827446 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8ed6d-1798-4c5e-95fb-320698efe939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:14.827717 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8ed6d-1798-4c5e-95fb-320698efe939 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:14.828350 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8ed6d-1798-4c5e-95fb-320698efe939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:14.829968 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8ed6d-1798-4c5e-95fb-320698efe939 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:14.840878 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1162/2318] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:14.844629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66a20a-37db-45eb-93e2-e6314de18e4f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:14.854958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66a20a-37db-45eb-93e2-e6314de18e4f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:14.859493 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce3619-cf71-4d1d-bda7-78f50f4a1385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:14.860086 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce3619-cf71-4d1d-bda7-78f50f4a1385 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:14.860365 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce3619-cf71-4d1d-bda7-78f50f4a1385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:14.860638 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce3619-cf71-4d1d-bda7-78f50f4a1385 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:14.861334 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce3619-cf71-4d1d-bda7-78f50f4a1385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:14.862910 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce3619-cf71-4d1d-bda7-78f50f4a1385 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:14.873357 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1157/2319] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:14.877375 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8ed6d-1798-4c5e-95fb-320698efe939 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:14.887932 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8ed6d-1798-4c5e-95fb-320698efe939 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:14.892754 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9d549-4e42-4e0e-bd22-6b2f912659a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:14.893431 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9d549-4e42-4e0e-bd22-6b2f912659a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:14.893713 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9d549-4e42-4e0e-bd22-6b2f912659a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:14.893986 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9d549-4e42-4e0e-bd22-6b2f912659a7 admin admin] PATH_INFO: `/v3/projects/17cd47ab56084a38846a6ca048f68e62/users/f16e5dd802044404b2ccc8e5d7f4a804/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:14.908871 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9d549-4e42-4e0e-bd22-6b2f912659a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17cd47ab56084a38846a6ca048f68e62, user_id=f16e5dd802044404b2ccc8e5d7f4a804, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:14.911527 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9d549-4e42-4e0e-bd22-6b2f912659a7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:14.923963 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1163/2320] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:39:14 2022] PUT /identity/v3/projects/17cd47ab56084a38846a6ca048f68e62/users/f16e5dd802044404b2ccc8e5d7f4a804/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:39:14.934336 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b24600-0299-4e06-9b2a-3b89499fbe69 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:14.934622 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b24600-0299-4e06-9b2a-3b89499fbe69 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:14.934894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b24600-0299-4e06-9b2a-3b89499fbe69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:14.962947 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-41b24600-0299-4e06-9b2a-3b89499fbe69 None None] MFA Rules not processed for user `f16e5dd802044404b2ccc8e5d7f4a804`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:14.964133 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-41b24600-0299-4e06-9b2a-3b89499fbe69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:15.026807 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1158/2321] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:39:15.031321 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9d549-4e42-4e0e-bd22-6b2f912659a7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:15.035856 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:15.095076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9d549-4e42-4e0e-bd22-6b2f912659a7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:15.099720 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ddc3e-c5d7-4022-9b93-993afa3c5a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:15.100315 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ddc3e-c5d7-4022-9b93-993afa3c5a85 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:15.100596 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ddc3e-c5d7-4022-9b93-993afa3c5a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:15.100868 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ddc3e-c5d7-4022-9b93-993afa3c5a85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:15.101534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ddc3e-c5d7-4022-9b93-993afa3c5a85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:15.103450 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ddc3e-c5d7-4022-9b93-993afa3c5a85 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:15.128563 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1164/2322] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:39:15 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:39:15.132689 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b24600-0299-4e06-9b2a-3b89499fbe69 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:15.144022 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b24600-0299-4e06-9b2a-3b89499fbe69 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:15.199881 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966f583-89eb-4550-a2dc-8df551075e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:15.200482 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966f583-89eb-4550-a2dc-8df551075e25 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:15.200762 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966f583-89eb-4550-a2dc-8df551075e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:15.201034 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966f583-89eb-4550-a2dc-8df551075e25 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:15.201686 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966f583-89eb-4550-a2dc-8df551075e25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:15.203580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966f583-89eb-4550-a2dc-8df551075e25 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:15.223917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1159/2323] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:39:15 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:39:15.227353 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ddc3e-c5d7-4022-9b93-993afa3c5a85 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:15.237389 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ddc3e-c5d7-4022-9b93-993afa3c5a85 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:15.241931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee7142-84f8-4045-8459-69f06f583b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:15.242517 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee7142-84f8-4045-8459-69f06f583b76 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:15.243294 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee7142-84f8-4045-8459-69f06f583b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:15.243563 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee7142-84f8-4045-8459-69f06f583b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:15.244198 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee7142-84f8-4045-8459-69f06f583b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:15.245810 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee7142-84f8-4045-8459-69f06f583b76 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:15.256033 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1165/2324] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:15.260651 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966f583-89eb-4550-a2dc-8df551075e25 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:15.270441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966f583-89eb-4550-a2dc-8df551075e25 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:15.275005 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b5db3-3a64-4e8f-be58-2e0fd66647dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:15.275589 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b5db3-3a64-4e8f-be58-2e0fd66647dc admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:15.275869 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b5db3-3a64-4e8f-be58-2e0fd66647dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:15.276144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b5db3-3a64-4e8f-be58-2e0fd66647dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:15.276788 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b5db3-3a64-4e8f-be58-2e0fd66647dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:15.278465 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b5db3-3a64-4e8f-be58-2e0fd66647dc admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:15.288053 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1160/2325] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:15.291889 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee7142-84f8-4045-8459-69f06f583b76 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:15.301823 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee7142-84f8-4045-8459-69f06f583b76 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:15.306891 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d926ed-664d-4469-8ad7-8d340a4cf494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:15.307516 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d926ed-664d-4469-8ad7-8d340a4cf494 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:15.307792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d926ed-664d-4469-8ad7-8d340a4cf494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:15.308061 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d926ed-664d-4469-8ad7-8d340a4cf494 admin admin] PATH_INFO: `/v3/projects/b6cc52d576db42518eae72bc79ebd077/users/252d2b001d3741cb94389d24b8999820/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:15.322635 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d926ed-664d-4469-8ad7-8d340a4cf494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6cc52d576db42518eae72bc79ebd077, user_id=252d2b001d3741cb94389d24b8999820, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:15.325283 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d926ed-664d-4469-8ad7-8d340a4cf494 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:15.339498 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1166/2326] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:39:15 2022] PUT /identity/v3/projects/b6cc52d576db42518eae72bc79ebd077/users/252d2b001d3741cb94389d24b8999820/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:39:15.350822 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b59530-70b4-4ef2-9d74-090317050a02 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:15.351111 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b59530-70b4-4ef2-9d74-090317050a02 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:15.351387 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b59530-70b4-4ef2-9d74-090317050a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:15.379306 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-89b59530-70b4-4ef2-9d74-090317050a02 None None] MFA Rules not processed for user `252d2b001d3741cb94389d24b8999820`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:15.380537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-89b59530-70b4-4ef2-9d74-090317050a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:15.400614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:15.445854 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1161/2327] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:39:15.450501 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d926ed-664d-4469-8ad7-8d340a4cf494 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:15.510597 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d926ed-664d-4469-8ad7-8d340a4cf494 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:15.515229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fd17e-23d4-4b90-900a-9b33c4b04969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:15.515819 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fd17e-23d4-4b90-900a-9b33c4b04969 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:15.516098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fd17e-23d4-4b90-900a-9b33c4b04969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:15.516369 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fd17e-23d4-4b90-900a-9b33c4b04969 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:15.516994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fd17e-23d4-4b90-900a-9b33c4b04969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:15.518886 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fd17e-23d4-4b90-900a-9b33c4b04969 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:15.545093 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1167/2328] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:39:15 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:39:15.554186 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b59530-70b4-4ef2-9d74-090317050a02 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:15.565335 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b59530-70b4-4ef2-9d74-090317050a02 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:15.619465 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2686b2-7c09-4896-9a90-cf76a1c09087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:15.620087 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2686b2-7c09-4896-9a90-cf76a1c09087 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:15.620370 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2686b2-7c09-4896-9a90-cf76a1c09087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:15.620643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2686b2-7c09-4896-9a90-cf76a1c09087 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:15.621297 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2686b2-7c09-4896-9a90-cf76a1c09087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:15.623182 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2686b2-7c09-4896-9a90-cf76a1c09087 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:15.643833 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1162/2329] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:39:15 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:39:15.647964 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fd17e-23d4-4b90-900a-9b33c4b04969 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:15.658541 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fd17e-23d4-4b90-900a-9b33c4b04969 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:15.663150 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7988188-0e7d-45c4-994b-eb3b6a24c249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:15.663746 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7988188-0e7d-45c4-994b-eb3b6a24c249 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:15.664025 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7988188-0e7d-45c4-994b-eb3b6a24c249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:15.664297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7988188-0e7d-45c4-994b-eb3b6a24c249 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:15.665500 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7988188-0e7d-45c4-994b-eb3b6a24c249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:15.667074 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7988188-0e7d-45c4-994b-eb3b6a24c249 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:15.677603 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1168/2330] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:39:15.682378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2686b2-7c09-4896-9a90-cf76a1c09087 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:15.692175 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2686b2-7c09-4896-9a90-cf76a1c09087 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:15.696812 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21482f46-bbe6-429d-aa9c-63af4bc6e3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:15.697466 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21482f46-bbe6-429d-aa9c-63af4bc6e3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:15.697746 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21482f46-bbe6-429d-aa9c-63af4bc6e3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:15.698017 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21482f46-bbe6-429d-aa9c-63af4bc6e3ca admin admin] PATH_INFO: `/v3/projects/39723368a7ce41f1a485825dfee6dfde/users/2c2aa930141c4f188f7851cd7ed64a5b/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:15.712537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21482f46-bbe6-429d-aa9c-63af4bc6e3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=39723368a7ce41f1a485825dfee6dfde, user_id=2c2aa930141c4f188f7851cd7ed64a5b, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:15.715249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21482f46-bbe6-429d-aa9c-63af4bc6e3ca admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:15.728525 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1163/2331] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:39:15 2022] PUT /identity/v3/projects/39723368a7ce41f1a485825dfee6dfde/users/2c2aa930141c4f188f7851cd7ed64a5b/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:15.732465 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7988188-0e7d-45c4-994b-eb3b6a24c249 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:15.742598 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7988188-0e7d-45c4-994b-eb3b6a24c249 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:15.766021 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:15.799394 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcd560-590d-441a-b8a3-c5a972fe587c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:15.799930 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcd560-590d-441a-b8a3-c5a972fe587c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:15.800211 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcd560-590d-441a-b8a3-c5a972fe587c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:15.800487 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcd560-590d-441a-b8a3-c5a972fe587c admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:15.801152 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bcd560-590d-441a-b8a3-c5a972fe587c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:15.802739 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bcd560-590d-441a-b8a3-c5a972fe587c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:15.812229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1169/2332] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:15.816252 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21482f46-bbe6-429d-aa9c-63af4bc6e3ca admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:15.826386 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21482f46-bbe6-429d-aa9c-63af4bc6e3ca admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:15.830933 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2e053-ca05-469c-8900-509181214fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:15.831568 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2e053-ca05-469c-8900-509181214fc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:15.831847 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2e053-ca05-469c-8900-509181214fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:15.832118 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2e053-ca05-469c-8900-509181214fc7 admin admin] PATH_INFO: `/v3/projects/39723368a7ce41f1a485825dfee6dfde/users/2c2aa930141c4f188f7851cd7ed64a5b/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:15.834050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2e053-ca05-469c-8900-509181214fc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39723368a7ce41f1a485825dfee6dfde, user_id=2c2aa930141c4f188f7851cd7ed64a5b, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:15.837260 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2e053-ca05-469c-8900-509181214fc7 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:15.847369 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1164/2333] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:39:15 2022] PUT /identity/v3/projects/39723368a7ce41f1a485825dfee6dfde/users/2c2aa930141c4f188f7851cd7ed64a5b/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:15.857869 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adcc89-f8fe-4c90-8c76-e7ab87c8eea4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:15.858157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adcc89-f8fe-4c90-8c76-e7ab87c8eea4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:15.858432 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adcc89-f8fe-4c90-8c76-e7ab87c8eea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:15.887019 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b2adcc89-f8fe-4c90-8c76-e7ab87c8eea4 None None] MFA Rules not processed for user `2c2aa930141c4f188f7851cd7ed64a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:15.888211 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b2adcc89-f8fe-4c90-8c76-e7ab87c8eea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:15.953341 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1170/2334] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:39:15.963941 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2e053-ca05-469c-8900-509181214fc7 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:15.965746 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b3e2e053-ca05-469c-8900-509181214fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:16.022053 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2e053-ca05-469c-8900-509181214fc7 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:16.025747 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b4c49-2fe1-46c0-bf86-067969b06cfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:16.026337 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b4c49-2fe1-46c0-bf86-067969b06cfc service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:16.026616 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b4c49-2fe1-46c0-bf86-067969b06cfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:16.026887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b4c49-2fe1-46c0-bf86-067969b06cfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:16.035868 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b4c49-2fe1-46c0-bf86-067969b06cfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:16.037330 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b4c49-2fe1-46c0-bf86-067969b06cfc service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:16.046930 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1165/2335] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:39:16.536118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adcc89-f8fe-4c90-8c76-e7ab87c8eea4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:16.537559 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b2adcc89-f8fe-4c90-8c76-e7ab87c8eea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:16.550145 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adcc89-f8fe-4c90-8c76-e7ab87c8eea4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:16.553639 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e27880-00f2-47ca-bdc2-77874a2a81ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:16.554232 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e27880-00f2-47ca-bdc2-77874a2a81ff service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:16.554511 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e27880-00f2-47ca-bdc2-77874a2a81ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:16.554783 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e27880-00f2-47ca-bdc2-77874a2a81ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:16.610891 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e27880-00f2-47ca-bdc2-77874a2a81ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:16.612326 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e27880-00f2-47ca-bdc2-77874a2a81ff service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:16.621135 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1171/2336] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:39:20.615637 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b4c49-2fe1-46c0-bf86-067969b06cfc service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:20.624103 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b4c49-2fe1-46c0-bf86-067969b06cfc service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:20.627671 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13572e1b-ab8f-48dc-a9fb-908472260b7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:20.628253 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13572e1b-ab8f-48dc-a9fb-908472260b7e service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:20.628529 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13572e1b-ab8f-48dc-a9fb-908472260b7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:20.628803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13572e1b-ab8f-48dc-a9fb-908472260b7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:20.641817 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:20.685837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13572e1b-ab8f-48dc-a9fb-908472260b7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:20.687187 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13572e1b-ab8f-48dc-a9fb-908472260b7e service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:20.696468 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1166/2337] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:39:22.738080 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e27880-00f2-47ca-bdc2-77874a2a81ff service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:22.784192 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:22.799469 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e27880-00f2-47ca-bdc2-77874a2a81ff service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:22.803950 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83319c82-94c9-4da9-8a97-b38245623e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:22.804570 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83319c82-94c9-4da9-8a97-b38245623e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:22.804853 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83319c82-94c9-4da9-8a97-b38245623e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:22.805156 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83319c82-94c9-4da9-8a97-b38245623e6c admin admin] PATH_INFO: `/v3/users/f16e5dd802044404b2ccc8e5d7f4a804` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:22.806777 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83319c82-94c9-4da9-8a97-b38245623e6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f16e5dd802044404b2ccc8e5d7f4a804)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:22.808679 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83319c82-94c9-4da9-8a97-b38245623e6c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:22.853314 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-83319c82-94c9-4da9-8a97-b38245623e6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f16e5dd802044404b2ccc8e5d7f4a804'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:22.860736 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-83319c82-94c9-4da9-8a97-b38245623e6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f16e5dd802044404b2ccc8e5d7f4a804'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:22.861383 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-83319c82-94c9-4da9-8a97-b38245623e6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f16e5dd802044404b2ccc8e5d7f4a804'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:22.873760 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-83319c82-94c9-4da9-8a97-b38245623e6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f16e5dd802044404b2ccc8e5d7f4a804'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:22.881802 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-83319c82-94c9-4da9-8a97-b38245623e6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f16e5dd802044404b2ccc8e5d7f4a804'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:22.888797 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1172/2338] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:39:22 2022] DELETE /identity/v3/users/f16e5dd802044404b2ccc8e5d7f4a804 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:22.893272 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca0469-397d-4611-91f5-5cbd729ba034 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:22.893740 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca0469-397d-4611-91f5-5cbd729ba034 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:22.893846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca0469-397d-4611-91f5-5cbd729ba034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:22.912464 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-bfca0469-397d-4611-91f5-5cbd729ba034 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:22.913694 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-bfca0469-397d-4611-91f5-5cbd729ba034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:22.971185 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1167/2339] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:22.981612 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83319c82-94c9-4da9-8a97-b38245623e6c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:22.983000 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-83319c82-94c9-4da9-8a97-b38245623e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:23.038507 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83319c82-94c9-4da9-8a97-b38245623e6c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:23.042569 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354cdd3-9b1b-4c71-842e-0136697b1eb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:23.043161 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354cdd3-9b1b-4c71-842e-0136697b1eb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:23.043680 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354cdd3-9b1b-4c71-842e-0136697b1eb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:23.043956 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354cdd3-9b1b-4c71-842e-0136697b1eb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:23.052670 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354cdd3-9b1b-4c71-842e-0136697b1eb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:23.054093 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354cdd3-9b1b-4c71-842e-0136697b1eb5 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:23.064102 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1173/2340] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:39:23.335126 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca0469-397d-4611-91f5-5cbd729ba034 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:23.336685 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-bfca0469-397d-4611-91f5-5cbd729ba034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:23.349314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca0469-397d-4611-91f5-5cbd729ba034 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:23.354517 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7d6fd-c0b0-412a-87db-1872f3811fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:23.355150 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7d6fd-c0b0-412a-87db-1872f3811fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:23.355427 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7d6fd-c0b0-412a-87db-1872f3811fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:23.355700 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7d6fd-c0b0-412a-87db-1872f3811fa4 admin admin] PATH_INFO: `/v3/projects/17cd47ab56084a38846a6ca048f68e62` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:23.356887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7d6fd-c0b0-412a-87db-1872f3811fa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17cd47ab56084a38846a6ca048f68e62)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:23.358823 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7d6fd-c0b0-412a-87db-1872f3811fa4 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:23.407921 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-92f7d6fd-c0b0-412a-87db-1872f3811fa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17cd47ab56084a38846a6ca048f68e62', 'request_id': 'req-92f7d6fd-c0b0-412a-87db-1872f3811fa4'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:23.413725 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-92f7d6fd-c0b0-412a-87db-1872f3811fa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17cd47ab56084a38846a6ca048f68e62', 'request_id': 'req-92f7d6fd-c0b0-412a-87db-1872f3811fa4'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:23.420769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-92f7d6fd-c0b0-412a-87db-1872f3811fa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17cd47ab56084a38846a6ca048f68e62', 'request_id': 'req-92f7d6fd-c0b0-412a-87db-1872f3811fa4'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:23.432671 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-92f7d6fd-c0b0-412a-87db-1872f3811fa4 admin admin] The token cache is being invalidate because project 17cd47ab56084a38846a6ca048f68e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:39:23.432959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-92f7d6fd-c0b0-412a-87db-1872f3811fa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:23.433614 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-92f7d6fd-c0b0-412a-87db-1872f3811fa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:23.435081 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1168/2341] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:39:23 2022] DELETE /identity/v3/projects/17cd47ab56084a38846a6ca048f68e62 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:23.439189 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354cdd3-9b1b-4c71-842e-0136697b1eb5 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:23.449254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354cdd3-9b1b-4c71-842e-0136697b1eb5 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:23.505479 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db201b0-82da-4256-9a10-99b5790f5f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:23.506099 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db201b0-82da-4256-9a10-99b5790f5f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:23.506375 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db201b0-82da-4256-9a10-99b5790f5f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:23.506643 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db201b0-82da-4256-9a10-99b5790f5f76 admin admin] PATH_INFO: `/v3/users/252d2b001d3741cb94389d24b8999820` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:23.507743 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db201b0-82da-4256-9a10-99b5790f5f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=252d2b001d3741cb94389d24b8999820)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:23.509668 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db201b0-82da-4256-9a10-99b5790f5f76 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:23.519158 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:23.554128 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2db201b0-82da-4256-9a10-99b5790f5f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '252d2b001d3741cb94389d24b8999820'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:23.560957 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2db201b0-82da-4256-9a10-99b5790f5f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '252d2b001d3741cb94389d24b8999820'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:23.561590 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2db201b0-82da-4256-9a10-99b5790f5f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '252d2b001d3741cb94389d24b8999820'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:23.572963 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2db201b0-82da-4256-9a10-99b5790f5f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '252d2b001d3741cb94389d24b8999820'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:23.579577 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2db201b0-82da-4256-9a10-99b5790f5f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '252d2b001d3741cb94389d24b8999820'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:23.585351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1174/2342] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:39:23 2022] DELETE /identity/v3/users/252d2b001d3741cb94389d24b8999820 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:23.857773 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7d6fd-c0b0-412a-87db-1872f3811fa4 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:23.859382 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-92f7d6fd-c0b0-412a-87db-1872f3811fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:23.872502 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7d6fd-c0b0-412a-87db-1872f3811fa4 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:23.913378 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:23.932985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158308a2-72f4-4b93-9f99-bbaf3cfef480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:23.933585 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158308a2-72f4-4b93-9f99-bbaf3cfef480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:23.933898 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158308a2-72f4-4b93-9f99-bbaf3cfef480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:23.934175 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158308a2-72f4-4b93-9f99-bbaf3cfef480 admin admin] PATH_INFO: `/v3/projects/b6cc52d576db42518eae72bc79ebd077` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:23.935316 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158308a2-72f4-4b93-9f99-bbaf3cfef480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6cc52d576db42518eae72bc79ebd077)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:23.937253 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158308a2-72f4-4b93-9f99-bbaf3cfef480 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:23.982970 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-158308a2-72f4-4b93-9f99-bbaf3cfef480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6cc52d576db42518eae72bc79ebd077', 'request_id': 'req-158308a2-72f4-4b93-9f99-bbaf3cfef480'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:23.988619 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-158308a2-72f4-4b93-9f99-bbaf3cfef480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6cc52d576db42518eae72bc79ebd077', 'request_id': 'req-158308a2-72f4-4b93-9f99-bbaf3cfef480'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:23.995125 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-158308a2-72f4-4b93-9f99-bbaf3cfef480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6cc52d576db42518eae72bc79ebd077', 'request_id': 'req-158308a2-72f4-4b93-9f99-bbaf3cfef480'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:24.007403 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-158308a2-72f4-4b93-9f99-bbaf3cfef480 admin admin] The token cache is being invalidate because project b6cc52d576db42518eae72bc79ebd077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:39:24.007689 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-158308a2-72f4-4b93-9f99-bbaf3cfef480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:24.008297 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-158308a2-72f4-4b93-9f99-bbaf3cfef480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:24.010424 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1169/2343] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:39:23 2022] DELETE /identity/v3/projects/b6cc52d576db42518eae72bc79ebd077 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:24.014382 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db201b0-82da-4256-9a10-99b5790f5f76 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:24.015784 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2db201b0-82da-4256-9a10-99b5790f5f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:24.028160 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db201b0-82da-4256-9a10-99b5790f5f76 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:24.088038 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea0302-4045-4a4b-8356-c5c17f9c1fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:24.088668 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea0302-4045-4a4b-8356-c5c17f9c1fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:24.088943 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea0302-4045-4a4b-8356-c5c17f9c1fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:24.089250 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea0302-4045-4a4b-8356-c5c17f9c1fd0 admin admin] PATH_INFO: `/v3/users/2c2aa930141c4f188f7851cd7ed64a5b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:24.090364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea0302-4045-4a4b-8356-c5c17f9c1fd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c2aa930141c4f188f7851cd7ed64a5b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:24.092255 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea0302-4045-4a4b-8356-c5c17f9c1fd0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:24.137132 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e2ea0302-4045-4a4b-8356-c5c17f9c1fd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c2aa930141c4f188f7851cd7ed64a5b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:24.144929 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e2ea0302-4045-4a4b-8356-c5c17f9c1fd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c2aa930141c4f188f7851cd7ed64a5b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:24.145627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e2ea0302-4045-4a4b-8356-c5c17f9c1fd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c2aa930141c4f188f7851cd7ed64a5b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:24.158257 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e2ea0302-4045-4a4b-8356-c5c17f9c1fd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c2aa930141c4f188f7851cd7ed64a5b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:24.164989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e2ea0302-4045-4a4b-8356-c5c17f9c1fd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c2aa930141c4f188f7851cd7ed64a5b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:24.171690 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1175/2344] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:39:24 2022] DELETE /identity/v3/users/2c2aa930141c4f188f7851cd7ed64a5b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:24.438523 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158308a2-72f4-4b93-9f99-bbaf3cfef480 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:24.439991 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-158308a2-72f4-4b93-9f99-bbaf3cfef480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:24.456669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158308a2-72f4-4b93-9f99-bbaf3cfef480 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:24.512084 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a86dd-5493-496f-b27c-8be0c9f3bcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:24.512706 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a86dd-5493-496f-b27c-8be0c9f3bcaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:24.512985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a86dd-5493-496f-b27c-8be0c9f3bcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:24.513293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a86dd-5493-496f-b27c-8be0c9f3bcaf admin admin] PATH_INFO: `/v3/projects/39723368a7ce41f1a485825dfee6dfde` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:24.514395 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a86dd-5493-496f-b27c-8be0c9f3bcaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=39723368a7ce41f1a485825dfee6dfde)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:24.516290 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a86dd-5493-496f-b27c-8be0c9f3bcaf admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:24.562831 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-871a86dd-5493-496f-b27c-8be0c9f3bcaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39723368a7ce41f1a485825dfee6dfde', 'request_id': 'req-871a86dd-5493-496f-b27c-8be0c9f3bcaf'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:24.568334 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-871a86dd-5493-496f-b27c-8be0c9f3bcaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39723368a7ce41f1a485825dfee6dfde', 'request_id': 'req-871a86dd-5493-496f-b27c-8be0c9f3bcaf'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:24.574826 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-871a86dd-5493-496f-b27c-8be0c9f3bcaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39723368a7ce41f1a485825dfee6dfde', 'request_id': 'req-871a86dd-5493-496f-b27c-8be0c9f3bcaf'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:24.583271 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:24.588168 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-871a86dd-5493-496f-b27c-8be0c9f3bcaf admin admin] The token cache is being invalidate because project 39723368a7ce41f1a485825dfee6dfde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:39:24.588541 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-871a86dd-5493-496f-b27c-8be0c9f3bcaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:24.589487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-871a86dd-5493-496f-b27c-8be0c9f3bcaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:24.591350 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1170/2345] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:39:24 2022] DELETE /identity/v3/projects/39723368a7ce41f1a485825dfee6dfde => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:24.597354 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b76b40-8fd7-433d-949d-e6d253378820 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:24.597638 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b76b40-8fd7-433d-949d-e6d253378820 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:24.597912 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b76b40-8fd7-433d-949d-e6d253378820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:24.611049 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:24.617686 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a6b76b40-8fd7-433d-949d-e6d253378820 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:24.619676 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a6b76b40-8fd7-433d-949d-e6d253378820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:24.677708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1176/2346] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:24.687181 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e85df5-2b61-4cce-aa1c-c2046e40a76c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:24.687464 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e85df5-2b61-4cce-aa1c-c2046e40a76c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:24.687754 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e85df5-2b61-4cce-aa1c-c2046e40a76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:24.707624 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-15e85df5-2b61-4cce-aa1c-c2046e40a76c None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:24.708752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-15e85df5-2b61-4cce-aa1c-c2046e40a76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:24.717134 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1171/2347] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:24.721147 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b76b40-8fd7-433d-949d-e6d253378820 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:24.730866 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b76b40-8fd7-433d-949d-e6d253378820 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:24.735465 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bf79d-fad3-4416-acc2-cc3926eaadcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:24.736061 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bf79d-fad3-4416-acc2-cc3926eaadcd admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:24.736333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bf79d-fad3-4416-acc2-cc3926eaadcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:24.736603 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bf79d-fad3-4416-acc2-cc3926eaadcd admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:24.737278 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5bf79d-fad3-4416-acc2-cc3926eaadcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:39:24.737585 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5bf79d-fad3-4416-acc2-cc3926eaadcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:24.739167 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5bf79d-fad3-4416-acc2-cc3926eaadcd admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:24.750985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1177/2348] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:39:24.755083 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e85df5-2b61-4cce-aa1c-c2046e40a76c None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:24.764674 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e85df5-2b61-4cce-aa1c-c2046e40a76c None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:24.769336 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c78601-b32f-4eb2-96ea-6754337fd9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:24.769925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c78601-b32f-4eb2-96ea-6754337fd9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:24.770208 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c78601-b32f-4eb2-96ea-6754337fd9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:24.770484 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c78601-b32f-4eb2-96ea-6754337fd9e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:24.771118 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c78601-b32f-4eb2-96ea-6754337fd9e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:24.773001 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c78601-b32f-4eb2-96ea-6754337fd9e7 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:24.801919 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1172/2349] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:39:24 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:39:24.806630 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bf79d-fad3-4416-acc2-cc3926eaadcd admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:24.816439 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bf79d-fad3-4416-acc2-cc3926eaadcd admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:24.872759 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be83872-7e11-40c6-8161-7a582d6fb15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:24.873398 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be83872-7e11-40c6-8161-7a582d6fb15e admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:24.873679 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be83872-7e11-40c6-8161-7a582d6fb15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:24.873947 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be83872-7e11-40c6-8161-7a582d6fb15e admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:24.874569 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be83872-7e11-40c6-8161-7a582d6fb15e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:24.876575 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be83872-7e11-40c6-8161-7a582d6fb15e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:24.898217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1178/2350] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:39:24 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:39:24.902363 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c78601-b32f-4eb2-96ea-6754337fd9e7 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:24.912673 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c78601-b32f-4eb2-96ea-6754337fd9e7 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:24.917555 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6689c05-d75f-4e4f-95d3-b8c4d42ea030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:24.918153 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6689c05-d75f-4e4f-95d3-b8c4d42ea030 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:24.918411 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6689c05-d75f-4e4f-95d3-b8c4d42ea030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:24.918934 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6689c05-d75f-4e4f-95d3-b8c4d42ea030 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:24.919571 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6689c05-d75f-4e4f-95d3-b8c4d42ea030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:24.921171 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6689c05-d75f-4e4f-95d3-b8c4d42ea030 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:24.931664 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1173/2351] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:24.935299 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be83872-7e11-40c6-8161-7a582d6fb15e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:24.944951 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be83872-7e11-40c6-8161-7a582d6fb15e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:24.950237 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140f6df-dc09-4468-84ec-1d949a0d0dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:24.950823 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140f6df-dc09-4468-84ec-1d949a0d0dde admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:24.951108 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140f6df-dc09-4468-84ec-1d949a0d0dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:24.951384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140f6df-dc09-4468-84ec-1d949a0d0dde admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:24.952047 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140f6df-dc09-4468-84ec-1d949a0d0dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:24.954014 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140f6df-dc09-4468-84ec-1d949a0d0dde admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:24.964457 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1179/2352] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:24.968417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6689c05-d75f-4e4f-95d3-b8c4d42ea030 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:24.978284 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6689c05-d75f-4e4f-95d3-b8c4d42ea030 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:24.982782 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5149a-af0b-440d-b373-6d1a16c7d2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:24.983411 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5149a-af0b-440d-b373-6d1a16c7d2d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:24.983686 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5149a-af0b-440d-b373-6d1a16c7d2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:24.983956 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5149a-af0b-440d-b373-6d1a16c7d2d7 admin admin] PATH_INFO: `/v3/projects/c3fa160f36ff4f5581e30d6c81c9f8bb/users/98ff9cd8f49741f7b65e76b32e34eb7d/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:24.998959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5149a-af0b-440d-b373-6d1a16c7d2d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3fa160f36ff4f5581e30d6c81c9f8bb, user_id=98ff9cd8f49741f7b65e76b32e34eb7d, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:25.001627 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5149a-af0b-440d-b373-6d1a16c7d2d7 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:25.014701 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1174/2353] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:39:24 2022] PUT /identity/v3/projects/c3fa160f36ff4f5581e30d6c81c9f8bb/users/98ff9cd8f49741f7b65e76b32e34eb7d/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:25.025936 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7a8b3-f25e-483a-9bee-5e052ed7ac50 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:25.026424 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7a8b3-f25e-483a-9bee-5e052ed7ac50 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:25.026601 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7a8b3-f25e-483a-9bee-5e052ed7ac50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:25.055262 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e1f7a8b3-f25e-483a-9bee-5e052ed7ac50 None None] MFA Rules not processed for user `98ff9cd8f49741f7b65e76b32e34eb7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:25.057012 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e1f7a8b3-f25e-483a-9bee-5e052ed7ac50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:25.119799 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1180/2354] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:39:25.124398 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5149a-af0b-440d-b373-6d1a16c7d2d7 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:25.185499 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5149a-af0b-440d-b373-6d1a16c7d2d7 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:25.190162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964bb17-e909-4f43-8bfe-e4a0e410df14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:25.190762 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964bb17-e909-4f43-8bfe-e4a0e410df14 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:25.191045 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964bb17-e909-4f43-8bfe-e4a0e410df14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:25.191321 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964bb17-e909-4f43-8bfe-e4a0e410df14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:25.191956 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964bb17-e909-4f43-8bfe-e4a0e410df14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:25.193885 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964bb17-e909-4f43-8bfe-e4a0e410df14 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:25.220115 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1175/2355] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:39:25 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:39:25.224124 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7a8b3-f25e-483a-9bee-5e052ed7ac50 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:25.230081 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:25.237442 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7a8b3-f25e-483a-9bee-5e052ed7ac50 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:25.292899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75892b7a-67e0-416c-9b62-394647c069ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:25.293786 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75892b7a-67e0-416c-9b62-394647c069ec admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:25.294065 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75892b7a-67e0-416c-9b62-394647c069ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:25.294334 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75892b7a-67e0-416c-9b62-394647c069ec admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:25.294959 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75892b7a-67e0-416c-9b62-394647c069ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:25.296854 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75892b7a-67e0-416c-9b62-394647c069ec admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:25.318939 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1181/2356] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:39:25 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:39:25.323032 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964bb17-e909-4f43-8bfe-e4a0e410df14 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:25.333473 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964bb17-e909-4f43-8bfe-e4a0e410df14 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:25.338161 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344a1ba-406c-4f46-ad44-f92f1bc129f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:25.338780 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344a1ba-406c-4f46-ad44-f92f1bc129f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:25.339061 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344a1ba-406c-4f46-ad44-f92f1bc129f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:25.339332 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344a1ba-406c-4f46-ad44-f92f1bc129f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:25.339978 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344a1ba-406c-4f46-ad44-f92f1bc129f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:25.341598 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344a1ba-406c-4f46-ad44-f92f1bc129f8 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:25.352250 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1176/2357] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:25.356694 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75892b7a-67e0-416c-9b62-394647c069ec admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:25.366611 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75892b7a-67e0-416c-9b62-394647c069ec admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:25.372010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f6ddd-dfb5-4c7f-ad2b-405f0fd00c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:25.372670 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f6ddd-dfb5-4c7f-ad2b-405f0fd00c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:25.372952 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f6ddd-dfb5-4c7f-ad2b-405f0fd00c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:25.373290 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f6ddd-dfb5-4c7f-ad2b-405f0fd00c7c admin admin] PATH_INFO: `/v3/projects/4eccb7f911d2425a9e79ab7fe358df78/users/964066758f0b475ca09508276039f01a/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:25.387651 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f6ddd-dfb5-4c7f-ad2b-405f0fd00c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eccb7f911d2425a9e79ab7fe358df78, user_id=964066758f0b475ca09508276039f01a, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:25.390328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f6ddd-dfb5-4c7f-ad2b-405f0fd00c7c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:25.402832 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1182/2358] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:39:25 2022] PUT /identity/v3/projects/4eccb7f911d2425a9e79ab7fe358df78/users/964066758f0b475ca09508276039f01a/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:39:25.406656 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344a1ba-406c-4f46-ad44-f92f1bc129f8 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:25.418059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344a1ba-406c-4f46-ad44-f92f1bc129f8 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:25.473292 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1423971-10fb-4a6f-9c41-d7873a9cb2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:25.473826 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1423971-10fb-4a6f-9c41-d7873a9cb2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:25.474106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1423971-10fb-4a6f-9c41-d7873a9cb2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:25.474379 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1423971-10fb-4a6f-9c41-d7873a9cb2b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:25.475021 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1423971-10fb-4a6f-9c41-d7873a9cb2b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:25.476594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1423971-10fb-4a6f-9c41-d7873a9cb2b7 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:25.486607 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1177/2359] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:25.490673 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f6ddd-dfb5-4c7f-ad2b-405f0fd00c7c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:25.501753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f6ddd-dfb5-4c7f-ad2b-405f0fd00c7c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:25.506345 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320ca49-bdb7-49bd-8d52-35c51bb6bac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:25.507006 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320ca49-bdb7-49bd-8d52-35c51bb6bac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:25.507287 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320ca49-bdb7-49bd-8d52-35c51bb6bac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:25.507566 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320ca49-bdb7-49bd-8d52-35c51bb6bac5 admin admin] PATH_INFO: `/v3/projects/4eccb7f911d2425a9e79ab7fe358df78/users/964066758f0b475ca09508276039f01a/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:25.509519 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320ca49-bdb7-49bd-8d52-35c51bb6bac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eccb7f911d2425a9e79ab7fe358df78, user_id=964066758f0b475ca09508276039f01a, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:25.512160 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320ca49-bdb7-49bd-8d52-35c51bb6bac5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:25.522175 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1183/2360] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:39:25 2022] PUT /identity/v3/projects/4eccb7f911d2425a9e79ab7fe358df78/users/964066758f0b475ca09508276039f01a/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:25.532503 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d71aa-3f34-46e4-a960-2214b2fd0132 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:25.532790 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d71aa-3f34-46e4-a960-2214b2fd0132 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:25.533067 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d71aa-3f34-46e4-a960-2214b2fd0132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:25.547313 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:25.561963 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-2f3d71aa-3f34-46e4-a960-2214b2fd0132 None None] MFA Rules not processed for user `964066758f0b475ca09508276039f01a`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:25.563253 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2f3d71aa-3f34-46e4-a960-2214b2fd0132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:25.629660 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1178/2361] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:25.640404 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320ca49-bdb7-49bd-8d52-35c51bb6bac5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:25.642140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9320ca49-bdb7-49bd-8d52-35c51bb6bac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:25.699534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320ca49-bdb7-49bd-8d52-35c51bb6bac5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:25.703210 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fbe90-1a6d-4103-a571-5853a8fae38f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:25.703807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fbe90-1a6d-4103-a571-5853a8fae38f service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:25.704088 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fbe90-1a6d-4103-a571-5853a8fae38f service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:25.704363 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fbe90-1a6d-4103-a571-5853a8fae38f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:25.713722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fbe90-1a6d-4103-a571-5853a8fae38f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:25.715132 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fbe90-1a6d-4103-a571-5853a8fae38f service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:25.724561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1184/2362] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:39:26.089802 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d71aa-3f34-46e4-a960-2214b2fd0132 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:26.150756 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d71aa-3f34-46e4-a960-2214b2fd0132 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:26.155396 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7fb94-edeb-4115-83cc-7287a4057d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:26.156018 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7fb94-edeb-4115-83cc-7287a4057d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:26.156298 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7fb94-edeb-4115-83cc-7287a4057d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:26.156570 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7fb94-edeb-4115-83cc-7287a4057d1f admin admin] PATH_INFO: `/v3/users/98ff9cd8f49741f7b65e76b32e34eb7d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:26.157696 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7fb94-edeb-4115-83cc-7287a4057d1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=98ff9cd8f49741f7b65e76b32e34eb7d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:26.159605 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7fb94-edeb-4115-83cc-7287a4057d1f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:26.204173 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-89b7fb94-edeb-4115-83cc-7287a4057d1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98ff9cd8f49741f7b65e76b32e34eb7d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:26.204805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-89b7fb94-edeb-4115-83cc-7287a4057d1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98ff9cd8f49741f7b65e76b32e34eb7d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:26.205422 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-89b7fb94-edeb-4115-83cc-7287a4057d1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98ff9cd8f49741f7b65e76b32e34eb7d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:26.212320 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-89b7fb94-edeb-4115-83cc-7287a4057d1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98ff9cd8f49741f7b65e76b32e34eb7d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:26.219323 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-89b7fb94-edeb-4115-83cc-7287a4057d1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98ff9cd8f49741f7b65e76b32e34eb7d'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:26.236869 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1179/2363] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:39:26 2022] DELETE /identity/v3/users/98ff9cd8f49741f7b65e76b32e34eb7d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:26.241297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017c3bf-717d-4d51-9c7b-e070bfb0d631 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:26.241758 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017c3bf-717d-4d51-9c7b-e070bfb0d631 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:26.241888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017c3bf-717d-4d51-9c7b-e070bfb0d631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:26.261094 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1017c3bf-717d-4d51-9c7b-e070bfb0d631 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:26.262318 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1017c3bf-717d-4d51-9c7b-e070bfb0d631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:26.311487 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:26.322410 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1185/2364] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:26.332149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7fb94-edeb-4115-83cc-7287a4057d1f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:26.333570 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-89b7fb94-edeb-4115-83cc-7287a4057d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:26.347555 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:26.391831 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7fb94-edeb-4115-83cc-7287a4057d1f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:26.395447 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f5682-59d0-4aac-8dfb-b9168c3e4c87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:26.396041 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f5682-59d0-4aac-8dfb-b9168c3e4c87 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:26.396317 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f5682-59d0-4aac-8dfb-b9168c3e4c87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:26.396586 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f5682-59d0-4aac-8dfb-b9168c3e4c87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:26.405862 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f5682-59d0-4aac-8dfb-b9168c3e4c87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:26.407266 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f5682-59d0-4aac-8dfb-b9168c3e4c87 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:26.417033 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1180/2365] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:39:26.691392 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017c3bf-717d-4d51-9c7b-e070bfb0d631 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:26.692914 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1017c3bf-717d-4d51-9c7b-e070bfb0d631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:26.709717 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017c3bf-717d-4d51-9c7b-e070bfb0d631 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:26.714977 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b346f-1df4-4d6c-8b38-908d80ec2c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:26.715607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b346f-1df4-4d6c-8b38-908d80ec2c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:26.716016 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b346f-1df4-4d6c-8b38-908d80ec2c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:26.716296 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b346f-1df4-4d6c-8b38-908d80ec2c68 admin admin] PATH_INFO: `/v3/projects/c3fa160f36ff4f5581e30d6c81c9f8bb` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:26.717532 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b346f-1df4-4d6c-8b38-908d80ec2c68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3fa160f36ff4f5581e30d6c81c9f8bb)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:26.719309 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b346f-1df4-4d6c-8b38-908d80ec2c68 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:26.765125 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cd1b346f-1df4-4d6c-8b38-908d80ec2c68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3fa160f36ff4f5581e30d6c81c9f8bb', 'request_id': 'req-cd1b346f-1df4-4d6c-8b38-908d80ec2c68'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:26.771866 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cd1b346f-1df4-4d6c-8b38-908d80ec2c68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3fa160f36ff4f5581e30d6c81c9f8bb', 'request_id': 'req-cd1b346f-1df4-4d6c-8b38-908d80ec2c68'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:26.777927 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cd1b346f-1df4-4d6c-8b38-908d80ec2c68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3fa160f36ff4f5581e30d6c81c9f8bb', 'request_id': 'req-cd1b346f-1df4-4d6c-8b38-908d80ec2c68'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:26.788592 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cd1b346f-1df4-4d6c-8b38-908d80ec2c68 admin admin] The token cache is being invalidate because project c3fa160f36ff4f5581e30d6c81c9f8bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:39:26.788878 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cd1b346f-1df4-4d6c-8b38-908d80ec2c68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:26.789531 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cd1b346f-1df4-4d6c-8b38-908d80ec2c68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:26.791198 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1186/2366] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:39:26 2022] DELETE /identity/v3/projects/c3fa160f36ff4f5581e30d6c81c9f8bb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:26.795425 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f5682-59d0-4aac-8dfb-b9168c3e4c87 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:26.804958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f5682-59d0-4aac-8dfb-b9168c3e4c87 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:26.861642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4864ec-ee38-48d1-804d-7bcfd7791044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:26.862284 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4864ec-ee38-48d1-804d-7bcfd7791044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:26.862546 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4864ec-ee38-48d1-804d-7bcfd7791044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:26.862818 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4864ec-ee38-48d1-804d-7bcfd7791044 admin admin] PATH_INFO: `/v3/users/964066758f0b475ca09508276039f01a` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:26.863929 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4864ec-ee38-48d1-804d-7bcfd7791044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=964066758f0b475ca09508276039f01a)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:26.866100 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4864ec-ee38-48d1-804d-7bcfd7791044 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:26.912887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ee4864ec-ee38-48d1-804d-7bcfd7791044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '964066758f0b475ca09508276039f01a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:26.913625 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ee4864ec-ee38-48d1-804d-7bcfd7791044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '964066758f0b475ca09508276039f01a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:26.914235 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ee4864ec-ee38-48d1-804d-7bcfd7791044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '964066758f0b475ca09508276039f01a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:26.921296 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ee4864ec-ee38-48d1-804d-7bcfd7791044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '964066758f0b475ca09508276039f01a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:26.928222 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ee4864ec-ee38-48d1-804d-7bcfd7791044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '964066758f0b475ca09508276039f01a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:26.944940 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1181/2367] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:39:26 2022] DELETE /identity/v3/users/964066758f0b475ca09508276039f01a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:27.212203 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b346f-1df4-4d6c-8b38-908d80ec2c68 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:27.213668 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cd1b346f-1df4-4d6c-8b38-908d80ec2c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:27.229778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b346f-1df4-4d6c-8b38-908d80ec2c68 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:27.286318 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0d559-f3bd-4b80-9c7e-fe91424d7a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:27.286979 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0d559-f3bd-4b80-9c7e-fe91424d7a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:27.287220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0d559-f3bd-4b80-9c7e-fe91424d7a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:27.287496 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0d559-f3bd-4b80-9c7e-fe91424d7a33 admin admin] PATH_INFO: `/v3/projects/4eccb7f911d2425a9e79ab7fe358df78` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:27.288626 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0d559-f3bd-4b80-9c7e-fe91424d7a33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eccb7f911d2425a9e79ab7fe358df78)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:27.290615 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0d559-f3bd-4b80-9c7e-fe91424d7a33 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:27.337071 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-60e0d559-f3bd-4b80-9c7e-fe91424d7a33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eccb7f911d2425a9e79ab7fe358df78', 'request_id': 'req-60e0d559-f3bd-4b80-9c7e-fe91424d7a33'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:27.344172 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-60e0d559-f3bd-4b80-9c7e-fe91424d7a33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eccb7f911d2425a9e79ab7fe358df78', 'request_id': 'req-60e0d559-f3bd-4b80-9c7e-fe91424d7a33'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:27.349787 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-60e0d559-f3bd-4b80-9c7e-fe91424d7a33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eccb7f911d2425a9e79ab7fe358df78', 'request_id': 'req-60e0d559-f3bd-4b80-9c7e-fe91424d7a33'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:27.360892 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-60e0d559-f3bd-4b80-9c7e-fe91424d7a33 admin admin] The token cache is being invalidate because project 4eccb7f911d2425a9e79ab7fe358df78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:39:27.361217 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-60e0d559-f3bd-4b80-9c7e-fe91424d7a33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:27.361872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-60e0d559-f3bd-4b80-9c7e-fe91424d7a33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:27.363431 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1187/2368] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:39:27 2022] DELETE /identity/v3/projects/4eccb7f911d2425a9e79ab7fe358df78 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:27.368851 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90673494-2b3d-4cae-8054-ed6fcb870860 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:27.369367 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90673494-2b3d-4cae-8054-ed6fcb870860 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:27.369482 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90673494-2b3d-4cae-8054-ed6fcb870860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:27.389476 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-90673494-2b3d-4cae-8054-ed6fcb870860 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:27.390659 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-90673494-2b3d-4cae-8054-ed6fcb870860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:27.419259 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:27.450278 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1182/2369] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:27.457930 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bd8fe-d419-469b-ae1f-0cd46f248158 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:27.458229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bd8fe-d419-469b-ae1f-0cd46f248158 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:27.458561 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bd8fe-d419-469b-ae1f-0cd46f248158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:27.478280 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-177bd8fe-d419-469b-ae1f-0cd46f248158 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:27.479483 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-177bd8fe-d419-469b-ae1f-0cd46f248158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:27.487332 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1188/2370] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:27.491510 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90673494-2b3d-4cae-8054-ed6fcb870860 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:27.501572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90673494-2b3d-4cae-8054-ed6fcb870860 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:27.506072 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8860e5f-39a2-4e45-b638-e683e92e462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:27.506656 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8860e5f-39a2-4e45-b638-e683e92e462f admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:27.506932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8860e5f-39a2-4e45-b638-e683e92e462f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:27.507199 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8860e5f-39a2-4e45-b638-e683e92e462f admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:27.507835 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8860e5f-39a2-4e45-b638-e683e92e462f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:39:27.508132 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8860e5f-39a2-4e45-b638-e683e92e462f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:27.509777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8860e5f-39a2-4e45-b638-e683e92e462f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:27.521251 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1183/2371] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:39:27.525417 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bd8fe-d419-469b-ae1f-0cd46f248158 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:27.531144 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:27.534882 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bd8fe-d419-469b-ae1f-0cd46f248158 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:27.543802 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfb887-42b2-418d-8503-09a34a4d60b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:27.544409 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfb887-42b2-418d-8503-09a34a4d60b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:27.544686 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfb887-42b2-418d-8503-09a34a4d60b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:27.544960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfb887-42b2-418d-8503-09a34a4d60b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:27.545636 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfb887-42b2-418d-8503-09a34a4d60b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:27.547516 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfb887-42b2-418d-8503-09a34a4d60b8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:27.575549 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1189/2372] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:39:27 2022] POST /identity/v3/projects => generated 361 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:39:27.579870 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8860e5f-39a2-4e45-b638-e683e92e462f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:27.589967 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8860e5f-39a2-4e45-b638-e683e92e462f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:27.646091 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be27d9-ad05-4e7a-97c4-d8c2ff917fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:27.646690 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be27d9-ad05-4e7a-97c4-d8c2ff917fed admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:27.646973 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be27d9-ad05-4e7a-97c4-d8c2ff917fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:27.647248 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be27d9-ad05-4e7a-97c4-d8c2ff917fed admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:27.647881 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be27d9-ad05-4e7a-97c4-d8c2ff917fed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:27.649926 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be27d9-ad05-4e7a-97c4-d8c2ff917fed admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:27.671135 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1184/2373] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:39:27 2022] POST /identity/v3/users => generated 281 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:39:27.675384 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfb887-42b2-418d-8503-09a34a4d60b8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:27.686453 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfb887-42b2-418d-8503-09a34a4d60b8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:27.691063 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fc4f3-a1c9-4fc4-925f-1a2316bea8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:27.691671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fc4f3-a1c9-4fc4-925f-1a2316bea8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:27.691980 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fc4f3-a1c9-4fc4-925f-1a2316bea8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:27.692254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fc4f3-a1c9-4fc4-925f-1a2316bea8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:27.692921 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fc4f3-a1c9-4fc4-925f-1a2316bea8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:27.694555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fc4f3-a1c9-4fc4-925f-1a2316bea8a9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:27.704366 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1190/2374] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:27.708195 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be27d9-ad05-4e7a-97c4-d8c2ff917fed admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:27.718145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be27d9-ad05-4e7a-97c4-d8c2ff917fed admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:27.722644 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5600837-adb8-45d2-823a-bf888da2c535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:27.723224 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5600837-adb8-45d2-823a-bf888da2c535 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:27.723526 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5600837-adb8-45d2-823a-bf888da2c535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:27.723951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5600837-adb8-45d2-823a-bf888da2c535 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:27.724679 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5600837-adb8-45d2-823a-bf888da2c535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:27.726294 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5600837-adb8-45d2-823a-bf888da2c535 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:27.737145 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1185/2375] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:39:27.741018 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fc4f3-a1c9-4fc4-925f-1a2316bea8a9 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:27.751641 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fc4f3-a1c9-4fc4-925f-1a2316bea8a9 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:27.756299 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a124d45-686c-452f-9a6f-5ce30756bb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:27.756960 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a124d45-686c-452f-9a6f-5ce30756bb05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:27.757285 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a124d45-686c-452f-9a6f-5ce30756bb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:27.757579 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a124d45-686c-452f-9a6f-5ce30756bb05 admin admin] PATH_INFO: `/v3/projects/f0e5d0b923b749ad8cc03ced4e47e4bf/users/3d7d95abb4724d90944b3950ec056d67/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:27.771769 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a124d45-686c-452f-9a6f-5ce30756bb05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e5d0b923b749ad8cc03ced4e47e4bf, user_id=3d7d95abb4724d90944b3950ec056d67, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:27.774949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a124d45-686c-452f-9a6f-5ce30756bb05 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:27.787013 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1191/2376] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:39:27 2022] PUT /identity/v3/projects/f0e5d0b923b749ad8cc03ced4e47e4bf/users/3d7d95abb4724d90944b3950ec056d67/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:27.798219 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7728a-75f4-4029-80f0-27d0b88789ce None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:27.798501 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7728a-75f4-4029-80f0-27d0b88789ce None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:27.798772 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7728a-75f4-4029-80f0-27d0b88789ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:27.825534 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-59d7728a-75f4-4029-80f0-27d0b88789ce None None] MFA Rules not processed for user `3d7d95abb4724d90944b3950ec056d67`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:27.826724 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-59d7728a-75f4-4029-80f0-27d0b88789ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:27.889124 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1186/2377] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:27.923025 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a124d45-686c-452f-9a6f-5ce30756bb05 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:27.924709 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3a124d45-686c-452f-9a6f-5ce30756bb05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:27.979857 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a124d45-686c-452f-9a6f-5ce30756bb05 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:27.983483 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b0091-6bb9-46ae-b09f-54794b2186fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:27.984077 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b0091-6bb9-46ae-b09f-54794b2186fb service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:27.984354 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b0091-6bb9-46ae-b09f-54794b2186fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:27.984625 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b0091-6bb9-46ae-b09f-54794b2186fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:27.992802 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b0091-6bb9-46ae-b09f-54794b2186fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:27.994234 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b0091-6bb9-46ae-b09f-54794b2186fb service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:28.003331 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1192/2378] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:39:28.019036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7728a-75f4-4029-80f0-27d0b88789ce None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:28.049769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:28.082797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7728a-75f4-4029-80f0-27d0b88789ce None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:28.087798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e643f1-cec6-47b2-9803-4a46fd7688da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:28.088418 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e643f1-cec6-47b2-9803-4a46fd7688da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:28.088860 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e643f1-cec6-47b2-9803-4a46fd7688da admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:28.089052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e643f1-cec6-47b2-9803-4a46fd7688da admin admin] PATH_INFO: `/v3/users/3d7d95abb4724d90944b3950ec056d67` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:28.090128 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e643f1-cec6-47b2-9803-4a46fd7688da admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d7d95abb4724d90944b3950ec056d67)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:28.092023 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e643f1-cec6-47b2-9803-4a46fd7688da admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:28.136857 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-47e643f1-cec6-47b2-9803-4a46fd7688da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d7d95abb4724d90944b3950ec056d67'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:28.137542 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-47e643f1-cec6-47b2-9803-4a46fd7688da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d7d95abb4724d90944b3950ec056d67'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:28.138164 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-47e643f1-cec6-47b2-9803-4a46fd7688da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d7d95abb4724d90944b3950ec056d67'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:28.145054 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-47e643f1-cec6-47b2-9803-4a46fd7688da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d7d95abb4724d90944b3950ec056d67'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:28.153262 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-47e643f1-cec6-47b2-9803-4a46fd7688da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d7d95abb4724d90944b3950ec056d67'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:28.170738 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1187/2379] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:39:28 2022] DELETE /identity/v3/users/3d7d95abb4724d90944b3950ec056d67 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:28.175211 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ed286-b02d-4e04-80aa-50421dee1ca1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:28.175498 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ed286-b02d-4e04-80aa-50421dee1ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:28.175769 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ed286-b02d-4e04-80aa-50421dee1ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:28.194230 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4b2ed286-b02d-4e04-80aa-50421dee1ca1 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:28.195416 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4b2ed286-b02d-4e04-80aa-50421dee1ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:28.252077 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1193/2380] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:39:28.262558 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e643f1-cec6-47b2-9803-4a46fd7688da admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:28.263982 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-47e643f1-cec6-47b2-9803-4a46fd7688da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:28.320240 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e643f1-cec6-47b2-9803-4a46fd7688da admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:28.324474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a79d6-9117-4aa3-99bd-80ed0367ab32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:28.325072 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a79d6-9117-4aa3-99bd-80ed0367ab32 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:28.325388 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a79d6-9117-4aa3-99bd-80ed0367ab32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:28.325664 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a79d6-9117-4aa3-99bd-80ed0367ab32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:28.334679 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a79d6-9117-4aa3-99bd-80ed0367ab32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:28.336094 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a79d6-9117-4aa3-99bd-80ed0367ab32 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:28.346029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1188/2381] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:39:28.610710 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ed286-b02d-4e04-80aa-50421dee1ca1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:28.612188 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4b2ed286-b02d-4e04-80aa-50421dee1ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:28.625248 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ed286-b02d-4e04-80aa-50421dee1ca1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:28.629965 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e738e-df2a-482b-b0cb-e4af6b1ff7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:28.630600 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e738e-df2a-482b-b0cb-e4af6b1ff7ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:28.630899 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e738e-df2a-482b-b0cb-e4af6b1ff7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:28.631174 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e738e-df2a-482b-b0cb-e4af6b1ff7ad admin admin] PATH_INFO: `/v3/projects/f0e5d0b923b749ad8cc03ced4e47e4bf` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:28.632300 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e738e-df2a-482b-b0cb-e4af6b1ff7ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e5d0b923b749ad8cc03ced4e47e4bf)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:28.634917 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e738e-df2a-482b-b0cb-e4af6b1ff7ad admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:28.679152 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:28.683297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b26e738e-df2a-482b-b0cb-e4af6b1ff7ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e5d0b923b749ad8cc03ced4e47e4bf', 'request_id': 'req-b26e738e-df2a-482b-b0cb-e4af6b1ff7ad'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:28.691721 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b26e738e-df2a-482b-b0cb-e4af6b1ff7ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e5d0b923b749ad8cc03ced4e47e4bf', 'request_id': 'req-b26e738e-df2a-482b-b0cb-e4af6b1ff7ad'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:28.698042 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b26e738e-df2a-482b-b0cb-e4af6b1ff7ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e5d0b923b749ad8cc03ced4e47e4bf', 'request_id': 'req-b26e738e-df2a-482b-b0cb-e4af6b1ff7ad'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:28.708847 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b26e738e-df2a-482b-b0cb-e4af6b1ff7ad admin admin] The token cache is being invalidate because project f0e5d0b923b749ad8cc03ced4e47e4bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:39:28.709163 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b26e738e-df2a-482b-b0cb-e4af6b1ff7ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:28.709798 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b26e738e-df2a-482b-b0cb-e4af6b1ff7ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:28.711262 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1194/2382] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:39:28 2022] DELETE /identity/v3/projects/f0e5d0b923b749ad8cc03ced4e47e4bf => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:28.716087 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb4b9c-3cdb-4636-b78a-146151e4805b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:28.716575 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb4b9c-3cdb-4636-b78a-146151e4805b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:28.716678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb4b9c-3cdb-4636-b78a-146151e4805b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:28.735733 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-4bbb4b9c-3cdb-4636-b78a-146151e4805b None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:28.736938 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4bbb4b9c-3cdb-4636-b78a-146151e4805b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:28.784049 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:28.799326 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1189/2383] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:28.808422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f7e7d-93aa-49dd-9c81-5dd52e202bb5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:28.808711 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f7e7d-93aa-49dd-9c81-5dd52e202bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:28.808987 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f7e7d-93aa-49dd-9c81-5dd52e202bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:28.828642 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2a7f7e7d-93aa-49dd-9c81-5dd52e202bb5 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:28.829869 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2a7f7e7d-93aa-49dd-9c81-5dd52e202bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:28.837636 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1195/2384] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:28.841665 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb4b9c-3cdb-4636-b78a-146151e4805b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:28.851250 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb4b9c-3cdb-4636-b78a-146151e4805b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:28.855756 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771c5d4-595d-4e64-8611-e6bd3cf951e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:28.856341 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771c5d4-595d-4e64-8611-e6bd3cf951e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:28.856618 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771c5d4-595d-4e64-8611-e6bd3cf951e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:28.856893 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771c5d4-595d-4e64-8611-e6bd3cf951e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:28.857610 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771c5d4-595d-4e64-8611-e6bd3cf951e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:39:28.857905 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771c5d4-595d-4e64-8611-e6bd3cf951e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:28.859467 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771c5d4-595d-4e64-8611-e6bd3cf951e2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:28.871281 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1190/2385] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:39:28.875410 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f7e7d-93aa-49dd-9c81-5dd52e202bb5 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:28.885991 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f7e7d-93aa-49dd-9c81-5dd52e202bb5 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:28.890579 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478428d-34d3-49d7-b42f-1cfe7cdc4e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:28.891174 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478428d-34d3-49d7-b42f-1cfe7cdc4e1c admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:28.891453 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478428d-34d3-49d7-b42f-1cfe7cdc4e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:28.891726 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478428d-34d3-49d7-b42f-1cfe7cdc4e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:28.892350 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478428d-34d3-49d7-b42f-1cfe7cdc4e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:28.894319 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478428d-34d3-49d7-b42f-1cfe7cdc4e1c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:28.921136 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1196/2386] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:39:28 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:39:28.925163 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771c5d4-595d-4e64-8611-e6bd3cf951e2 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:28.935599 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771c5d4-595d-4e64-8611-e6bd3cf951e2 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:28.989899 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7968e50-7e03-40a7-848d-66dfda31c885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:28.990418 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7968e50-7e03-40a7-848d-66dfda31c885 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:28.990704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7968e50-7e03-40a7-848d-66dfda31c885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:28.991001 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7968e50-7e03-40a7-848d-66dfda31c885 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:28.991629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7968e50-7e03-40a7-848d-66dfda31c885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:28.994206 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7968e50-7e03-40a7-848d-66dfda31c885 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:29.015069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1191/2387] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:39:28 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:39:29.019262 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478428d-34d3-49d7-b42f-1cfe7cdc4e1c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:29.029581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478428d-34d3-49d7-b42f-1cfe7cdc4e1c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:29.034122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b985b86-0df9-4741-b0e7-b77512187bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:29.034709 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b985b86-0df9-4741-b0e7-b77512187bbb admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:29.034995 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b985b86-0df9-4741-b0e7-b77512187bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:29.035267 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b985b86-0df9-4741-b0e7-b77512187bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:29.035908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b985b86-0df9-4741-b0e7-b77512187bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:29.037531 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b985b86-0df9-4741-b0e7-b77512187bbb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:29.047893 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1197/2388] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:29.051607 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7968e50-7e03-40a7-848d-66dfda31c885 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:29.062893 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7968e50-7e03-40a7-848d-66dfda31c885 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:29.067870 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e79f2a-4964-4b20-9415-b0c2d044eb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:29.068557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e79f2a-4964-4b20-9415-b0c2d044eb8a admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:29.068892 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e79f2a-4964-4b20-9415-b0c2d044eb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:29.069520 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e79f2a-4964-4b20-9415-b0c2d044eb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:29.070797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e79f2a-4964-4b20-9415-b0c2d044eb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:29.072363 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e79f2a-4964-4b20-9415-b0c2d044eb8a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:29.085333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1192/2389] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:29.089608 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b985b86-0df9-4741-b0e7-b77512187bbb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:29.099653 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b985b86-0df9-4741-b0e7-b77512187bbb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:29.104865 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ce924-e35d-4e72-8c38-858a27bf66f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:29.105543 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ce924-e35d-4e72-8c38-858a27bf66f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:29.105825 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ce924-e35d-4e72-8c38-858a27bf66f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:29.106101 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ce924-e35d-4e72-8c38-858a27bf66f3 admin admin] PATH_INFO: `/v3/projects/40aea786a42a4ace86a6c5bc0422ac20/users/d328a4c204e94d379425a6f53b4e89d2/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:29.120910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ce924-e35d-4e72-8c38-858a27bf66f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40aea786a42a4ace86a6c5bc0422ac20, user_id=d328a4c204e94d379425a6f53b4e89d2, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:29.123752 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ce924-e35d-4e72-8c38-858a27bf66f3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:29.136309 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1198/2390] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:39:29 2022] PUT /identity/v3/projects/40aea786a42a4ace86a6c5bc0422ac20/users/d328a4c204e94d379425a6f53b4e89d2/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:29.146423 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f2197-c3cf-41ba-bbad-e11d62b82b4f None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:29.146717 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f2197-c3cf-41ba-bbad-e11d62b82b4f None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:29.146995 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f2197-c3cf-41ba-bbad-e11d62b82b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:29.176403 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-a88f2197-c3cf-41ba-bbad-e11d62b82b4f None None] MFA Rules not processed for user `d328a4c204e94d379425a6f53b4e89d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:29.177654 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a88f2197-c3cf-41ba-bbad-e11d62b82b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:29.240651 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1193/2391] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:29.245911 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ce924-e35d-4e72-8c38-858a27bf66f3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:29.307062 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ce924-e35d-4e72-8c38-858a27bf66f3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:29.311708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4380f8-8ed3-4595-86a3-206f03478ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:29.312304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4380f8-8ed3-4595-86a3-206f03478ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:29.312586 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4380f8-8ed3-4595-86a3-206f03478ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:29.312861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4380f8-8ed3-4595-86a3-206f03478ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:29.313584 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4380f8-8ed3-4595-86a3-206f03478ec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:29.315445 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4380f8-8ed3-4595-86a3-206f03478ec2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:29.341309 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1199/2392] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:39:29 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:39:29.345404 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f2197-c3cf-41ba-bbad-e11d62b82b4f None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:29.356533 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f2197-c3cf-41ba-bbad-e11d62b82b4f None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:29.398687 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:29.412410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd15bd3-1f5e-4480-9334-b69aa3a8bb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:29.413008 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd15bd3-1f5e-4480-9334-b69aa3a8bb75 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:29.413316 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd15bd3-1f5e-4480-9334-b69aa3a8bb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:29.413592 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd15bd3-1f5e-4480-9334-b69aa3a8bb75 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:29.414255 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd15bd3-1f5e-4480-9334-b69aa3a8bb75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:29.416751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd15bd3-1f5e-4480-9334-b69aa3a8bb75 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:29.437500 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1194/2393] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:39:29 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:39:29.441435 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4380f8-8ed3-4595-86a3-206f03478ec2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:29.452618 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4380f8-8ed3-4595-86a3-206f03478ec2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:29.457445 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21eafca-c7e2-4681-83b8-27155c0e223b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:29.458148 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21eafca-c7e2-4681-83b8-27155c0e223b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:29.458432 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21eafca-c7e2-4681-83b8-27155c0e223b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:29.458706 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21eafca-c7e2-4681-83b8-27155c0e223b admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:29.459350 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21eafca-c7e2-4681-83b8-27155c0e223b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:29.460930 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21eafca-c7e2-4681-83b8-27155c0e223b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:29.471838 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1200/2394] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:29.476011 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd15bd3-1f5e-4480-9334-b69aa3a8bb75 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:29.486509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd15bd3-1f5e-4480-9334-b69aa3a8bb75 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:29.491234 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2d2a4-c796-4135-9c12-bb9bec3624cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:29.491804 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2d2a4-c796-4135-9c12-bb9bec3624cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:29.492087 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2d2a4-c796-4135-9c12-bb9bec3624cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:29.492386 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2d2a4-c796-4135-9c12-bb9bec3624cf admin admin] PATH_INFO: `/v3/projects/4c81ef267cb44f5ebe3c1ccce06f407e/users/140e430d825d466f8799590879365d59/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:29.506803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2d2a4-c796-4135-9c12-bb9bec3624cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c81ef267cb44f5ebe3c1ccce06f407e, user_id=140e430d825d466f8799590879365d59, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:29.509490 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2d2a4-c796-4135-9c12-bb9bec3624cf admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:29.522277 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1195/2395] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:39:29 2022] PUT /identity/v3/projects/4c81ef267cb44f5ebe3c1ccce06f407e/users/140e430d825d466f8799590879365d59/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:29.526632 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21eafca-c7e2-4681-83b8-27155c0e223b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:29.536493 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21eafca-c7e2-4681-83b8-27155c0e223b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:29.577366 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:29.594729 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e6d7c-cd81-4358-9913-f17401fa88f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:29.595328 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e6d7c-cd81-4358-9913-f17401fa88f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:29.595610 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e6d7c-cd81-4358-9913-f17401fa88f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:29.595885 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e6d7c-cd81-4358-9913-f17401fa88f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:29.596525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e6d7c-cd81-4358-9913-f17401fa88f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:29.598120 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e6d7c-cd81-4358-9913-f17401fa88f5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:29.608105 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1201/2396] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:29.612189 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2d2a4-c796-4135-9c12-bb9bec3624cf admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:29.622393 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2d2a4-c796-4135-9c12-bb9bec3624cf admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:29.627010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb6a25-1a80-4a5d-b3b1-cbbe7488e300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:29.627655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb6a25-1a80-4a5d-b3b1-cbbe7488e300 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:29.627940 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb6a25-1a80-4a5d-b3b1-cbbe7488e300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:29.628219 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb6a25-1a80-4a5d-b3b1-cbbe7488e300 admin admin] PATH_INFO: `/v3/projects/4c81ef267cb44f5ebe3c1ccce06f407e/users/140e430d825d466f8799590879365d59/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:29.630174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb6a25-1a80-4a5d-b3b1-cbbe7488e300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c81ef267cb44f5ebe3c1ccce06f407e, user_id=140e430d825d466f8799590879365d59, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:29.632791 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb6a25-1a80-4a5d-b3b1-cbbe7488e300 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:29.643293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1196/2397] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:39:29 2022] PUT /identity/v3/projects/4c81ef267cb44f5ebe3c1ccce06f407e/users/140e430d825d466f8799590879365d59/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:29.653778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcedc4f-ce7c-488a-b9ac-243862946dc6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:29.654268 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcedc4f-ce7c-488a-b9ac-243862946dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:29.654378 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcedc4f-ce7c-488a-b9ac-243862946dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:29.682406 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-bdcedc4f-ce7c-488a-b9ac-243862946dc6 None None] MFA Rules not processed for user `140e430d825d466f8799590879365d59`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:29.683599 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bdcedc4f-ce7c-488a-b9ac-243862946dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:29.748726 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1202/2398] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:39:29.759795 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb6a25-1a80-4a5d-b3b1-cbbe7488e300 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:29.761594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-dbfb6a25-1a80-4a5d-b3b1-cbbe7488e300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:29.817897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb6a25-1a80-4a5d-b3b1-cbbe7488e300 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:29.822013 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e51599-2866-434f-b632-de48ca31ee5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:29.822601 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e51599-2866-434f-b632-de48ca31ee5b service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:29.822882 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e51599-2866-434f-b632-de48ca31ee5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:29.823155 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e51599-2866-434f-b632-de48ca31ee5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:29.877037 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e51599-2866-434f-b632-de48ca31ee5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:29.878481 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e51599-2866-434f-b632-de48ca31ee5b service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:29.887711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1197/2399] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:39:32.414749 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcedc4f-ce7c-488a-b9ac-243862946dc6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:32.474712 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcedc4f-ce7c-488a-b9ac-243862946dc6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:32.480100 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec22acd-0d47-4817-8631-b22f4b6275ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:32.480718 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec22acd-0d47-4817-8631-b22f4b6275ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:32.480998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec22acd-0d47-4817-8631-b22f4b6275ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:32.481314 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec22acd-0d47-4817-8631-b22f4b6275ed admin admin] PATH_INFO: `/v3/users/d328a4c204e94d379425a6f53b4e89d2` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:32.482425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec22acd-0d47-4817-8631-b22f4b6275ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=d328a4c204e94d379425a6f53b4e89d2)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:32.484322 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec22acd-0d47-4817-8631-b22f4b6275ed admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:32.528763 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3ec22acd-0d47-4817-8631-b22f4b6275ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd328a4c204e94d379425a6f53b4e89d2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:32.535889 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3ec22acd-0d47-4817-8631-b22f4b6275ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd328a4c204e94d379425a6f53b4e89d2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:32.536552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3ec22acd-0d47-4817-8631-b22f4b6275ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd328a4c204e94d379425a6f53b4e89d2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:32.547596 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:32.550224 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3ec22acd-0d47-4817-8631-b22f4b6275ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd328a4c204e94d379425a6f53b4e89d2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:32.558926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3ec22acd-0d47-4817-8631-b22f4b6275ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd328a4c204e94d379425a6f53b4e89d2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:32.564996 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1203/2400] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:39:32 2022] DELETE /identity/v3/users/d328a4c204e94d379425a6f53b4e89d2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:32.569447 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29433e0c-0aad-49e5-b25f-f38857bbbef0 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:32.569905 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29433e0c-0aad-49e5-b25f-f38857bbbef0 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:32.570024 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29433e0c-0aad-49e5-b25f-f38857bbbef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:32.590594 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-29433e0c-0aad-49e5-b25f-f38857bbbef0 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:32.591853 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-29433e0c-0aad-49e5-b25f-f38857bbbef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:32.638578 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:32.651790 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1198/2401] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:32.661961 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec22acd-0d47-4817-8631-b22f4b6275ed admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:32.663437 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3ec22acd-0d47-4817-8631-b22f4b6275ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:32.723417 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec22acd-0d47-4817-8631-b22f4b6275ed admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:32.727078 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6aae5-31f1-4610-8652-7985fb183858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:32.727734 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6aae5-31f1-4610-8652-7985fb183858 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:32.728013 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6aae5-31f1-4610-8652-7985fb183858 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:32.728286 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6aae5-31f1-4610-8652-7985fb183858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:32.737601 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6aae5-31f1-4610-8652-7985fb183858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:32.739246 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6aae5-31f1-4610-8652-7985fb183858 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:32.749023 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1204/2402] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:39:33.025463 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29433e0c-0aad-49e5-b25f-f38857bbbef0 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:33.026913 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-29433e0c-0aad-49e5-b25f-f38857bbbef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:33.040549 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29433e0c-0aad-49e5-b25f-f38857bbbef0 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:33.045339 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa5e11-6264-4c86-b4d7-6683cce64bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:33.045971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa5e11-6264-4c86-b4d7-6683cce64bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:33.046255 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa5e11-6264-4c86-b4d7-6683cce64bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:33.046553 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa5e11-6264-4c86-b4d7-6683cce64bad admin admin] PATH_INFO: `/v3/projects/40aea786a42a4ace86a6c5bc0422ac20` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:33.047676 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa5e11-6264-4c86-b4d7-6683cce64bad admin admin] RBAC: Authorizing `identity:delete_project(project_id=40aea786a42a4ace86a6c5bc0422ac20)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:33.050221 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa5e11-6264-4c86-b4d7-6683cce64bad admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:33.100416 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a9fa5e11-6264-4c86-b4d7-6683cce64bad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40aea786a42a4ace86a6c5bc0422ac20', 'request_id': 'req-a9fa5e11-6264-4c86-b4d7-6683cce64bad'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:33.105871 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a9fa5e11-6264-4c86-b4d7-6683cce64bad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40aea786a42a4ace86a6c5bc0422ac20', 'request_id': 'req-a9fa5e11-6264-4c86-b4d7-6683cce64bad'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:33.112106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a9fa5e11-6264-4c86-b4d7-6683cce64bad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40aea786a42a4ace86a6c5bc0422ac20', 'request_id': 'req-a9fa5e11-6264-4c86-b4d7-6683cce64bad'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:33.124951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a9fa5e11-6264-4c86-b4d7-6683cce64bad admin admin] The token cache is being invalidate because project 40aea786a42a4ace86a6c5bc0422ac20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:39:33.125275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a9fa5e11-6264-4c86-b4d7-6683cce64bad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:33.125884 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a9fa5e11-6264-4c86-b4d7-6683cce64bad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:33.127356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1199/2403] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:39:33 2022] DELETE /identity/v3/projects/40aea786a42a4ace86a6c5bc0422ac20 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:33.131433 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6aae5-31f1-4610-8652-7985fb183858 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:33.141631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6aae5-31f1-4610-8652-7985fb183858 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:33.195869 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc607ced-be34-42f7-8f84-7aa0f635e691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:33.197124 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc607ced-be34-42f7-8f84-7aa0f635e691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:33.197414 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc607ced-be34-42f7-8f84-7aa0f635e691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:33.197689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc607ced-be34-42f7-8f84-7aa0f635e691 admin admin] PATH_INFO: `/v3/users/140e430d825d466f8799590879365d59` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:33.198795 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc607ced-be34-42f7-8f84-7aa0f635e691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=140e430d825d466f8799590879365d59)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:33.200684 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc607ced-be34-42f7-8f84-7aa0f635e691 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:33.243942 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fc607ced-be34-42f7-8f84-7aa0f635e691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140e430d825d466f8799590879365d59'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:33.250782 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fc607ced-be34-42f7-8f84-7aa0f635e691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140e430d825d466f8799590879365d59'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:33.251385 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fc607ced-be34-42f7-8f84-7aa0f635e691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140e430d825d466f8799590879365d59'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:33.263449 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fc607ced-be34-42f7-8f84-7aa0f635e691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140e430d825d466f8799590879365d59'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:33.270092 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fc607ced-be34-42f7-8f84-7aa0f635e691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140e430d825d466f8799590879365d59'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:33.275809 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1205/2404] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:39:33 2022] DELETE /identity/v3/users/140e430d825d466f8799590879365d59 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:33.555268 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa5e11-6264-4c86-b4d7-6683cce64bad admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:33.557750 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a9fa5e11-6264-4c86-b4d7-6683cce64bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:33.572690 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa5e11-6264-4c86-b4d7-6683cce64bad admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:33.632265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a1329-5701-4d35-9aa0-aa8ca702ca80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:33.632897 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a1329-5701-4d35-9aa0-aa8ca702ca80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:33.633194 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a1329-5701-4d35-9aa0-aa8ca702ca80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:33.633468 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a1329-5701-4d35-9aa0-aa8ca702ca80 admin admin] PATH_INFO: `/v3/projects/4c81ef267cb44f5ebe3c1ccce06f407e` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:33.634606 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a1329-5701-4d35-9aa0-aa8ca702ca80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c81ef267cb44f5ebe3c1ccce06f407e)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:33.636538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a1329-5701-4d35-9aa0-aa8ca702ca80 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:33.683965 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ad3a1329-5701-4d35-9aa0-aa8ca702ca80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c81ef267cb44f5ebe3c1ccce06f407e', 'request_id': 'req-ad3a1329-5701-4d35-9aa0-aa8ca702ca80'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:33.689487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ad3a1329-5701-4d35-9aa0-aa8ca702ca80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c81ef267cb44f5ebe3c1ccce06f407e', 'request_id': 'req-ad3a1329-5701-4d35-9aa0-aa8ca702ca80'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:33.695741 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ad3a1329-5701-4d35-9aa0-aa8ca702ca80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c81ef267cb44f5ebe3c1ccce06f407e', 'request_id': 'req-ad3a1329-5701-4d35-9aa0-aa8ca702ca80'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:33.707980 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ad3a1329-5701-4d35-9aa0-aa8ca702ca80 admin admin] The token cache is being invalidate because project 4c81ef267cb44f5ebe3c1ccce06f407e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:39:33.708265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ad3a1329-5701-4d35-9aa0-aa8ca702ca80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:33.708893 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ad3a1329-5701-4d35-9aa0-aa8ca702ca80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:33.710467 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1200/2405] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:39:33 2022] DELETE /identity/v3/projects/4c81ef267cb44f5ebe3c1ccce06f407e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:33.715276 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2513f-2ace-4323-ba1b-128e9456882d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:33.715739 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2513f-2ace-4323-ba1b-128e9456882d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:33.715857 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2513f-2ace-4323-ba1b-128e9456882d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:33.730186 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:33.736985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-92b2513f-2ace-4323-ba1b-128e9456882d None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:33.738852 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-92b2513f-2ace-4323-ba1b-128e9456882d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:33.796904 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1206/2406] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:39:33.860228 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76f203-f70c-49f0-8234-7c00dd667a62 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:33.860511 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76f203-f70c-49f0-8234-7c00dd667a62 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:33.860781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76f203-f70c-49f0-8234-7c00dd667a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:33.875051 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:33.880547 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ba76f203-f70c-49f0-8234-7c00dd667a62 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:33.882348 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ba76f203-f70c-49f0-8234-7c00dd667a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:33.890730 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1201/2407] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:33.894894 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2513f-2ace-4323-ba1b-128e9456882d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:33.905178 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2513f-2ace-4323-ba1b-128e9456882d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:33.909773 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a88ff-3648-4714-8ba5-6fef78579ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:33.910369 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a88ff-3648-4714-8ba5-6fef78579ebe admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:33.910656 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a88ff-3648-4714-8ba5-6fef78579ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:33.910934 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a88ff-3648-4714-8ba5-6fef78579ebe admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:33.911584 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a88ff-3648-4714-8ba5-6fef78579ebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:39:33.911889 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a88ff-3648-4714-8ba5-6fef78579ebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:33.913519 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a88ff-3648-4714-8ba5-6fef78579ebe admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:33.925654 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1207/2408] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:39:33.929571 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76f203-f70c-49f0-8234-7c00dd667a62 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:33.938545 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76f203-f70c-49f0-8234-7c00dd667a62 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:33.943090 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b5a9d-5d94-4d37-ab82-efbec7fb48e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:33.943669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b5a9d-5d94-4d37-ab82-efbec7fb48e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:33.943945 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b5a9d-5d94-4d37-ab82-efbec7fb48e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:33.944213 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b5a9d-5d94-4d37-ab82-efbec7fb48e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:33.944826 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b5a9d-5d94-4d37-ab82-efbec7fb48e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:33.946761 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b5a9d-5d94-4d37-ab82-efbec7fb48e5 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:33.973441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1202/2409] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:39:33 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:39:33.977397 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a88ff-3648-4714-8ba5-6fef78579ebe admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:33.987948 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a88ff-3648-4714-8ba5-6fef78579ebe admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:34.042564 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbf38b-15c3-45cf-a9ce-cbaa9a194ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:34.043224 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbf38b-15c3-45cf-a9ce-cbaa9a194ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:34.043505 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbf38b-15c3-45cf-a9ce-cbaa9a194ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:34.044041 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbf38b-15c3-45cf-a9ce-cbaa9a194ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:34.044674 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbf38b-15c3-45cf-a9ce-cbaa9a194ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:34.046664 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbf38b-15c3-45cf-a9ce-cbaa9a194ee9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:34.071229 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1208/2410] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:39:33 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:39:34.072536 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b5a9d-5d94-4d37-ab82-efbec7fb48e5 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:34.083158 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b5a9d-5d94-4d37-ab82-efbec7fb48e5 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:34.088250 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d2f79-88f0-460e-910b-c040bfe8ba60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:34.088841 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d2f79-88f0-460e-910b-c040bfe8ba60 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:34.089151 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d2f79-88f0-460e-910b-c040bfe8ba60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:34.089429 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d2f79-88f0-460e-910b-c040bfe8ba60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:34.090722 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d2f79-88f0-460e-910b-c040bfe8ba60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:34.092314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d2f79-88f0-460e-910b-c040bfe8ba60 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:34.102060 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1203/2411] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:34.106637 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbf38b-15c3-45cf-a9ce-cbaa9a194ee9 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:34.116708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbf38b-15c3-45cf-a9ce-cbaa9a194ee9 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:34.121359 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94b2fa-8314-4d79-90fb-861b08d17dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:34.121955 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94b2fa-8314-4d79-90fb-861b08d17dfa admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:34.122242 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94b2fa-8314-4d79-90fb-861b08d17dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:34.122520 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94b2fa-8314-4d79-90fb-861b08d17dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:34.123165 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94b2fa-8314-4d79-90fb-861b08d17dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:34.124747 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94b2fa-8314-4d79-90fb-861b08d17dfa admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:34.135702 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1209/2412] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:34.139446 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d2f79-88f0-460e-910b-c040bfe8ba60 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:34.149228 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d2f79-88f0-460e-910b-c040bfe8ba60 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:34.154516 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec8218-c644-4b7c-b4ae-2e2a6f42fecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:34.155146 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec8218-c644-4b7c-b4ae-2e2a6f42fecc admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:34.155432 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec8218-c644-4b7c-b4ae-2e2a6f42fecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:34.155701 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec8218-c644-4b7c-b4ae-2e2a6f42fecc admin admin] PATH_INFO: `/v3/projects/1bf87ddc182e4ec9898be41860f3c8fc/users/84179d09f779486988ed3b2e029192ee/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:34.170419 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec8218-c644-4b7c-b4ae-2e2a6f42fecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf87ddc182e4ec9898be41860f3c8fc, user_id=84179d09f779486988ed3b2e029192ee, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:34.173035 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec8218-c644-4b7c-b4ae-2e2a6f42fecc admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:34.185064 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1204/2413] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:39:34 2022] PUT /identity/v3/projects/1bf87ddc182e4ec9898be41860f3c8fc/users/84179d09f779486988ed3b2e029192ee/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:34.194745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c66c3-4261-4267-b660-59bfc718e297 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:34.195037 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c66c3-4261-4267-b660-59bfc718e297 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:34.195339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c66c3-4261-4267-b660-59bfc718e297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:34.223562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-032c66c3-4261-4267-b660-59bfc718e297 None None] MFA Rules not processed for user `84179d09f779486988ed3b2e029192ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:34.224757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-032c66c3-4261-4267-b660-59bfc718e297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:34.287537 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1210/2414] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:34.298459 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec8218-c644-4b7c-b4ae-2e2a6f42fecc admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:34.300167 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-c8ec8218-c644-4b7c-b4ae-2e2a6f42fecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:34.357366 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec8218-c644-4b7c-b4ae-2e2a6f42fecc admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:34.360987 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f37f8c-adb5-4bf6-86f0-bd00b9231c5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:34.361623 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f37f8c-adb5-4bf6-86f0-bd00b9231c5a service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:34.361904 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f37f8c-adb5-4bf6-86f0-bd00b9231c5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:34.362179 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f37f8c-adb5-4bf6-86f0-bd00b9231c5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:34.370396 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f37f8c-adb5-4bf6-86f0-bd00b9231c5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:34.371815 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f37f8c-adb5-4bf6-86f0-bd00b9231c5a service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:34.380749 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1205/2415] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:39:37.378972 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c66c3-4261-4267-b660-59bfc718e297 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:37.383152 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:37.441691 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c66c3-4261-4267-b660-59bfc718e297 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:37.446081 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bb956-e443-4266-a510-d1e08fd9a989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:37.446704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bb956-e443-4266-a510-d1e08fd9a989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:37.446985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bb956-e443-4266-a510-d1e08fd9a989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:37.447257 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bb956-e443-4266-a510-d1e08fd9a989 admin admin] PATH_INFO: `/v3/users/84179d09f779486988ed3b2e029192ee` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:37.448360 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7bb956-e443-4266-a510-d1e08fd9a989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84179d09f779486988ed3b2e029192ee)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:37.450287 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7bb956-e443-4266-a510-d1e08fd9a989 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:37.494029 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8a7bb956-e443-4266-a510-d1e08fd9a989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84179d09f779486988ed3b2e029192ee'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:37.501039 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8a7bb956-e443-4266-a510-d1e08fd9a989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84179d09f779486988ed3b2e029192ee'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:37.501675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8a7bb956-e443-4266-a510-d1e08fd9a989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84179d09f779486988ed3b2e029192ee'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:37.513837 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8a7bb956-e443-4266-a510-d1e08fd9a989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84179d09f779486988ed3b2e029192ee'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:37.520695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8a7bb956-e443-4266-a510-d1e08fd9a989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84179d09f779486988ed3b2e029192ee'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:37.526983 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1211/2416] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:39:37 2022] DELETE /identity/v3/users/84179d09f779486988ed3b2e029192ee => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:37.531428 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49ba6f-e7ef-4fd6-b8e5-bc642b252765 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:37.531913 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49ba6f-e7ef-4fd6-b8e5-bc642b252765 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:37.532030 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49ba6f-e7ef-4fd6-b8e5-bc642b252765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:37.551238 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-5e49ba6f-e7ef-4fd6-b8e5-bc642b252765 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:37.552433 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5e49ba6f-e7ef-4fd6-b8e5-bc642b252765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:37.609232 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1206/2417] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:37.618811 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bb956-e443-4266-a510-d1e08fd9a989 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:37.620208 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8a7bb956-e443-4266-a510-d1e08fd9a989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:37.676607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bb956-e443-4266-a510-d1e08fd9a989 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:37.680306 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d124ee-7424-4baf-bfc6-eb863899df30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:37.680910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d124ee-7424-4baf-bfc6-eb863899df30 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:37.681230 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d124ee-7424-4baf-bfc6-eb863899df30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:37.681510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d124ee-7424-4baf-bfc6-eb863899df30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:37.690422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d124ee-7424-4baf-bfc6-eb863899df30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:37.691885 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d124ee-7424-4baf-bfc6-eb863899df30 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:37.701226 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1212/2418] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:39:37.970760 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49ba6f-e7ef-4fd6-b8e5-bc642b252765 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:37.972958 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5e49ba6f-e7ef-4fd6-b8e5-bc642b252765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:37.987313 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49ba6f-e7ef-4fd6-b8e5-bc642b252765 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:37.992025 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80002127-ebe9-4a2e-8685-05eef764ed78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:37.992866 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80002127-ebe9-4a2e-8685-05eef764ed78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:37.993278 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80002127-ebe9-4a2e-8685-05eef764ed78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:37.993619 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80002127-ebe9-4a2e-8685-05eef764ed78 admin admin] PATH_INFO: `/v3/projects/1bf87ddc182e4ec9898be41860f3c8fc` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:37.994744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80002127-ebe9-4a2e-8685-05eef764ed78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bf87ddc182e4ec9898be41860f3c8fc)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:37.996653 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80002127-ebe9-4a2e-8685-05eef764ed78 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:38.037726 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:38.044747 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-80002127-ebe9-4a2e-8685-05eef764ed78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bf87ddc182e4ec9898be41860f3c8fc', 'request_id': 'req-80002127-ebe9-4a2e-8685-05eef764ed78'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:38.050649 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-80002127-ebe9-4a2e-8685-05eef764ed78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bf87ddc182e4ec9898be41860f3c8fc', 'request_id': 'req-80002127-ebe9-4a2e-8685-05eef764ed78'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:38.056686 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-80002127-ebe9-4a2e-8685-05eef764ed78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bf87ddc182e4ec9898be41860f3c8fc', 'request_id': 'req-80002127-ebe9-4a2e-8685-05eef764ed78'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:38.072140 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-80002127-ebe9-4a2e-8685-05eef764ed78 admin admin] The token cache is being invalidate because project 1bf87ddc182e4ec9898be41860f3c8fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:39:38.072923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-80002127-ebe9-4a2e-8685-05eef764ed78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:38.073575 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-80002127-ebe9-4a2e-8685-05eef764ed78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:38.075051 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1207/2419] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:39:37 2022] DELETE /identity/v3/projects/1bf87ddc182e4ec9898be41860f3c8fc => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:38.079928 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009254fb-5b26-402c-b2eb-3da556b3850f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:38.080215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009254fb-5b26-402c-b2eb-3da556b3850f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:38.080495 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009254fb-5b26-402c-b2eb-3da556b3850f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:38.099990 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-009254fb-5b26-402c-b2eb-3da556b3850f None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:38.101206 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-009254fb-5b26-402c-b2eb-3da556b3850f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:38.118671 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:38.159519 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1213/2420] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:38.167144 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c1a56-ceaf-46f2-810f-a04ae863ab77 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:38.167428 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c1a56-ceaf-46f2-810f-a04ae863ab77 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:38.167704 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c1a56-ceaf-46f2-810f-a04ae863ab77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:38.187153 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-cc3c1a56-ceaf-46f2-810f-a04ae863ab77 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:38.188336 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-cc3c1a56-ceaf-46f2-810f-a04ae863ab77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:38.196283 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1208/2421] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:38.200713 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009254fb-5b26-402c-b2eb-3da556b3850f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:38.210144 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009254fb-5b26-402c-b2eb-3da556b3850f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:38.215519 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b36e4-24a6-402c-a734-da29aa12cf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:38.216056 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b36e4-24a6-402c-a734-da29aa12cf13 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:38.216333 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b36e4-24a6-402c-a734-da29aa12cf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:38.216601 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b36e4-24a6-402c-a734-da29aa12cf13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:38.217280 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b36e4-24a6-402c-a734-da29aa12cf13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:39:38.217581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b36e4-24a6-402c-a734-da29aa12cf13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:38.219145 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b36e4-24a6-402c-a734-da29aa12cf13 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:38.233204 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1214/2422] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:39:38.234764 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c1a56-ceaf-46f2-810f-a04ae863ab77 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:38.243777 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c1a56-ceaf-46f2-810f-a04ae863ab77 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:38.248817 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8a8d7-cc8f-4e68-a910-2b614745eae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:38.249441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8a8d7-cc8f-4e68-a910-2b614745eae3 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:38.249724 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8a8d7-cc8f-4e68-a910-2b614745eae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:38.249999 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8a8d7-cc8f-4e68-a910-2b614745eae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:38.250629 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8a8d7-cc8f-4e68-a910-2b614745eae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:38.252503 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8a8d7-cc8f-4e68-a910-2b614745eae3 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:38.281457 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1209/2423] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:39:38 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:39:38.285661 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b36e4-24a6-402c-a734-da29aa12cf13 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:38.296103 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b36e4-24a6-402c-a734-da29aa12cf13 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:38.355451 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee45e3-9fba-4b38-b6e1-6de46bd30d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:38.356062 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee45e3-9fba-4b38-b6e1-6de46bd30d49 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:38.356341 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee45e3-9fba-4b38-b6e1-6de46bd30d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:38.356608 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee45e3-9fba-4b38-b6e1-6de46bd30d49 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:38.357271 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee45e3-9fba-4b38-b6e1-6de46bd30d49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:38.359186 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee45e3-9fba-4b38-b6e1-6de46bd30d49 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:38.383447 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1215/2424] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:39:38 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:39:38.387821 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8a8d7-cc8f-4e68-a910-2b614745eae3 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:38.398107 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8a8d7-cc8f-4e68-a910-2b614745eae3 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:38.402780 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239a239-55b7-4ebd-94ef-f6e8394718f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:38.403352 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239a239-55b7-4ebd-94ef-f6e8394718f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:38.403631 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239a239-55b7-4ebd-94ef-f6e8394718f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:38.403898 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239a239-55b7-4ebd-94ef-f6e8394718f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:38.404532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239a239-55b7-4ebd-94ef-f6e8394718f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:38.406132 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239a239-55b7-4ebd-94ef-f6e8394718f0 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:38.415788 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1210/2425] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:38.420037 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee45e3-9fba-4b38-b6e1-6de46bd30d49 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:38.429818 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee45e3-9fba-4b38-b6e1-6de46bd30d49 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:38.434940 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10eae98-28df-4b56-bbd7-8201d5bd4c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:38.435522 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10eae98-28df-4b56-bbd7-8201d5bd4c20 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:38.435800 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10eae98-28df-4b56-bbd7-8201d5bd4c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:38.436070 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10eae98-28df-4b56-bbd7-8201d5bd4c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:38.436701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10eae98-28df-4b56-bbd7-8201d5bd4c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:38.438302 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10eae98-28df-4b56-bbd7-8201d5bd4c20 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:38.449160 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1216/2426] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:38.453126 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239a239-55b7-4ebd-94ef-f6e8394718f0 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:38.462772 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239a239-55b7-4ebd-94ef-f6e8394718f0 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:38.467428 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56537d7c-f77a-42e1-a45c-43f2632fa898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:38.467997 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56537d7c-f77a-42e1-a45c-43f2632fa898 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:38.468275 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56537d7c-f77a-42e1-a45c-43f2632fa898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:38.468547 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56537d7c-f77a-42e1-a45c-43f2632fa898 admin admin] PATH_INFO: `/v3/projects/af34d3cf2a194521b33cb16d843a3b73/users/87791202207a47229db395db9cb78f86/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:38.483804 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56537d7c-f77a-42e1-a45c-43f2632fa898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af34d3cf2a194521b33cb16d843a3b73, user_id=87791202207a47229db395db9cb78f86, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:38.486443 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56537d7c-f77a-42e1-a45c-43f2632fa898 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:38.498991 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1211/2427] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:39:38 2022] PUT /identity/v3/projects/af34d3cf2a194521b33cb16d843a3b73/users/87791202207a47229db395db9cb78f86/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:38.510758 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afff30-34ef-43df-90ed-356d978ddd47 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:38.511042 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afff30-34ef-43df-90ed-356d978ddd47 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:38.511318 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afff30-34ef-43df-90ed-356d978ddd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:38.538202 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e5afff30-34ef-43df-90ed-356d978ddd47 None None] MFA Rules not processed for user `87791202207a47229db395db9cb78f86`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:38.539421 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e5afff30-34ef-43df-90ed-356d978ddd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:38.602835 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1217/2428] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:38.607769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56537d7c-f77a-42e1-a45c-43f2632fa898 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:38.668027 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56537d7c-f77a-42e1-a45c-43f2632fa898 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:38.673016 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da17e4b-2f4b-4374-b0b8-dea4085d71f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:38.673650 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da17e4b-2f4b-4374-b0b8-dea4085d71f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:38.673928 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da17e4b-2f4b-4374-b0b8-dea4085d71f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:38.674219 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da17e4b-2f4b-4374-b0b8-dea4085d71f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:38.674865 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da17e4b-2f4b-4374-b0b8-dea4085d71f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:38.676781 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da17e4b-2f4b-4374-b0b8-dea4085d71f7 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:38.702551 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1212/2429] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:39:38 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:39:38.706485 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afff30-34ef-43df-90ed-356d978ddd47 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:38.716989 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afff30-34ef-43df-90ed-356d978ddd47 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:38.733431 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:38.772986 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d8e24-9d9c-4463-ba0d-0f908a7eeb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:38.773619 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d8e24-9d9c-4463-ba0d-0f908a7eeb10 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:38.773898 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d8e24-9d9c-4463-ba0d-0f908a7eeb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:38.774183 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d8e24-9d9c-4463-ba0d-0f908a7eeb10 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:38.774807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d8e24-9d9c-4463-ba0d-0f908a7eeb10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:38.776684 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d8e24-9d9c-4463-ba0d-0f908a7eeb10 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:38.797350 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1218/2430] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:39:38 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:39:38.801427 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da17e4b-2f4b-4374-b0b8-dea4085d71f7 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:38.812069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da17e4b-2f4b-4374-b0b8-dea4085d71f7 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:38.816849 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b776e31-8667-4b7c-b67c-40605fbd5ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:38.817542 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b776e31-8667-4b7c-b67c-40605fbd5ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:38.817824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b776e31-8667-4b7c-b67c-40605fbd5ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:38.818099 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b776e31-8667-4b7c-b67c-40605fbd5ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:38.818769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b776e31-8667-4b7c-b67c-40605fbd5ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:38.820353 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b776e31-8667-4b7c-b67c-40605fbd5ea7 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:38.830855 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1213/2431] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:38.834572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d8e24-9d9c-4463-ba0d-0f908a7eeb10 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:38.844756 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d8e24-9d9c-4463-ba0d-0f908a7eeb10 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:38.849387 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96086551-bec4-4687-b7d6-2e0b3ecf93b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:38.849983 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96086551-bec4-4687-b7d6-2e0b3ecf93b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:38.850265 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96086551-bec4-4687-b7d6-2e0b3ecf93b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:38.850569 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96086551-bec4-4687-b7d6-2e0b3ecf93b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:38.851584 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96086551-bec4-4687-b7d6-2e0b3ecf93b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:38.852780 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96086551-bec4-4687-b7d6-2e0b3ecf93b5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:38.863160 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1219/2432] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:39:38.867180 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b776e31-8667-4b7c-b67c-40605fbd5ea7 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:38.878321 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b776e31-8667-4b7c-b67c-40605fbd5ea7 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:38.883418 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a3fab-eb1c-46c9-8d84-3d3fb5e42651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:38.884086 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a3fab-eb1c-46c9-8d84-3d3fb5e42651 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:38.884365 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a3fab-eb1c-46c9-8d84-3d3fb5e42651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:38.884639 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a3fab-eb1c-46c9-8d84-3d3fb5e42651 admin admin] PATH_INFO: `/v3/projects/5db093a9edaa4cde8ee86dd637c02f8d/users/be3e67fb20d34b07b569b56319ee8637/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:38.898944 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a3fab-eb1c-46c9-8d84-3d3fb5e42651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db093a9edaa4cde8ee86dd637c02f8d, user_id=be3e67fb20d34b07b569b56319ee8637, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:38.901598 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a3fab-eb1c-46c9-8d84-3d3fb5e42651 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:38.913641 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1214/2433] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:39:38 2022] PUT /identity/v3/projects/5db093a9edaa4cde8ee86dd637c02f8d/users/be3e67fb20d34b07b569b56319ee8637/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:38.924548 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfac6a5-1ef4-49e4-8d28-879ce3d13aba None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:38.924839 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfac6a5-1ef4-49e4-8d28-879ce3d13aba None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:38.925134 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfac6a5-1ef4-49e4-8d28-879ce3d13aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:38.952572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-cbfac6a5-1ef4-49e4-8d28-879ce3d13aba None None] MFA Rules not processed for user `be3e67fb20d34b07b569b56319ee8637`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:38.953795 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cbfac6a5-1ef4-49e4-8d28-879ce3d13aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:39.017819 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1220/2434] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:39:39.022136 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a3fab-eb1c-46c9-8d84-3d3fb5e42651 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:39.039866 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:39.091933 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a3fab-eb1c-46c9-8d84-3d3fb5e42651 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:39.096666 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8acb32-adbe-4af8-9627-0f10953c2773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:39.097305 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8acb32-adbe-4af8-9627-0f10953c2773 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:39.097587 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8acb32-adbe-4af8-9627-0f10953c2773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:39.097860 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8acb32-adbe-4af8-9627-0f10953c2773 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:39.098503 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8acb32-adbe-4af8-9627-0f10953c2773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:39.100435 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8acb32-adbe-4af8-9627-0f10953c2773 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:39.127049 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1215/2435] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:39:39 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:39:39.130859 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfac6a5-1ef4-49e4-8d28-879ce3d13aba None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:39.141317 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfac6a5-1ef4-49e4-8d28-879ce3d13aba None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:39.196676 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189879a1-0da4-48c3-bccd-b57bf6eb3afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:39.197314 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189879a1-0da4-48c3-bccd-b57bf6eb3afe admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:39.197620 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189879a1-0da4-48c3-bccd-b57bf6eb3afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:39.197893 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189879a1-0da4-48c3-bccd-b57bf6eb3afe admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:39.198525 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189879a1-0da4-48c3-bccd-b57bf6eb3afe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:39.200412 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189879a1-0da4-48c3-bccd-b57bf6eb3afe admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:39.221476 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1221/2436] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:39:39 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:39:39.225430 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8acb32-adbe-4af8-9627-0f10953c2773 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:39.236150 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8acb32-adbe-4af8-9627-0f10953c2773 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:39.240921 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa41110-b391-49e5-b311-cb2c3b48c702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:39.241559 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa41110-b391-49e5-b311-cb2c3b48c702 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:39.241860 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa41110-b391-49e5-b311-cb2c3b48c702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:39.242131 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa41110-b391-49e5-b311-cb2c3b48c702 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:39.242773 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa41110-b391-49e5-b311-cb2c3b48c702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:39.244379 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa41110-b391-49e5-b311-cb2c3b48c702 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:39.254741 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1216/2437] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:39.258731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189879a1-0da4-48c3-bccd-b57bf6eb3afe admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:39.268587 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189879a1-0da4-48c3-bccd-b57bf6eb3afe admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:39.273192 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fb9a3-9d1d-4637-a37a-e5ed67b62b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:39.273836 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fb9a3-9d1d-4637-a37a-e5ed67b62b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:39.274115 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fb9a3-9d1d-4637-a37a-e5ed67b62b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:39.274448 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fb9a3-9d1d-4637-a37a-e5ed67b62b36 admin admin] PATH_INFO: `/v3/projects/f6e1fc0eb6f44a879689c9133c58c198/users/96882d1826884b95bac46b9856f91e7a/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:39.289555 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508fb9a3-9d1d-4637-a37a-e5ed67b62b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e1fc0eb6f44a879689c9133c58c198, user_id=96882d1826884b95bac46b9856f91e7a, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:39.292995 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508fb9a3-9d1d-4637-a37a-e5ed67b62b36 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:39.295402 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:39.306689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1222/2438] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:39:39 2022] PUT /identity/v3/projects/f6e1fc0eb6f44a879689c9133c58c198/users/96882d1826884b95bac46b9856f91e7a/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:39.310515 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa41110-b391-49e5-b311-cb2c3b48c702 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:39.320326 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa41110-b391-49e5-b311-cb2c3b48c702 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:39.375490 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc0960-d11c-424c-a535-749e792c2a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:39.376090 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc0960-d11c-424c-a535-749e792c2a95 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:39.376384 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc0960-d11c-424c-a535-749e792c2a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:39.376683 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc0960-d11c-424c-a535-749e792c2a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:39.377403 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc0960-d11c-424c-a535-749e792c2a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:39.379019 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc0960-d11c-424c-a535-749e792c2a95 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:39.389385 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1217/2439] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:39.393483 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fb9a3-9d1d-4637-a37a-e5ed67b62b36 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:39.403935 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fb9a3-9d1d-4637-a37a-e5ed67b62b36 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:39.408394 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123a75f-9f1e-43d2-8de6-1788fbe30c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:39.409047 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123a75f-9f1e-43d2-8de6-1788fbe30c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:39.409364 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123a75f-9f1e-43d2-8de6-1788fbe30c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:39.409635 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123a75f-9f1e-43d2-8de6-1788fbe30c02 admin admin] PATH_INFO: `/v3/projects/f6e1fc0eb6f44a879689c9133c58c198/users/96882d1826884b95bac46b9856f91e7a/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:39.411651 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123a75f-9f1e-43d2-8de6-1788fbe30c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e1fc0eb6f44a879689c9133c58c198, user_id=96882d1826884b95bac46b9856f91e7a, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:39.414411 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123a75f-9f1e-43d2-8de6-1788fbe30c02 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:39.425757 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1223/2440] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:39:39 2022] PUT /identity/v3/projects/f6e1fc0eb6f44a879689c9133c58c198/users/96882d1826884b95bac46b9856f91e7a/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:39.437585 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a370b-7794-4291-879e-069fb34f47c1 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:39.437879 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a370b-7794-4291-879e-069fb34f47c1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:39.438161 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a370b-7794-4291-879e-069fb34f47c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:39.466046 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e33a370b-7794-4291-879e-069fb34f47c1 None None] MFA Rules not processed for user `96882d1826884b95bac46b9856f91e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:39.467280 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e33a370b-7794-4291-879e-069fb34f47c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:39.539391 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1218/2441] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:39.551901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123a75f-9f1e-43d2-8de6-1788fbe30c02 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:39.553638 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6123a75f-9f1e-43d2-8de6-1788fbe30c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:39.610716 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123a75f-9f1e-43d2-8de6-1788fbe30c02 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:39.614350 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d0460-cd2b-4a2e-9849-17fdb2b82e1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:39.614943 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d0460-cd2b-4a2e-9849-17fdb2b82e1e service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:39.615220 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d0460-cd2b-4a2e-9849-17fdb2b82e1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:39.615490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d0460-cd2b-4a2e-9849-17fdb2b82e1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:39.669496 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d0460-cd2b-4a2e-9849-17fdb2b82e1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:39.670985 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d0460-cd2b-4a2e-9849-17fdb2b82e1e service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:39.679563 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1224/2442] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:39:41.162522 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a370b-7794-4291-879e-069fb34f47c1 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:41.163891 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e33a370b-7794-4291-879e-069fb34f47c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:41.176229 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a370b-7794-4291-879e-069fb34f47c1 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:41.179659 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea329e15-e07d-4eac-a386-93d67d3ea3b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:41.180247 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea329e15-e07d-4eac-a386-93d67d3ea3b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:41.180522 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea329e15-e07d-4eac-a386-93d67d3ea3b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:41.180792 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea329e15-e07d-4eac-a386-93d67d3ea3b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:41.189668 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:41.239086 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea329e15-e07d-4eac-a386-93d67d3ea3b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:41.240448 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea329e15-e07d-4eac-a386-93d67d3ea3b4 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:41.249161 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1219/2443] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:39:41.757925 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d0460-cd2b-4a2e-9849-17fdb2b82e1e service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:41.766974 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d0460-cd2b-4a2e-9849-17fdb2b82e1e service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:41.770631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433d9d5-969f-4591-b04f-d5ef4de3809e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:41.771232 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433d9d5-969f-4591-b04f-d5ef4de3809e service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:41.771512 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433d9d5-969f-4591-b04f-d5ef4de3809e service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:41.771784 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433d9d5-969f-4591-b04f-d5ef4de3809e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:41.781334 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1433d9d5-969f-4591-b04f-d5ef4de3809e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:41.782746 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1433d9d5-969f-4591-b04f-d5ef4de3809e service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:41.792424 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1225/2444] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:39:45.704485 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea329e15-e07d-4eac-a386-93d67d3ea3b4 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:45.769207 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea329e15-e07d-4eac-a386-93d67d3ea3b4 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:45.773767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9662a4-e7d2-426a-84c5-da0f94db9ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:45.774396 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9662a4-e7d2-426a-84c5-da0f94db9ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:45.774676 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9662a4-e7d2-426a-84c5-da0f94db9ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:45.774950 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9662a4-e7d2-426a-84c5-da0f94db9ff8 admin admin] PATH_INFO: `/v3/users/87791202207a47229db395db9cb78f86` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:45.776063 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9662a4-e7d2-426a-84c5-da0f94db9ff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87791202207a47229db395db9cb78f86)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:45.778014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9662a4-e7d2-426a-84c5-da0f94db9ff8 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:45.828215 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ce9662a4-e7d2-426a-84c5-da0f94db9ff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87791202207a47229db395db9cb78f86'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:45.828963 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ce9662a4-e7d2-426a-84c5-da0f94db9ff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87791202207a47229db395db9cb78f86'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:45.829592 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ce9662a4-e7d2-426a-84c5-da0f94db9ff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87791202207a47229db395db9cb78f86'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:45.836713 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ce9662a4-e7d2-426a-84c5-da0f94db9ff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87791202207a47229db395db9cb78f86'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:45.844605 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ce9662a4-e7d2-426a-84c5-da0f94db9ff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87791202207a47229db395db9cb78f86'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:45.867287 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1220/2445] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:39:45 2022] DELETE /identity/v3/users/87791202207a47229db395db9cb78f86 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:45.872657 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea1dcb-0384-43c5-adf8-fd948a9752fd None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:45.877619 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea1dcb-0384-43c5-adf8-fd948a9752fd None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:45.877619 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea1dcb-0384-43c5-adf8-fd948a9752fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:45.893935 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-43ea1dcb-0384-43c5-adf8-fd948a9752fd None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:45.895065 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-43ea1dcb-0384-43c5-adf8-fd948a9752fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:45.953753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1226/2446] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:39:45.963414 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9662a4-e7d2-426a-84c5-da0f94db9ff8 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:45.964839 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ce9662a4-e7d2-426a-84c5-da0f94db9ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:45.998580 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:46.025645 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9662a4-e7d2-426a-84c5-da0f94db9ff8 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:46.029271 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23a5a9-7916-4100-8f6d-21dbcee2200a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:46.029888 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23a5a9-7916-4100-8f6d-21dbcee2200a service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:46.030204 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23a5a9-7916-4100-8f6d-21dbcee2200a service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:46.030482 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23a5a9-7916-4100-8f6d-21dbcee2200a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:46.039415 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23a5a9-7916-4100-8f6d-21dbcee2200a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:46.040871 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23a5a9-7916-4100-8f6d-21dbcee2200a service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:46.050407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1221/2447] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:39:46.312889 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea1dcb-0384-43c5-adf8-fd948a9752fd None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:46.314358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-43ea1dcb-0384-43c5-adf8-fd948a9752fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:46.327317 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea1dcb-0384-43c5-adf8-fd948a9752fd None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:46.332917 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e40fe6-4f5e-4753-a6f0-8cd7c7624c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:46.333600 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40fe6-4f5e-4753-a6f0-8cd7c7624c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:46.333905 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40fe6-4f5e-4753-a6f0-8cd7c7624c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:46.334177 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40fe6-4f5e-4753-a6f0-8cd7c7624c97 admin admin] PATH_INFO: `/v3/projects/af34d3cf2a194521b33cb16d843a3b73` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:46.335425 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e40fe6-4f5e-4753-a6f0-8cd7c7624c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af34d3cf2a194521b33cb16d843a3b73)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:46.337597 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e40fe6-4f5e-4753-a6f0-8cd7c7624c97 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:46.355464 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:46.387615 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b2e40fe6-4f5e-4753-a6f0-8cd7c7624c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af34d3cf2a194521b33cb16d843a3b73', 'request_id': 'req-b2e40fe6-4f5e-4753-a6f0-8cd7c7624c97'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:46.394710 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b2e40fe6-4f5e-4753-a6f0-8cd7c7624c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af34d3cf2a194521b33cb16d843a3b73', 'request_id': 'req-b2e40fe6-4f5e-4753-a6f0-8cd7c7624c97'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:46.400485 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b2e40fe6-4f5e-4753-a6f0-8cd7c7624c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af34d3cf2a194521b33cb16d843a3b73', 'request_id': 'req-b2e40fe6-4f5e-4753-a6f0-8cd7c7624c97'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:46.411371 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b2e40fe6-4f5e-4753-a6f0-8cd7c7624c97 admin admin] The token cache is being invalidate because project af34d3cf2a194521b33cb16d843a3b73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:39:46.411660 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b2e40fe6-4f5e-4753-a6f0-8cd7c7624c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:46.412287 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b2e40fe6-4f5e-4753-a6f0-8cd7c7624c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:46.413795 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1227/2448] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:39:46 2022] DELETE /identity/v3/projects/af34d3cf2a194521b33cb16d843a3b73 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:46.418359 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23a5a9-7916-4100-8f6d-21dbcee2200a service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:46.428152 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23a5a9-7916-4100-8f6d-21dbcee2200a service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:46.483642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be78616-bb14-4bae-ab95-6df124b4db91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:46.484193 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be78616-bb14-4bae-ab95-6df124b4db91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:46.484471 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be78616-bb14-4bae-ab95-6df124b4db91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:46.484760 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be78616-bb14-4bae-ab95-6df124b4db91 admin admin] PATH_INFO: `/v3/users/be3e67fb20d34b07b569b56319ee8637` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:46.485861 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be78616-bb14-4bae-ab95-6df124b4db91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be3e67fb20d34b07b569b56319ee8637)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:46.487982 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be78616-bb14-4bae-ab95-6df124b4db91 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:46.531502 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-2be78616-bb14-4bae-ab95-6df124b4db91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be3e67fb20d34b07b569b56319ee8637'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:46.532111 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-2be78616-bb14-4bae-ab95-6df124b4db91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be3e67fb20d34b07b569b56319ee8637'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:46.532698 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-2be78616-bb14-4bae-ab95-6df124b4db91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be3e67fb20d34b07b569b56319ee8637'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:46.539440 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-2be78616-bb14-4bae-ab95-6df124b4db91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be3e67fb20d34b07b569b56319ee8637'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:46.547874 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-2be78616-bb14-4bae-ab95-6df124b4db91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be3e67fb20d34b07b569b56319ee8637'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:46.564473 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1222/2449] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:39:46 2022] DELETE /identity/v3/users/be3e67fb20d34b07b569b56319ee8637 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:46.834032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e40fe6-4f5e-4753-a6f0-8cd7c7624c97 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:46.835460 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b2e40fe6-4f5e-4753-a6f0-8cd7c7624c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:46.850064 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e40fe6-4f5e-4753-a6f0-8cd7c7624c97 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:46.907971 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78069c9b-2fcb-4c32-8725-d642992d7790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:46.908591 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78069c9b-2fcb-4c32-8725-d642992d7790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:46.908869 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78069c9b-2fcb-4c32-8725-d642992d7790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:46.910395 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78069c9b-2fcb-4c32-8725-d642992d7790 admin admin] PATH_INFO: `/v3/projects/5db093a9edaa4cde8ee86dd637c02f8d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:46.910395 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78069c9b-2fcb-4c32-8725-d642992d7790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db093a9edaa4cde8ee86dd637c02f8d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:46.912195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78069c9b-2fcb-4c32-8725-d642992d7790 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:46.958862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-78069c9b-2fcb-4c32-8725-d642992d7790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db093a9edaa4cde8ee86dd637c02f8d', 'request_id': 'req-78069c9b-2fcb-4c32-8725-d642992d7790'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:46.966180 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-78069c9b-2fcb-4c32-8725-d642992d7790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db093a9edaa4cde8ee86dd637c02f8d', 'request_id': 'req-78069c9b-2fcb-4c32-8725-d642992d7790'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:46.972500 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-78069c9b-2fcb-4c32-8725-d642992d7790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db093a9edaa4cde8ee86dd637c02f8d', 'request_id': 'req-78069c9b-2fcb-4c32-8725-d642992d7790'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:46.984249 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-78069c9b-2fcb-4c32-8725-d642992d7790 admin admin] The token cache is being invalidate because project 5db093a9edaa4cde8ee86dd637c02f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:39:46.984541 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-78069c9b-2fcb-4c32-8725-d642992d7790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:46.985223 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-78069c9b-2fcb-4c32-8725-d642992d7790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:46.986709 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1228/2450] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:39:46 2022] DELETE /identity/v3/projects/5db093a9edaa4cde8ee86dd637c02f8d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:46.991028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be78616-bb14-4bae-ab95-6df124b4db91 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:46.992555 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2be78616-bb14-4bae-ab95-6df124b4db91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:47.006784 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be78616-bb14-4bae-ab95-6df124b4db91 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:47.055253 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:47.067861 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0c8ae-3b42-4f32-a61e-50afb93645ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:47.068543 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0c8ae-3b42-4f32-a61e-50afb93645ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:47.069031 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0c8ae-3b42-4f32-a61e-50afb93645ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:47.069550 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0c8ae-3b42-4f32-a61e-50afb93645ea admin admin] PATH_INFO: `/v3/users/96882d1826884b95bac46b9856f91e7a` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:47.070886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0c8ae-3b42-4f32-a61e-50afb93645ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=96882d1826884b95bac46b9856f91e7a)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:47.072907 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0c8ae-3b42-4f32-a61e-50afb93645ea admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:47.118551 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-98f0c8ae-3b42-4f32-a61e-50afb93645ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96882d1826884b95bac46b9856f91e7a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:47.119805 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-98f0c8ae-3b42-4f32-a61e-50afb93645ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96882d1826884b95bac46b9856f91e7a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:47.120453 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-98f0c8ae-3b42-4f32-a61e-50afb93645ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96882d1826884b95bac46b9856f91e7a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:47.127264 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-98f0c8ae-3b42-4f32-a61e-50afb93645ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96882d1826884b95bac46b9856f91e7a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:47.134506 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-98f0c8ae-3b42-4f32-a61e-50afb93645ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96882d1826884b95bac46b9856f91e7a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:47.151527 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1223/2451] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:39:46 2022] DELETE /identity/v3/users/96882d1826884b95bac46b9856f91e7a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:47.424264 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78069c9b-2fcb-4c32-8725-d642992d7790 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:47.425700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-78069c9b-2fcb-4c32-8725-d642992d7790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:47.442350 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78069c9b-2fcb-4c32-8725-d642992d7790 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:47.475173 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:47.501149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84261ce2-6b16-4939-aada-5de76f86d867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:47.501775 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84261ce2-6b16-4939-aada-5de76f86d867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:47.502057 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84261ce2-6b16-4939-aada-5de76f86d867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:47.502332 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84261ce2-6b16-4939-aada-5de76f86d867 admin admin] PATH_INFO: `/v3/projects/f6e1fc0eb6f44a879689c9133c58c198` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:47.503441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84261ce2-6b16-4939-aada-5de76f86d867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6e1fc0eb6f44a879689c9133c58c198)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:47.505360 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84261ce2-6b16-4939-aada-5de76f86d867 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:47.551978 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-84261ce2-6b16-4939-aada-5de76f86d867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6e1fc0eb6f44a879689c9133c58c198', 'request_id': 'req-84261ce2-6b16-4939-aada-5de76f86d867'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:47.558929 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-84261ce2-6b16-4939-aada-5de76f86d867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6e1fc0eb6f44a879689c9133c58c198', 'request_id': 'req-84261ce2-6b16-4939-aada-5de76f86d867'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:47.564390 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-84261ce2-6b16-4939-aada-5de76f86d867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6e1fc0eb6f44a879689c9133c58c198', 'request_id': 'req-84261ce2-6b16-4939-aada-5de76f86d867'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:47.575140 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-84261ce2-6b16-4939-aada-5de76f86d867 admin admin] The token cache is being invalidate because project f6e1fc0eb6f44a879689c9133c58c198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:39:47.575414 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-84261ce2-6b16-4939-aada-5de76f86d867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:47.576042 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-84261ce2-6b16-4939-aada-5de76f86d867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:39:47.577520 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1229/2452] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:39:47 2022] DELETE /identity/v3/projects/f6e1fc0eb6f44a879689c9133c58c198 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:47.582387 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21ee6a-f863-4517-ae3c-c3116e0cbf1b None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:47.582683 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21ee6a-f863-4517-ae3c-c3116e0cbf1b None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:47.582984 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21ee6a-f863-4517-ae3c-c3116e0cbf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:47.602944 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-5b21ee6a-f863-4517-ae3c-c3116e0cbf1b None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:47.604751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-5b21ee6a-f863-4517-ae3c-c3116e0cbf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:47.662415 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1224/2453] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:47.670601 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f943d-03d0-428d-b946-14ffc117ce0c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:47.670967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f943d-03d0-428d-b946-14ffc117ce0c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:47.671308 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f943d-03d0-428d-b946-14ffc117ce0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:47.690440 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5d8f943d-03d0-428d-b946-14ffc117ce0c None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:47.691627 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5d8f943d-03d0-428d-b946-14ffc117ce0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:47.700173 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1230/2454] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:47.704154 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21ee6a-f863-4517-ae3c-c3116e0cbf1b None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:47.714351 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21ee6a-f863-4517-ae3c-c3116e0cbf1b None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:47.718930 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57e418-2205-46b9-a8a1-67e596a13632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:47.719518 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57e418-2205-46b9-a8a1-67e596a13632 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:47.719800 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57e418-2205-46b9-a8a1-67e596a13632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:47.720083 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57e418-2205-46b9-a8a1-67e596a13632 admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:47.720731 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57e418-2205-46b9-a8a1-67e596a13632 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:39:47.721030 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57e418-2205-46b9-a8a1-67e596a13632 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:47.722644 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57e418-2205-46b9-a8a1-67e596a13632 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:47.734229 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1225/2455] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:39:47.738242 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f943d-03d0-428d-b946-14ffc117ce0c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:47.747253 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f943d-03d0-428d-b946-14ffc117ce0c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:47.751837 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ce003-ad16-4afd-8c69-e801a5433e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:47.752418 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ce003-ad16-4afd-8c69-e801a5433e60 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:47.752695 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ce003-ad16-4afd-8c69-e801a5433e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:47.752963 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ce003-ad16-4afd-8c69-e801a5433e60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:47.753624 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ce003-ad16-4afd-8c69-e801a5433e60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:47.755508 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ce003-ad16-4afd-8c69-e801a5433e60 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:47.782196 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1231/2456] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:39:47 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:39:47.786440 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57e418-2205-46b9-a8a1-67e596a13632 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:47.796663 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57e418-2205-46b9-a8a1-67e596a13632 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:47.845550 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:47.851856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e8d24-2aa5-48d1-b3e4-46d5c50be7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:47.852742 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e8d24-2aa5-48d1-b3e4-46d5c50be7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:47.853030 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e8d24-2aa5-48d1-b3e4-46d5c50be7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:47.853387 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e8d24-2aa5-48d1-b3e4-46d5c50be7d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:47.854059 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e8d24-2aa5-48d1-b3e4-46d5c50be7d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:47.856397 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e8d24-2aa5-48d1-b3e4-46d5c50be7d9 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:47.876407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1226/2457] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:39:47 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:39:47.881030 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ce003-ad16-4afd-8c69-e801a5433e60 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:47.892594 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ce003-ad16-4afd-8c69-e801a5433e60 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:47.897407 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abab6b-7fe2-4e23-b432-1b1267cc9ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:47.898005 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abab6b-7fe2-4e23-b432-1b1267cc9ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:47.898281 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abab6b-7fe2-4e23-b432-1b1267cc9ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:47.898550 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abab6b-7fe2-4e23-b432-1b1267cc9ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:47.899184 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abab6b-7fe2-4e23-b432-1b1267cc9ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:47.901438 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abab6b-7fe2-4e23-b432-1b1267cc9ff1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:47.911162 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1232/2458] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:47.914941 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e8d24-2aa5-48d1-b3e4-46d5c50be7d9 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:47.925169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e8d24-2aa5-48d1-b3e4-46d5c50be7d9 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:47.929774 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed12d9-b81b-42b2-a97e-970ea1ab4bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:47.930388 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed12d9-b81b-42b2-a97e-970ea1ab4bdd admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:47.930668 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed12d9-b81b-42b2-a97e-970ea1ab4bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:47.930938 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed12d9-b81b-42b2-a97e-970ea1ab4bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:47.931592 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed12d9-b81b-42b2-a97e-970ea1ab4bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:47.933195 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed12d9-b81b-42b2-a97e-970ea1ab4bdd admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:47.943536 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1227/2459] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:39:47.948092 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abab6b-7fe2-4e23-b432-1b1267cc9ff1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:47.957884 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abab6b-7fe2-4e23-b432-1b1267cc9ff1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:47.962490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebf873-45d9-4662-8eec-60751bc1cabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:47.963747 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebf873-45d9-4662-8eec-60751bc1cabe admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:47.964025 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebf873-45d9-4662-8eec-60751bc1cabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:47.964295 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebf873-45d9-4662-8eec-60751bc1cabe admin admin] PATH_INFO: `/v3/projects/f82cae8cc1624d9996dc6ab37ba54731/users/429ad0fa699f41e9bea2a88a6e9ef614/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:47.978388 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebf873-45d9-4662-8eec-60751bc1cabe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f82cae8cc1624d9996dc6ab37ba54731, user_id=429ad0fa699f41e9bea2a88a6e9ef614, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:47.981005 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebf873-45d9-4662-8eec-60751bc1cabe admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:47.993541 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1233/2460] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:39:47 2022] PUT /identity/v3/projects/f82cae8cc1624d9996dc6ab37ba54731/users/429ad0fa699f41e9bea2a88a6e9ef614/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:39:47.999062 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f1f1a-64c8-4313-a40e-d67ef386db89 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:47.999533 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f1f1a-64c8-4313-a40e-d67ef386db89 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:47.999636 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f1f1a-64c8-4313-a40e-d67ef386db89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:48.018603 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e14f1f1a-64c8-4313-a40e-d67ef386db89 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:48.019850 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e14f1f1a-64c8-4313-a40e-d67ef386db89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:48.076825 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1228/2461] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:48.086610 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebf873-45d9-4662-8eec-60751bc1cabe admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:48.088297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-42ebf873-45d9-4662-8eec-60751bc1cabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:48.146763 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebf873-45d9-4662-8eec-60751bc1cabe admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:48.150392 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fb378-68a6-408d-a5ea-c4be8af186f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:48.150995 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fb378-68a6-408d-a5ea-c4be8af186f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:48.151270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fb378-68a6-408d-a5ea-c4be8af186f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:48.151539 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fb378-68a6-408d-a5ea-c4be8af186f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:48.160527 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fb378-68a6-408d-a5ea-c4be8af186f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:48.161958 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fb378-68a6-408d-a5ea-c4be8af186f1 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:48.171707 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1234/2462] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:39:48.803429 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d21f5a-4ec7-443a-8370-c1c2511108f5 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:48.803722 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d21f5a-4ec7-443a-8370-c1c2511108f5 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:48.804001 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d21f5a-4ec7-443a-8370-c1c2511108f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:48.831294 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e4d21f5a-4ec7-443a-8370-c1c2511108f5 None None] MFA Rules not processed for user `429ad0fa699f41e9bea2a88a6e9ef614`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:48.832521 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e4d21f5a-4ec7-443a-8370-c1c2511108f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:48.901751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1229/2463] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:48.912428 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fb378-68a6-408d-a5ea-c4be8af186f1 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:39:48.913910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7e1fb378-68a6-408d-a5ea-c4be8af186f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:48.921182 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:39:48.973628 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fb378-68a6-408d-a5ea-c4be8af186f1 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:39:48.977255 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517e528-1864-4cf8-8407-9cf91e0db9df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:39:48.977888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517e528-1864-4cf8-8407-9cf91e0db9df service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:48.978167 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517e528-1864-4cf8-8407-9cf91e0db9df service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:48.978456 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517e528-1864-4cf8-8407-9cf91e0db9df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:48.987465 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517e528-1864-4cf8-8407-9cf91e0db9df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:39:48.988873 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517e528-1864-4cf8-8407-9cf91e0db9df service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:39:48.997719 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1235/2464] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:39:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:39:50.358368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a7f7e-05b7-4c1c-b7be-2f8ab4cace19 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:39:50.358890 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a7f7e-05b7-4c1c-b7be-2f8ab4cace19 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:39:50.358993 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a7f7e-05b7-4c1c-b7be-2f8ab4cace19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:39:50.377749 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-8f9a7f7e-05b7-4c1c-b7be-2f8ab4cace19 None None] MFA Rules not processed for user `429ad0fa699f41e9bea2a88a6e9ef614`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:39:50.379064 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-8f9a7f7e-05b7-4c1c-b7be-2f8ab4cace19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:39:50.386166 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1230/2465] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:39:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:39:58.993589 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=24 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:40:00.372248 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=70,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:40:03.619857 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a4eb2-3027-49cd-ba00-723bf8c97301 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:40:03.620913 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a4eb2-3027-49cd-ba00-723bf8c97301 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:40:03.621058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a4eb2-3027-49cd-ba00-723bf8c97301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:40:03.639777 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d23a4eb2-3027-49cd-ba00-723bf8c97301 None None] MFA Rules not processed for user `429ad0fa699f41e9bea2a88a6e9ef614`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:40:03.640974 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d23a4eb2-3027-49cd-ba00-723bf8c97301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:40:03.647967 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1236/2466] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:40:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:40:13.634419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:40:18.058526 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa3529-7493-4e76-a49d-152053d12275 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:40:18.059536 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa3529-7493-4e76-a49d-152053d12275 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:40:18.059643 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa3529-7493-4e76-a49d-152053d12275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:40:18.079707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-3caa3529-7493-4e76-a49d-152053d12275 None None] MFA Rules not processed for user `912693f459f147a5a479ad01e2e8387a`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:40:18.080907 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-3caa3529-7493-4e76-a49d-152053d12275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:40:18.133844 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1231/2467] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Oct 31 12:40:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:40:18.178708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a4eb2-3027-49cd-ba00-723bf8c97301 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:40:18.180098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d23a4eb2-3027-49cd-ba00-723bf8c97301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:40:18.248114 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a4eb2-3027-49cd-ba00-723bf8c97301 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:40:18.252935 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126286f-1bfb-422b-9000-ab1cd90c6539 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188c4989dcfb4f99a04c3349e1a882d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:40:18.253574 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126286f-1bfb-422b-9000-ab1cd90c6539 service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:40:18.253851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126286f-1bfb-422b-9000-ab1cd90c6539 service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:40:18.254121 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126286f-1bfb-422b-9000-ab1cd90c6539 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:40:18.261843 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126286f-1bfb-422b-9000-ab1cd90c6539 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:40:18.264010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126286f-1bfb-422b-9000-ab1cd90c6539 service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:40:18.271961 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1237/2468] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 31 12:40:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 12:40:26.553532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573415d-6c7a-48dc-b37b-33d15c3d2a1a None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:40:26.553532 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573415d-6c7a-48dc-b37b-33d15c3d2a1a None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:40:26.554068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573415d-6c7a-48dc-b37b-33d15c3d2a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:40:26.579363 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-2573415d-6c7a-48dc-b37b-33d15c3d2a1a None None] MFA Rules not processed for user `7b207b303fb64275bf26dbb70ee36473`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:40:26.580650 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-2573415d-6c7a-48dc-b37b-33d15c3d2a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:40:26.644763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1232/2469] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:40:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:40:28.268739 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=32 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:40:33.872533 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c82d0-ae1f-40ef-a47c-2d099b625563 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:40:33.873154 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c82d0-ae1f-40ef-a47c-2d099b625563 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:40:33.873154 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c82d0-ae1f-40ef-a47c-2d099b625563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:40:33.911084 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6a4c82d0-ae1f-40ef-a47c-2d099b625563 None None] MFA Rules not processed for user `912693f459f147a5a479ad01e2e8387a`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:40:33.912305 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6a4c82d0-ae1f-40ef-a47c-2d099b625563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:40:33.944579 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1238/2470] 10.222.0.18 () {58 vars in 967 bytes} [Mon Oct 31 12:40:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:40:33.957476 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573415d-6c7a-48dc-b37b-33d15c3d2a1a None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:40:33.991595 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573415d-6c7a-48dc-b37b-33d15c3d2a1a None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:40:33.997150 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a937c-df5c-4250-81a8-be3db807f9b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188c4989dcfb4f99a04c3349e1a882d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:40:33.997746 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a937c-df5c-4250-81a8-be3db807f9b6 service swift] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:40:33.998027 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a937c-df5c-4250-81a8-be3db807f9b6 service swift] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:40:33.998298 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a937c-df5c-4250-81a8-be3db807f9b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:40:34.007005 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a937c-df5c-4250-81a8-be3db807f9b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:40:34.008509 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a937c-df5c-4250-81a8-be3db807f9b6 service swift] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:40:34.016922 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1233/2471] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Oct 31 12:40:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 12:40:35.849923 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c82d0-ae1f-40ef-a47c-2d099b625563 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:40:35.851358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6a4c82d0-ae1f-40ef-a47c-2d099b625563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:40:35.914826 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a937c-df5c-4250-81a8-be3db807f9b6 service swift] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:40:35.947778 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c82d0-ae1f-40ef-a47c-2d099b625563 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:40:35.952224 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a937c-df5c-4250-81a8-be3db807f9b6 service swift] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:40:35.952977 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47dae9-821a-4616-9f37-d86ec0b843c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18c015b8317b4517911f69bef21a0573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:40:35.953679 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47dae9-821a-4616-9f37-d86ec0b843c1 service placement] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:40:35.954021 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47dae9-821a-4616-9f37-d86ec0b843c1 service placement] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:40:35.954362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47dae9-821a-4616-9f37-d86ec0b843c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:40:35.956075 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9e47dae9-821a-4616-9f37-d86ec0b843c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:40:35.956791 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb6773-c1af-4201-9839-05f5c9fac1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:40:35.957443 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb6773-c1af-4201-9839-05f5c9fac1c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:40:35.957724 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb6773-c1af-4201-9839-05f5c9fac1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:40:35.957996 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb6773-c1af-4201-9839-05f5c9fac1c6 admin admin] PATH_INFO: `/v3/users/429ad0fa699f41e9bea2a88a6e9ef614` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:40:35.959116 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb6773-c1af-4201-9839-05f5c9fac1c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=429ad0fa699f41e9bea2a88a6e9ef614)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:40:35.961049 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb6773-c1af-4201-9839-05f5c9fac1c6 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:40:35.968122 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47dae9-821a-4616-9f37-d86ec0b843c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:40:35.969708 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47dae9-821a-4616-9f37-d86ec0b843c1 service placement] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:40:35.980223 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1239/2472] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:40:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:40:36.008678 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-59cb6773-c1af-4201-9839-05f5c9fac1c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '429ad0fa699f41e9bea2a88a6e9ef614'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:40:36.009355 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-59cb6773-c1af-4201-9839-05f5c9fac1c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '429ad0fa699f41e9bea2a88a6e9ef614'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:40:36.009968 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-59cb6773-c1af-4201-9839-05f5c9fac1c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '429ad0fa699f41e9bea2a88a6e9ef614'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:40:36.014711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:40:36.017752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-59cb6773-c1af-4201-9839-05f5c9fac1c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '429ad0fa699f41e9bea2a88a6e9ef614'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:40:36.025895 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-59cb6773-c1af-4201-9839-05f5c9fac1c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '429ad0fa699f41e9bea2a88a6e9ef614'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:40:36.044134 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1234/2473] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:40:35 2022] DELETE /identity/v3/users/429ad0fa699f41e9bea2a88a6e9ef614 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:40:36.214415 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47dae9-821a-4616-9f37-d86ec0b843c1 service placement] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:40:36.225617 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47dae9-821a-4616-9f37-d86ec0b843c1 service placement] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:40:36.282185 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbf4f5-448b-4d52-887c-832987cb60e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:40:36.282808 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbf4f5-448b-4d52-887c-832987cb60e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:40:36.283084 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbf4f5-448b-4d52-887c-832987cb60e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:40:36.283357 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbf4f5-448b-4d52-887c-832987cb60e4 admin admin] PATH_INFO: `/v3/projects/f82cae8cc1624d9996dc6ab37ba54731` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:40:36.284452 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbf4f5-448b-4d52-887c-832987cb60e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f82cae8cc1624d9996dc6ab37ba54731)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:40:36.286356 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbf4f5-448b-4d52-887c-832987cb60e4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:40:36.309771 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:40:36.333454 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0ebbf4f5-448b-4d52-887c-832987cb60e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f82cae8cc1624d9996dc6ab37ba54731', 'request_id': 'req-0ebbf4f5-448b-4d52-887c-832987cb60e4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:40:36.341133 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0ebbf4f5-448b-4d52-887c-832987cb60e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f82cae8cc1624d9996dc6ab37ba54731', 'request_id': 'req-0ebbf4f5-448b-4d52-887c-832987cb60e4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:40:36.346577 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0ebbf4f5-448b-4d52-887c-832987cb60e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f82cae8cc1624d9996dc6ab37ba54731', 'request_id': 'req-0ebbf4f5-448b-4d52-887c-832987cb60e4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:40:36.369325 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0ebbf4f5-448b-4d52-887c-832987cb60e4 admin admin] The token cache is being invalidate because project f82cae8cc1624d9996dc6ab37ba54731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:40:36.369619 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0ebbf4f5-448b-4d52-887c-832987cb60e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:40:36.370252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0ebbf4f5-448b-4d52-887c-832987cb60e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:40:36.371712 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1240/2474] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:40:36 2022] DELETE /identity/v3/projects/f82cae8cc1624d9996dc6ab37ba54731 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:40:45.064080 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb6773-c1af-4201-9839-05f5c9fac1c6 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:40:45.065588 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-59cb6773-c1af-4201-9839-05f5c9fac1c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:40:45.134505 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb6773-c1af-4201-9839-05f5c9fac1c6 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:40:45.193011 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04f9c5-cd99-4911-8464-fc91874ecd35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18c015b8317b4517911f69bef21a0573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:40:45.193646 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04f9c5-cd99-4911-8464-fc91874ecd35 service placement] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:40:45.193927 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04f9c5-cd99-4911-8464-fc91874ecd35 service placement] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:40:45.194202 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04f9c5-cd99-4911-8464-fc91874ecd35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:40:45.195916 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ce04f9c5-cd99-4911-8464-fc91874ecd35 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:40:45.207693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04f9c5-cd99-4911-8464-fc91874ecd35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:40:45.209296 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04f9c5-cd99-4911-8464-fc91874ecd35 service placement] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:40:45.219624 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1235/2475] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:40:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:40:46.366918 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:40:55.214773 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=68,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:33.671195 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbf4f5-448b-4d52-887c-832987cb60e4 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:33.674264 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0ebbf4f5-448b-4d52-887c-832987cb60e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:33.746173 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbf4f5-448b-4d52-887c-832987cb60e4 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:33.751055 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fb950-7e4e-4487-83a3-7c97cab02a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:33.751698 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fb950-7e4e-4487-83a3-7c97cab02a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:33.752004 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fb950-7e4e-4487-83a3-7c97cab02a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:33.752282 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fb950-7e4e-4487-83a3-7c97cab02a8c admin admin] PATH_INFO: `/v3/users/7b207b303fb64275bf26dbb70ee36473` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:33.753448 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fb950-7e4e-4487-83a3-7c97cab02a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b207b303fb64275bf26dbb70ee36473)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:33.755356 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fb950-7e4e-4487-83a3-7c97cab02a8c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:33.802026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-507fb950-7e4e-4487-83a3-7c97cab02a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b207b303fb64275bf26dbb70ee36473'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:33.809275 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-507fb950-7e4e-4487-83a3-7c97cab02a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b207b303fb64275bf26dbb70ee36473'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:33.809885 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-507fb950-7e4e-4487-83a3-7c97cab02a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b207b303fb64275bf26dbb70ee36473'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:33.823112 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-507fb950-7e4e-4487-83a3-7c97cab02a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b207b303fb64275bf26dbb70ee36473'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:33.829848 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-507fb950-7e4e-4487-83a3-7c97cab02a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b207b303fb64275bf26dbb70ee36473'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:33.835727 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1241/2476] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:41:33 2022] DELETE /identity/v3/users/7b207b303fb64275bf26dbb70ee36473 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:34.006029 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04f9c5-cd99-4911-8464-fc91874ecd35 service placement] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:34.017156 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04f9c5-cd99-4911-8464-fc91874ecd35 service placement] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:34.076572 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12bdc3-aafe-4097-9a05-a30651eca16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:34.077232 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12bdc3-aafe-4097-9a05-a30651eca16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:34.077514 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12bdc3-aafe-4097-9a05-a30651eca16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:34.077785 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12bdc3-aafe-4097-9a05-a30651eca16c admin admin] PATH_INFO: `/v3/projects/16dde6e228024e1aadc23ad49391a6e1` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:34.079392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12bdc3-aafe-4097-9a05-a30651eca16c admin admin] RBAC: Authorizing `identity:delete_project(project_id=16dde6e228024e1aadc23ad49391a6e1)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:34.081325 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12bdc3-aafe-4097-9a05-a30651eca16c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:34.128371 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8e12bdc3-aafe-4097-9a05-a30651eca16c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16dde6e228024e1aadc23ad49391a6e1', 'request_id': 'req-8e12bdc3-aafe-4097-9a05-a30651eca16c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:34.133798 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8e12bdc3-aafe-4097-9a05-a30651eca16c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16dde6e228024e1aadc23ad49391a6e1', 'request_id': 'req-8e12bdc3-aafe-4097-9a05-a30651eca16c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:34.139760 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8e12bdc3-aafe-4097-9a05-a30651eca16c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16dde6e228024e1aadc23ad49391a6e1', 'request_id': 'req-8e12bdc3-aafe-4097-9a05-a30651eca16c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:34.152420 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8e12bdc3-aafe-4097-9a05-a30651eca16c admin admin] The token cache is being invalidate because project 16dde6e228024e1aadc23ad49391a6e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:41:34.152842 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8e12bdc3-aafe-4097-9a05-a30651eca16c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:34.153515 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-8e12bdc3-aafe-4097-9a05-a30651eca16c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:34.154990 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1236/2477] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:41:34 2022] DELETE /identity/v3/projects/16dde6e228024e1aadc23ad49391a6e1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:34.160461 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266804fc-821f-46ce-aae4-ba1d699528fa None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:34.160742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266804fc-821f-46ce-aae4-ba1d699528fa None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:34.161015 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266804fc-821f-46ce-aae4-ba1d699528fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:34.217892 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-266804fc-821f-46ce-aae4-ba1d699528fa None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:41:34.219718 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-266804fc-821f-46ce-aae4-ba1d699528fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:34.261546 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:34.278551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1242/2478] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:41:34.287899 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29cdaa-96bf-43c2-8e28-42f78907ef76 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:34.288184 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29cdaa-96bf-43c2-8e28-42f78907ef76 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:34.288463 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29cdaa-96bf-43c2-8e28-42f78907ef76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:34.308121 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-1e29cdaa-96bf-43c2-8e28-42f78907ef76 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:41:34.309346 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1e29cdaa-96bf-43c2-8e28-42f78907ef76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:34.317624 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1237/2479] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:41:34.321615 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266804fc-821f-46ce-aae4-ba1d699528fa None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:34.331864 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266804fc-821f-46ce-aae4-ba1d699528fa None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:34.336331 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddb4ef-6553-44f1-8049-734f2f89ca4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:34.336922 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddb4ef-6553-44f1-8049-734f2f89ca4a admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:34.337239 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddb4ef-6553-44f1-8049-734f2f89ca4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:34.337518 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddb4ef-6553-44f1-8049-734f2f89ca4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:34.338162 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddb4ef-6553-44f1-8049-734f2f89ca4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:41:34.338469 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddb4ef-6553-44f1-8049-734f2f89ca4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:34.340047 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddb4ef-6553-44f1-8049-734f2f89ca4a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:34.351476 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1243/2480] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:41:34.355536 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29cdaa-96bf-43c2-8e28-42f78907ef76 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:34.364526 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29cdaa-96bf-43c2-8e28-42f78907ef76 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:34.369069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1324ef-246b-4288-a8b0-c071a1efe81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:34.369711 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1324ef-246b-4288-a8b0-c071a1efe81a admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:34.369993 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1324ef-246b-4288-a8b0-c071a1efe81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:34.370265 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1324ef-246b-4288-a8b0-c071a1efe81a admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:34.370900 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1324ef-246b-4288-a8b0-c071a1efe81a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:34.372769 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1324ef-246b-4288-a8b0-c071a1efe81a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:34.400218 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1238/2481] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:41:34 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:41:34.404105 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddb4ef-6553-44f1-8049-734f2f89ca4a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:34.414034 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddb4ef-6553-44f1-8049-734f2f89ca4a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:34.469921 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e94b7-4b62-4517-abd9-85145e1db3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:34.470517 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e94b7-4b62-4517-abd9-85145e1db3dd admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:34.470798 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e94b7-4b62-4517-abd9-85145e1db3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:34.471069 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e94b7-4b62-4517-abd9-85145e1db3dd admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:34.471700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e94b7-4b62-4517-abd9-85145e1db3dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:34.473626 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e94b7-4b62-4517-abd9-85145e1db3dd admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:34.494326 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1244/2482] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:41:34 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:41:34.498586 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1324ef-246b-4288-a8b0-c071a1efe81a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:34.509559 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1324ef-246b-4288-a8b0-c071a1efe81a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:34.514201 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f963eb9-22c5-418b-89e1-2b23de37ba24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:34.514797 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f963eb9-22c5-418b-89e1-2b23de37ba24 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:34.515080 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f963eb9-22c5-418b-89e1-2b23de37ba24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:34.515357 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f963eb9-22c5-418b-89e1-2b23de37ba24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:34.516637 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f963eb9-22c5-418b-89e1-2b23de37ba24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:34.518283 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f963eb9-22c5-418b-89e1-2b23de37ba24 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:34.528014 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1239/2483] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:41:34.531650 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e94b7-4b62-4517-abd9-85145e1db3dd admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:34.541446 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e94b7-4b62-4517-abd9-85145e1db3dd admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:34.546291 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757abdf8-fd75-4b0e-858e-301fd1adbba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:34.546905 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757abdf8-fd75-4b0e-858e-301fd1adbba2 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:34.547184 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757abdf8-fd75-4b0e-858e-301fd1adbba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:34.547456 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757abdf8-fd75-4b0e-858e-301fd1adbba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:34.548091 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757abdf8-fd75-4b0e-858e-301fd1adbba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:34.549682 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757abdf8-fd75-4b0e-858e-301fd1adbba2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:34.560044 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1245/2484] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:41:34.564293 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f963eb9-22c5-418b-89e1-2b23de37ba24 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:34.574176 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f963eb9-22c5-418b-89e1-2b23de37ba24 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:34.579430 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84faa39d-1bd8-4b35-8167-57f421828d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:34.580061 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faa39d-1bd8-4b35-8167-57f421828d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:34.580344 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faa39d-1bd8-4b35-8167-57f421828d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:34.580642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84faa39d-1bd8-4b35-8167-57f421828d59 admin admin] PATH_INFO: `/v3/projects/bf12f1eef07443fb87f54dd292c10e0d/users/9afab881b9c144439bcdb109967a86c6/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:34.594946 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84faa39d-1bd8-4b35-8167-57f421828d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf12f1eef07443fb87f54dd292c10e0d, user_id=9afab881b9c144439bcdb109967a86c6, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:34.597620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84faa39d-1bd8-4b35-8167-57f421828d59 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:34.610230 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1240/2485] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:41:34 2022] PUT /identity/v3/projects/bf12f1eef07443fb87f54dd292c10e0d/users/9afab881b9c144439bcdb109967a86c6/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:34.620484 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ea3fa-f98c-4aa9-8b8a-28ae15b704f3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:34.620756 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ea3fa-f98c-4aa9-8b8a-28ae15b704f3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:34.621028 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ea3fa-f98c-4aa9-8b8a-28ae15b704f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:34.649237 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-684ea3fa-f98c-4aa9-8b8a-28ae15b704f3 None None] MFA Rules not processed for user `9afab881b9c144439bcdb109967a86c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:41:34.650465 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-684ea3fa-f98c-4aa9-8b8a-28ae15b704f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:34.712332 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1246/2486] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:41:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:41:34.716737 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84faa39d-1bd8-4b35-8167-57f421828d59 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:34.746172 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:34.780432 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84faa39d-1bd8-4b35-8167-57f421828d59 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:34.785148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4499979-1bc3-4c1c-afb7-675c4c0dd88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:34.785751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4499979-1bc3-4c1c-afb7-675c4c0dd88a admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:34.786026 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4499979-1bc3-4c1c-afb7-675c4c0dd88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:34.786297 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4499979-1bc3-4c1c-afb7-675c4c0dd88a admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:34.786952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4499979-1bc3-4c1c-afb7-675c4c0dd88a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:34.789141 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4499979-1bc3-4c1c-afb7-675c4c0dd88a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:34.820212 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1241/2487] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:41:34 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:41:34.821503 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ea3fa-f98c-4aa9-8b8a-28ae15b704f3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:34.831957 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ea3fa-f98c-4aa9-8b8a-28ae15b704f3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:34.871714 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:34.888015 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47631f0b-c6a1-48d0-91b4-5064e0b51300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:34.888603 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47631f0b-c6a1-48d0-91b4-5064e0b51300 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:34.888880 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47631f0b-c6a1-48d0-91b4-5064e0b51300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:34.889187 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47631f0b-c6a1-48d0-91b4-5064e0b51300 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:34.889825 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47631f0b-c6a1-48d0-91b4-5064e0b51300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:34.891729 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47631f0b-c6a1-48d0-91b4-5064e0b51300 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:34.911847 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1247/2488] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:41:34 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:41:34.915960 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4499979-1bc3-4c1c-afb7-675c4c0dd88a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:34.927354 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4499979-1bc3-4c1c-afb7-675c4c0dd88a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:34.932314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdabd5-bb4f-4c72-bcf4-14d85183443d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:34.932951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdabd5-bb4f-4c72-bcf4-14d85183443d admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:34.933270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdabd5-bb4f-4c72-bcf4-14d85183443d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:34.933546 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdabd5-bb4f-4c72-bcf4-14d85183443d admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:34.934189 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abdabd5-bb4f-4c72-bcf4-14d85183443d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:34.935849 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abdabd5-bb4f-4c72-bcf4-14d85183443d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:34.947535 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1242/2489] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:41:34.951723 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47631f0b-c6a1-48d0-91b4-5064e0b51300 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:34.961717 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47631f0b-c6a1-48d0-91b4-5064e0b51300 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:34.967231 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708e8fb-16a0-4c40-b834-7685f1256973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:34.967888 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708e8fb-16a0-4c40-b834-7685f1256973 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:34.968168 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708e8fb-16a0-4c40-b834-7685f1256973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:34.968441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708e8fb-16a0-4c40-b834-7685f1256973 admin admin] PATH_INFO: `/v3/projects/e32169eefb314c4f94e5916a00ffe0c4/users/c337ba2441604e7ba76f9bf7e9638a7a/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:34.984913 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708e8fb-16a0-4c40-b834-7685f1256973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e32169eefb314c4f94e5916a00ffe0c4, user_id=c337ba2441604e7ba76f9bf7e9638a7a, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:34.987562 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708e8fb-16a0-4c40-b834-7685f1256973 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:35.001351 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1248/2490] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:41:34 2022] PUT /identity/v3/projects/e32169eefb314c4f94e5916a00ffe0c4/users/c337ba2441604e7ba76f9bf7e9638a7a/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:35.005391 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdabd5-bb4f-4c72-bcf4-14d85183443d admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:35.015890 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdabd5-bb4f-4c72-bcf4-14d85183443d admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:35.074256 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49a046-f849-4f06-8df0-d1ff1af5276e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:35.074868 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49a046-f849-4f06-8df0-d1ff1af5276e admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:35.075148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49a046-f849-4f06-8df0-d1ff1af5276e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:35.075416 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49a046-f849-4f06-8df0-d1ff1af5276e admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:35.076064 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49a046-f849-4f06-8df0-d1ff1af5276e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:35.077824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49a046-f849-4f06-8df0-d1ff1af5276e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:35.093315 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1243/2491] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:41:35.094940 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708e8fb-16a0-4c40-b834-7685f1256973 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:35.105363 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708e8fb-16a0-4c40-b834-7685f1256973 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:35.110623 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69790981-2c00-4dd9-a2bf-a7a4c6ef6f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:35.111259 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69790981-2c00-4dd9-a2bf-a7a4c6ef6f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:35.111537 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69790981-2c00-4dd9-a2bf-a7a4c6ef6f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:35.111808 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69790981-2c00-4dd9-a2bf-a7a4c6ef6f09 admin admin] PATH_INFO: `/v3/projects/e32169eefb314c4f94e5916a00ffe0c4/users/c337ba2441604e7ba76f9bf7e9638a7a/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:35.113722 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69790981-2c00-4dd9-a2bf-a7a4c6ef6f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e32169eefb314c4f94e5916a00ffe0c4, user_id=c337ba2441604e7ba76f9bf7e9638a7a, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:35.116309 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69790981-2c00-4dd9-a2bf-a7a4c6ef6f09 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:35.126276 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1249/2492] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:41:35 2022] PUT /identity/v3/projects/e32169eefb314c4f94e5916a00ffe0c4/users/c337ba2441604e7ba76f9bf7e9638a7a/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:41:35.136184 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fc3f8-47a6-44c7-9dc5-310f5dfc193e None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:35.136474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fc3f8-47a6-44c7-9dc5-310f5dfc193e None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:35.136752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fc3f8-47a6-44c7-9dc5-310f5dfc193e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:35.164487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-e79fc3f8-47a6-44c7-9dc5-310f5dfc193e None None] MFA Rules not processed for user `c337ba2441604e7ba76f9bf7e9638a7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:41:35.165725 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-e79fc3f8-47a6-44c7-9dc5-310f5dfc193e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:35.231993 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1244/2493] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:41:35 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:41:35.243685 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69790981-2c00-4dd9-a2bf-a7a4c6ef6f09 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:35.245512 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-69790981-2c00-4dd9-a2bf-a7a4c6ef6f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:35.321321 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69790981-2c00-4dd9-a2bf-a7a4c6ef6f09 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:35.324901 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77140a-f132-4acf-945f-e956b08818aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:35.325529 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77140a-f132-4acf-945f-e956b08818aa service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:35.325808 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77140a-f132-4acf-945f-e956b08818aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:35.326076 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77140a-f132-4acf-945f-e956b08818aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:35.334704 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77140a-f132-4acf-945f-e956b08818aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:35.336101 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77140a-f132-4acf-945f-e956b08818aa service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:35.345675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1250/2494] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:41:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:41:35.421336 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fc3f8-47a6-44c7-9dc5-310f5dfc193e None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:35.431754 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fc3f8-47a6-44c7-9dc5-310f5dfc193e None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:35.435387 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe210dd1-28ea-4c6a-90a9-c4e6b15e1227 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:35.435979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe210dd1-28ea-4c6a-90a9-c4e6b15e1227 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:35.436261 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe210dd1-28ea-4c6a-90a9-c4e6b15e1227 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:35.436538 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe210dd1-28ea-4c6a-90a9-c4e6b15e1227 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:35.455636 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:35.494050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe210dd1-28ea-4c6a-90a9-c4e6b15e1227 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:35.495460 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe210dd1-28ea-4c6a-90a9-c4e6b15e1227 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:35.504189 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1245/2495] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:41:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:41:42.216156 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77140a-f132-4acf-945f-e956b08818aa service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:42.275490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77140a-f132-4acf-945f-e956b08818aa service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:42.279953 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad7014-fd54-4e64-84c2-7d0fe008676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:42.280570 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad7014-fd54-4e64-84c2-7d0fe008676d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:42.280846 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad7014-fd54-4e64-84c2-7d0fe008676d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:42.281162 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad7014-fd54-4e64-84c2-7d0fe008676d admin admin] PATH_INFO: `/v3/users/9afab881b9c144439bcdb109967a86c6` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:42.282258 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad7014-fd54-4e64-84c2-7d0fe008676d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9afab881b9c144439bcdb109967a86c6)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:42.284141 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad7014-fd54-4e64-84c2-7d0fe008676d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:42.305406 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:42.331280 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b1ad7014-fd54-4e64-84c2-7d0fe008676d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9afab881b9c144439bcdb109967a86c6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:42.338243 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b1ad7014-fd54-4e64-84c2-7d0fe008676d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9afab881b9c144439bcdb109967a86c6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:42.338949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b1ad7014-fd54-4e64-84c2-7d0fe008676d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9afab881b9c144439bcdb109967a86c6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:42.350943 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b1ad7014-fd54-4e64-84c2-7d0fe008676d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9afab881b9c144439bcdb109967a86c6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:42.357719 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b1ad7014-fd54-4e64-84c2-7d0fe008676d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9afab881b9c144439bcdb109967a86c6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:42.364020 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1251/2496] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:41:42 2022] DELETE /identity/v3/users/9afab881b9c144439bcdb109967a86c6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:42.368501 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d243698-9c43-4e81-8058-9f364c7f6e57 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:42.368969 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d243698-9c43-4e81-8058-9f364c7f6e57 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:42.369206 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d243698-9c43-4e81-8058-9f364c7f6e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:42.388668 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-0d243698-9c43-4e81-8058-9f364c7f6e57 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:41:42.389888 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0d243698-9c43-4e81-8058-9f364c7f6e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:42.446885 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1246/2497] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:41:42.456507 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad7014-fd54-4e64-84c2-7d0fe008676d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:42.458016 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b1ad7014-fd54-4e64-84c2-7d0fe008676d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:42.535557 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad7014-fd54-4e64-84c2-7d0fe008676d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:42.539226 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2447f9-274d-4c30-adcd-c82a3c507631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:42.539824 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2447f9-274d-4c30-adcd-c82a3c507631 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:42.540128 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2447f9-274d-4c30-adcd-c82a3c507631 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:42.540406 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2447f9-274d-4c30-adcd-c82a3c507631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:42.550171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2447f9-274d-4c30-adcd-c82a3c507631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:42.551576 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2447f9-274d-4c30-adcd-c82a3c507631 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:42.560902 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1252/2498] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:41:42.824362 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d243698-9c43-4e81-8058-9f364c7f6e57 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:42.825834 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-0d243698-9c43-4e81-8058-9f364c7f6e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:42.838288 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d243698-9c43-4e81-8058-9f364c7f6e57 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:42.842880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526476e-c91d-43f9-84b8-1ff9e71a0bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:42.844069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526476e-c91d-43f9-84b8-1ff9e71a0bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:42.844333 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526476e-c91d-43f9-84b8-1ff9e71a0bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:42.844602 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526476e-c91d-43f9-84b8-1ff9e71a0bc1 admin admin] PATH_INFO: `/v3/projects/bf12f1eef07443fb87f54dd292c10e0d` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:42.845739 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526476e-c91d-43f9-84b8-1ff9e71a0bc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf12f1eef07443fb87f54dd292c10e0d)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:42.847627 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526476e-c91d-43f9-84b8-1ff9e71a0bc1 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:42.895013 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b526476e-c91d-43f9-84b8-1ff9e71a0bc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf12f1eef07443fb87f54dd292c10e0d', 'request_id': 'req-b526476e-c91d-43f9-84b8-1ff9e71a0bc1'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:42.900519 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b526476e-c91d-43f9-84b8-1ff9e71a0bc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf12f1eef07443fb87f54dd292c10e0d', 'request_id': 'req-b526476e-c91d-43f9-84b8-1ff9e71a0bc1'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:42.906954 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b526476e-c91d-43f9-84b8-1ff9e71a0bc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf12f1eef07443fb87f54dd292c10e0d', 'request_id': 'req-b526476e-c91d-43f9-84b8-1ff9e71a0bc1'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:42.920071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b526476e-c91d-43f9-84b8-1ff9e71a0bc1 admin admin] The token cache is being invalidate because project bf12f1eef07443fb87f54dd292c10e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:41:42.920356 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b526476e-c91d-43f9-84b8-1ff9e71a0bc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:42.921252 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-b526476e-c91d-43f9-84b8-1ff9e71a0bc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:42.923305 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1247/2499] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:41:42 2022] DELETE /identity/v3/projects/bf12f1eef07443fb87f54dd292c10e0d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:42.927225 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2447f9-274d-4c30-adcd-c82a3c507631 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:42.936785 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2447f9-274d-4c30-adcd-c82a3c507631 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:42.991090 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63fffc-f53a-470c-8a6b-c8bb41a1b2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:42.991706 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63fffc-f53a-470c-8a6b-c8bb41a1b2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:42.991984 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63fffc-f53a-470c-8a6b-c8bb41a1b2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:42.992256 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63fffc-f53a-470c-8a6b-c8bb41a1b2ca admin admin] PATH_INFO: `/v3/users/c337ba2441604e7ba76f9bf7e9638a7a` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:42.993439 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63fffc-f53a-470c-8a6b-c8bb41a1b2ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=c337ba2441604e7ba76f9bf7e9638a7a)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:42.995331 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63fffc-f53a-470c-8a6b-c8bb41a1b2ca admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:43.017624 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:43.041213 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bd63fffc-f53a-470c-8a6b-c8bb41a1b2ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c337ba2441604e7ba76f9bf7e9638a7a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:43.048208 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bd63fffc-f53a-470c-8a6b-c8bb41a1b2ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c337ba2441604e7ba76f9bf7e9638a7a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:43.048905 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bd63fffc-f53a-470c-8a6b-c8bb41a1b2ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c337ba2441604e7ba76f9bf7e9638a7a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:43.060422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bd63fffc-f53a-470c-8a6b-c8bb41a1b2ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c337ba2441604e7ba76f9bf7e9638a7a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:43.067165 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bd63fffc-f53a-470c-8a6b-c8bb41a1b2ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c337ba2441604e7ba76f9bf7e9638a7a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:43.072944 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1253/2500] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:41:42 2022] DELETE /identity/v3/users/c337ba2441604e7ba76f9bf7e9638a7a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:43.335232 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526476e-c91d-43f9-84b8-1ff9e71a0bc1 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:43.336742 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-b526476e-c91d-43f9-84b8-1ff9e71a0bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:43.353224 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526476e-c91d-43f9-84b8-1ff9e71a0bc1 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:43.401961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:43.419602 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef98f3-032c-4667-b873-2c422f879351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:43.420163 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef98f3-032c-4667-b873-2c422f879351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:43.420444 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef98f3-032c-4667-b873-2c422f879351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:43.420975 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef98f3-032c-4667-b873-2c422f879351 admin admin] PATH_INFO: `/v3/projects/e32169eefb314c4f94e5916a00ffe0c4` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:43.422146 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef98f3-032c-4667-b873-2c422f879351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e32169eefb314c4f94e5916a00ffe0c4)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:43.424035 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef98f3-032c-4667-b873-2c422f879351 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:43.469691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-10ef98f3-032c-4667-b873-2c422f879351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e32169eefb314c4f94e5916a00ffe0c4', 'request_id': 'req-10ef98f3-032c-4667-b873-2c422f879351'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:43.475051 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-10ef98f3-032c-4667-b873-2c422f879351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e32169eefb314c4f94e5916a00ffe0c4', 'request_id': 'req-10ef98f3-032c-4667-b873-2c422f879351'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:43.481003 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-10ef98f3-032c-4667-b873-2c422f879351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e32169eefb314c4f94e5916a00ffe0c4', 'request_id': 'req-10ef98f3-032c-4667-b873-2c422f879351'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:43.492627 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-10ef98f3-032c-4667-b873-2c422f879351 admin admin] The token cache is being invalidate because project e32169eefb314c4f94e5916a00ffe0c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:41:43.492940 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-10ef98f3-032c-4667-b873-2c422f879351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:43.493587 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-10ef98f3-032c-4667-b873-2c422f879351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:43.495068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1248/2501] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:41:43 2022] DELETE /identity/v3/projects/e32169eefb314c4f94e5916a00ffe0c4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:43.500817 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25f34f-d8fb-416c-b060-d3c7dee779aa None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:43.501374 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25f34f-d8fb-416c-b060-d3c7dee779aa None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:43.501374 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25f34f-d8fb-416c-b060-d3c7dee779aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:43.521212 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4f25f34f-d8fb-416c-b060-d3c7dee779aa None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:41:43.522414 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4f25f34f-d8fb-416c-b060-d3c7dee779aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:43.580794 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1254/2502] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:41:43.589911 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457333a-291e-4e2a-b4ac-b84c9e63e2c4 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:43.590279 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457333a-291e-4e2a-b4ac-b84c9e63e2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:43.590618 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457333a-291e-4e2a-b4ac-b84c9e63e2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:43.610148 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f457333a-291e-4e2a-b4ac-b84c9e63e2c4 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:41:43.611335 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f457333a-291e-4e2a-b4ac-b84c9e63e2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:43.619147 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1249/2503] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:41:43.623308 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25f34f-d8fb-416c-b060-d3c7dee779aa None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:43.633457 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25f34f-d8fb-416c-b060-d3c7dee779aa None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:43.638251 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fbfad-00a5-4754-a30d-de950c456272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:43.638855 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fbfad-00a5-4754-a30d-de950c456272 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:43.639147 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fbfad-00a5-4754-a30d-de950c456272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:43.639420 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fbfad-00a5-4754-a30d-de950c456272 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:43.640073 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fbfad-00a5-4754-a30d-de950c456272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:41:43.641027 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fbfad-00a5-4754-a30d-de950c456272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:43.642647 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fbfad-00a5-4754-a30d-de950c456272 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:43.654332 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1255/2504] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:41:43.658537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457333a-291e-4e2a-b4ac-b84c9e63e2c4 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:43.667692 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457333a-291e-4e2a-b4ac-b84c9e63e2c4 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:43.673161 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471f292-acfb-42ac-96b2-40919fa64e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:43.673707 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471f292-acfb-42ac-96b2-40919fa64e04 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:43.673982 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471f292-acfb-42ac-96b2-40919fa64e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:43.674250 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471f292-acfb-42ac-96b2-40919fa64e04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:43.674875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471f292-acfb-42ac-96b2-40919fa64e04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:43.676743 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471f292-acfb-42ac-96b2-40919fa64e04 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:43.703129 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1250/2505] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:41:43 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:41:43.707215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fbfad-00a5-4754-a30d-de950c456272 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:43.717000 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fbfad-00a5-4754-a30d-de950c456272 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:43.771539 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcaa73-74d8-44cf-b0b6-768f5406eb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:43.772128 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcaa73-74d8-44cf-b0b6-768f5406eb7f admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:43.772406 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcaa73-74d8-44cf-b0b6-768f5406eb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:43.772675 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcaa73-74d8-44cf-b0b6-768f5406eb7f admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:43.773312 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bcaa73-74d8-44cf-b0b6-768f5406eb7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:43.775183 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bcaa73-74d8-44cf-b0b6-768f5406eb7f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:43.795981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1256/2506] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:41:43 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:41:43.800621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471f292-acfb-42ac-96b2-40919fa64e04 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:43.810729 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471f292-acfb-42ac-96b2-40919fa64e04 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:43.815932 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11cd40-7973-4a53-bd65-a9e44d31c829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:43.816518 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11cd40-7973-4a53-bd65-a9e44d31c829 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:43.816818 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11cd40-7973-4a53-bd65-a9e44d31c829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:43.817088 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11cd40-7973-4a53-bd65-a9e44d31c829 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:43.817758 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11cd40-7973-4a53-bd65-a9e44d31c829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:43.819326 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11cd40-7973-4a53-bd65-a9e44d31c829 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:43.828915 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1251/2507] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:41:43.832776 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcaa73-74d8-44cf-b0b6-768f5406eb7f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:43.842486 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcaa73-74d8-44cf-b0b6-768f5406eb7f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:43.846986 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98716d7-f1ca-413d-acd1-1a551980e303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:43.847569 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98716d7-f1ca-413d-acd1-1a551980e303 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:43.847851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98716d7-f1ca-413d-acd1-1a551980e303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:43.848120 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98716d7-f1ca-413d-acd1-1a551980e303 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:43.848751 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98716d7-f1ca-413d-acd1-1a551980e303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:43.850343 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98716d7-f1ca-413d-acd1-1a551980e303 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:43.860994 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1257/2508] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:41:43.864782 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11cd40-7973-4a53-bd65-a9e44d31c829 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:43.874567 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11cd40-7973-4a53-bd65-a9e44d31c829 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:43.879830 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce014bf9-8f91-4249-a1ce-435c12a5377c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:43.880495 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce014bf9-8f91-4249-a1ce-435c12a5377c admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:43.880775 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce014bf9-8f91-4249-a1ce-435c12a5377c admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:43.881046 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce014bf9-8f91-4249-a1ce-435c12a5377c admin admin] PATH_INFO: `/v3/projects/13f6581e763e490fbbd79a34a68a2ecb/users/56c747baa078462e95c81cbbd593f88f/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:43.896120 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce014bf9-8f91-4249-a1ce-435c12a5377c admin admin] RBAC: Authorizing `identity:create_grant(project_id=13f6581e763e490fbbd79a34a68a2ecb, user_id=56c747baa078462e95c81cbbd593f88f, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:43.898855 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce014bf9-8f91-4249-a1ce-435c12a5377c admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:43.910855 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1252/2509] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:41:43 2022] PUT /identity/v3/projects/13f6581e763e490fbbd79a34a68a2ecb/users/56c747baa078462e95c81cbbd593f88f/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:43.922021 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc045e-fe44-466b-9b06-e1d2d42976b8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:43.922316 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc045e-fe44-466b-9b06-e1d2d42976b8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:43.922589 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc045e-fe44-466b-9b06-e1d2d42976b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:43.935557 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:43.952037 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6ecc045e-fe44-466b-9b06-e1d2d42976b8 None None] MFA Rules not processed for user `56c747baa078462e95c81cbbd593f88f`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:41:43.953283 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6ecc045e-fe44-466b-9b06-e1d2d42976b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:44.014417 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1258/2510] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:41:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:41:44.018963 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce014bf9-8f91-4249-a1ce-435c12a5377c admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:44.079954 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce014bf9-8f91-4249-a1ce-435c12a5377c admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:44.084567 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc4ad1-f2c8-4e28-9f5b-661b14f604c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:44.085196 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc4ad1-f2c8-4e28-9f5b-661b14f604c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:44.085474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc4ad1-f2c8-4e28-9f5b-661b14f604c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:44.085745 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc4ad1-f2c8-4e28-9f5b-661b14f604c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:44.086366 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc4ad1-f2c8-4e28-9f5b-661b14f604c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:44.088264 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc4ad1-f2c8-4e28-9f5b-661b14f604c6 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:44.103477 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:44.117286 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1253/2511] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:41:44 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:41:44.121426 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc045e-fe44-466b-9b06-e1d2d42976b8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:44.132113 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc045e-fe44-466b-9b06-e1d2d42976b8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:44.187490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b867d9d-9250-4b04-a7d7-05ac81549c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:44.188024 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b867d9d-9250-4b04-a7d7-05ac81549c1a admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:44.188300 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b867d9d-9250-4b04-a7d7-05ac81549c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:44.188567 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b867d9d-9250-4b04-a7d7-05ac81549c1a admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:44.189248 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b867d9d-9250-4b04-a7d7-05ac81549c1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:44.191118 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b867d9d-9250-4b04-a7d7-05ac81549c1a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:44.211120 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1259/2512] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:41:44 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:41:44.215232 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc4ad1-f2c8-4e28-9f5b-661b14f604c6 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:44.225911 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc4ad1-f2c8-4e28-9f5b-661b14f604c6 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:44.230504 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b5a6f-ff6e-4a9d-915c-d6eeeb18d74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:44.231096 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b5a6f-ff6e-4a9d-915c-d6eeeb18d74f admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:44.231371 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b5a6f-ff6e-4a9d-915c-d6eeeb18d74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:44.231641 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b5a6f-ff6e-4a9d-915c-d6eeeb18d74f admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:44.232277 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b5a6f-ff6e-4a9d-915c-d6eeeb18d74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:44.233887 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b5a6f-ff6e-4a9d-915c-d6eeeb18d74f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:44.244782 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1254/2513] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:41:44.248745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b867d9d-9250-4b04-a7d7-05ac81549c1a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:44.258600 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b867d9d-9250-4b04-a7d7-05ac81549c1a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:44.263207 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66a515-8f12-4936-8576-da00aa6eb4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:44.263843 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66a515-8f12-4936-8576-da00aa6eb4b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:44.264127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66a515-8f12-4936-8576-da00aa6eb4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:44.264408 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66a515-8f12-4936-8576-da00aa6eb4b9 admin admin] PATH_INFO: `/v3/projects/105af2adbf82462cad1b5c6019ba3aea/users/f8b99f9955054326b93a492a9444fdff/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:44.278931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66a515-8f12-4936-8576-da00aa6eb4b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=105af2adbf82462cad1b5c6019ba3aea, user_id=f8b99f9955054326b93a492a9444fdff, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:44.282181 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66a515-8f12-4936-8576-da00aa6eb4b9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:44.294847 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1260/2514] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:41:44 2022] PUT /identity/v3/projects/105af2adbf82462cad1b5c6019ba3aea/users/f8b99f9955054326b93a492a9444fdff/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:41:44.299774 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b5a6f-ff6e-4a9d-915c-d6eeeb18d74f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:44.309648 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b5a6f-ff6e-4a9d-915c-d6eeeb18d74f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:44.364943 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b50c69-8d98-4901-ad94-740d504f08ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:44.365566 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b50c69-8d98-4901-ad94-740d504f08ba admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:44.365845 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b50c69-8d98-4901-ad94-740d504f08ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:44.366119 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b50c69-8d98-4901-ad94-740d504f08ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:44.366755 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b50c69-8d98-4901-ad94-740d504f08ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:44.368328 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b50c69-8d98-4901-ad94-740d504f08ba admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:44.377743 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1255/2515] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:41:44.381763 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66a515-8f12-4936-8576-da00aa6eb4b9 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:44.391909 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66a515-8f12-4936-8576-da00aa6eb4b9 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:44.396496 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0708e7-d9a0-4083-b830-798dc51d16cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:44.397151 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0708e7-d9a0-4083-b830-798dc51d16cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:44.397438 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0708e7-d9a0-4083-b830-798dc51d16cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:44.397707 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0708e7-d9a0-4083-b830-798dc51d16cc admin admin] PATH_INFO: `/v3/projects/105af2adbf82462cad1b5c6019ba3aea/users/f8b99f9955054326b93a492a9444fdff/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:44.399693 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0708e7-d9a0-4083-b830-798dc51d16cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=105af2adbf82462cad1b5c6019ba3aea, user_id=f8b99f9955054326b93a492a9444fdff, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:44.402320 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0708e7-d9a0-4083-b830-798dc51d16cc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:44.412881 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1261/2516] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:41:44 2022] PUT /identity/v3/projects/105af2adbf82462cad1b5c6019ba3aea/users/f8b99f9955054326b93a492a9444fdff/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:44.424536 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1465ade-c70b-48ff-b4f9-ac7cccf8388c None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:44.425012 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1465ade-c70b-48ff-b4f9-ac7cccf8388c None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:44.425157 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1465ade-c70b-48ff-b4f9-ac7cccf8388c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:44.451727 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-d1465ade-c70b-48ff-b4f9-ac7cccf8388c None None] MFA Rules not processed for user `f8b99f9955054326b93a492a9444fdff`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:41:44.453381 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-d1465ade-c70b-48ff-b4f9-ac7cccf8388c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:44.518383 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1256/2517] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:41:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:41:44.529637 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0708e7-d9a0-4083-b830-798dc51d16cc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:44.531969 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6a0708e7-d9a0-4083-b830-798dc51d16cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:44.585415 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:44.589371 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0708e7-d9a0-4083-b830-798dc51d16cc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:44.594465 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7d4f9-501f-4a53-a6db-0ba3cdab0bc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:44.595104 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7d4f9-501f-4a53-a6db-0ba3cdab0bc5 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:44.595527 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7d4f9-501f-4a53-a6db-0ba3cdab0bc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:44.595798 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7d4f9-501f-4a53-a6db-0ba3cdab0bc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:44.604812 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7d4f9-501f-4a53-a6db-0ba3cdab0bc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:44.606272 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7d4f9-501f-4a53-a6db-0ba3cdab0bc5 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:44.615482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1262/2518] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:41:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:41:44.681074 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1465ade-c70b-48ff-b4f9-ac7cccf8388c None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:44.741655 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1465ade-c70b-48ff-b4f9-ac7cccf8388c None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:44.746122 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce195393-af9c-4a02-a759-34eeb77e9dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:44.746739 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce195393-af9c-4a02-a759-34eeb77e9dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:44.747017 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce195393-af9c-4a02-a759-34eeb77e9dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:44.747283 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce195393-af9c-4a02-a759-34eeb77e9dcb admin admin] PATH_INFO: `/v3/users/56c747baa078462e95c81cbbd593f88f` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:44.748394 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce195393-af9c-4a02-a759-34eeb77e9dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=56c747baa078462e95c81cbbd593f88f)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:44.750352 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce195393-af9c-4a02-a759-34eeb77e9dcb admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:44.755581 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=100 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:44.802511 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ce195393-af9c-4a02-a759-34eeb77e9dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56c747baa078462e95c81cbbd593f88f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:44.803178 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ce195393-af9c-4a02-a759-34eeb77e9dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56c747baa078462e95c81cbbd593f88f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:44.803792 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ce195393-af9c-4a02-a759-34eeb77e9dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56c747baa078462e95c81cbbd593f88f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:44.810715 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ce195393-af9c-4a02-a759-34eeb77e9dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56c747baa078462e95c81cbbd593f88f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:44.818405 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-ce195393-af9c-4a02-a759-34eeb77e9dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56c747baa078462e95c81cbbd593f88f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:44.835905 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1257/2519] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:41:44 2022] DELETE /identity/v3/users/56c747baa078462e95c81cbbd593f88f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:44.840513 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fe880-aa93-4503-bcf4-cc071eede5c6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:44.840799 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fe880-aa93-4503-bcf4-cc071eede5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:44.841072 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fe880-aa93-4503-bcf4-cc071eede5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:44.859282 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f26fe880-aa93-4503-bcf4-cc071eede5c6 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:41:44.860471 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f26fe880-aa93-4503-bcf4-cc071eede5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:44.918089 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1263/2520] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:41:44.927438 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce195393-af9c-4a02-a759-34eeb77e9dcb admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:44.928877 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ce195393-af9c-4a02-a759-34eeb77e9dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:44.984726 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce195393-af9c-4a02-a759-34eeb77e9dcb admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:44.988373 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99988e3-91d7-4b3c-8f4a-9432ca5bd53f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:44.988971 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99988e3-91d7-4b3c-8f4a-9432ca5bd53f service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:44.989283 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99988e3-91d7-4b3c-8f4a-9432ca5bd53f service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:44.989558 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99988e3-91d7-4b3c-8f4a-9432ca5bd53f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:44.998457 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99988e3-91d7-4b3c-8f4a-9432ca5bd53f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:45.000316 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99988e3-91d7-4b3c-8f4a-9432ca5bd53f service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:45.009562 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1258/2521] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:41:45.273768 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fe880-aa93-4503-bcf4-cc071eede5c6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:45.275233 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f26fe880-aa93-4503-bcf4-cc071eede5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:45.287200 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fe880-aa93-4503-bcf4-cc071eede5c6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:45.292017 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b67a6-9cbd-49a1-9beb-9372de4fb3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:45.292777 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b67a6-9cbd-49a1-9beb-9372de4fb3bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:45.293144 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b67a6-9cbd-49a1-9beb-9372de4fb3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:45.293520 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b67a6-9cbd-49a1-9beb-9372de4fb3bb admin admin] PATH_INFO: `/v3/projects/13f6581e763e490fbbd79a34a68a2ecb` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:45.294731 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b67a6-9cbd-49a1-9beb-9372de4fb3bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=13f6581e763e490fbbd79a34a68a2ecb)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:45.297548 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b67a6-9cbd-49a1-9beb-9372de4fb3bb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:45.343889 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2f7b67a6-9cbd-49a1-9beb-9372de4fb3bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13f6581e763e490fbbd79a34a68a2ecb', 'request_id': 'req-2f7b67a6-9cbd-49a1-9beb-9372de4fb3bb'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:45.350702 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2f7b67a6-9cbd-49a1-9beb-9372de4fb3bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13f6581e763e490fbbd79a34a68a2ecb', 'request_id': 'req-2f7b67a6-9cbd-49a1-9beb-9372de4fb3bb'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:45.356416 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2f7b67a6-9cbd-49a1-9beb-9372de4fb3bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13f6581e763e490fbbd79a34a68a2ecb', 'request_id': 'req-2f7b67a6-9cbd-49a1-9beb-9372de4fb3bb'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:45.367689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2f7b67a6-9cbd-49a1-9beb-9372de4fb3bb admin admin] The token cache is being invalidate because project 13f6581e763e490fbbd79a34a68a2ecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:41:45.367977 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2f7b67a6-9cbd-49a1-9beb-9372de4fb3bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:45.368606 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2f7b67a6-9cbd-49a1-9beb-9372de4fb3bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:45.370098 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1264/2522] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:41:45 2022] DELETE /identity/v3/projects/13f6581e763e490fbbd79a34a68a2ecb => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:45.374055 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99988e3-91d7-4b3c-8f4a-9432ca5bd53f service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:45.384175 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99988e3-91d7-4b3c-8f4a-9432ca5bd53f service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:45.440541 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd247269-f2e6-41c7-8333-70447ccfdbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:45.441262 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd247269-f2e6-41c7-8333-70447ccfdbbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:45.441545 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd247269-f2e6-41c7-8333-70447ccfdbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:45.441818 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd247269-f2e6-41c7-8333-70447ccfdbbb admin admin] PATH_INFO: `/v3/users/f8b99f9955054326b93a492a9444fdff` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:45.442925 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd247269-f2e6-41c7-8333-70447ccfdbbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b99f9955054326b93a492a9444fdff)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:45.444818 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd247269-f2e6-41c7-8333-70447ccfdbbb admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:45.476027 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:45.490363 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dd247269-f2e6-41c7-8333-70447ccfdbbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b99f9955054326b93a492a9444fdff'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:45.491004 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dd247269-f2e6-41c7-8333-70447ccfdbbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b99f9955054326b93a492a9444fdff'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:45.491608 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dd247269-f2e6-41c7-8333-70447ccfdbbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b99f9955054326b93a492a9444fdff'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:45.498539 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dd247269-f2e6-41c7-8333-70447ccfdbbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b99f9955054326b93a492a9444fdff'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:45.505985 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-dd247269-f2e6-41c7-8333-70447ccfdbbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b99f9955054326b93a492a9444fdff'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:45.523116 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1259/2523] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:41:45 2022] DELETE /identity/v3/users/f8b99f9955054326b93a492a9444fdff => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:45.795236 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b67a6-9cbd-49a1-9beb-9372de4fb3bb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:45.797536 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2f7b67a6-9cbd-49a1-9beb-9372de4fb3bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:45.811689 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b67a6-9cbd-49a1-9beb-9372de4fb3bb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:45.868141 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50e8a3-2a5f-4cef-b67a-8014c400666f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:45.868774 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50e8a3-2a5f-4cef-b67a-8014c400666f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:45.869056 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50e8a3-2a5f-4cef-b67a-8014c400666f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:45.869361 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50e8a3-2a5f-4cef-b67a-8014c400666f admin admin] PATH_INFO: `/v3/projects/105af2adbf82462cad1b5c6019ba3aea` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:45.870465 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50e8a3-2a5f-4cef-b67a-8014c400666f admin admin] RBAC: Authorizing `identity:delete_project(project_id=105af2adbf82462cad1b5c6019ba3aea)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:45.872356 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50e8a3-2a5f-4cef-b67a-8014c400666f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:45.888483 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:45.921208 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6d50e8a3-2a5f-4cef-b67a-8014c400666f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '105af2adbf82462cad1b5c6019ba3aea', 'request_id': 'req-6d50e8a3-2a5f-4cef-b67a-8014c400666f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:45.928949 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6d50e8a3-2a5f-4cef-b67a-8014c400666f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '105af2adbf82462cad1b5c6019ba3aea', 'request_id': 'req-6d50e8a3-2a5f-4cef-b67a-8014c400666f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:45.934421 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6d50e8a3-2a5f-4cef-b67a-8014c400666f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '105af2adbf82462cad1b5c6019ba3aea', 'request_id': 'req-6d50e8a3-2a5f-4cef-b67a-8014c400666f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:45.945117 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6d50e8a3-2a5f-4cef-b67a-8014c400666f admin admin] The token cache is being invalidate because project 105af2adbf82462cad1b5c6019ba3aea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:41:45.945427 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6d50e8a3-2a5f-4cef-b67a-8014c400666f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:45.946058 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6d50e8a3-2a5f-4cef-b67a-8014c400666f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:45.947517 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1265/2524] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:41:45 2022] DELETE /identity/v3/projects/105af2adbf82462cad1b5c6019ba3aea => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:45.952477 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5688bd3-b60c-42c3-bb67-fc95e8437874 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:45.953309 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5688bd3-b60c-42c3-bb67-fc95e8437874 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:45.953564 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5688bd3-b60c-42c3-bb67-fc95e8437874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:45.973050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-f5688bd3-b60c-42c3-bb67-fc95e8437874 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:41:45.974263 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f5688bd3-b60c-42c3-bb67-fc95e8437874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:46.031874 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1260/2525] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:41:46.039541 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21910f80-9ff3-4d43-a3de-5aed18475745 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:46.039766 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21910f80-9ff3-4d43-a3de-5aed18475745 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:46.040509 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21910f80-9ff3-4d43-a3de-5aed18475745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:46.059842 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-21910f80-9ff3-4d43-a3de-5aed18475745 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:41:46.061038 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-21910f80-9ff3-4d43-a3de-5aed18475745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:46.068806 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1266/2526] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:41:46.074287 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5688bd3-b60c-42c3-bb67-fc95e8437874 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:46.084335 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5688bd3-b60c-42c3-bb67-fc95e8437874 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:46.088811 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf512e-bf7f-4002-8963-4349b387934d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:46.089429 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf512e-bf7f-4002-8963-4349b387934d admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:46.089709 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf512e-bf7f-4002-8963-4349b387934d admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:46.089979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf512e-bf7f-4002-8963-4349b387934d admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:46.090615 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf512e-bf7f-4002-8963-4349b387934d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:41:46.090915 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf512e-bf7f-4002-8963-4349b387934d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:46.092554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf512e-bf7f-4002-8963-4349b387934d admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:46.104383 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1261/2527] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:41:46.108631 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21910f80-9ff3-4d43-a3de-5aed18475745 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:46.118215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21910f80-9ff3-4d43-a3de-5aed18475745 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:46.122792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee316e2-1cc4-4a0e-9f2f-2cb646fda8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:46.123378 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee316e2-1cc4-4a0e-9f2f-2cb646fda8b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:46.123655 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee316e2-1cc4-4a0e-9f2f-2cb646fda8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:46.123928 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee316e2-1cc4-4a0e-9f2f-2cb646fda8b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:46.124552 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee316e2-1cc4-4a0e-9f2f-2cb646fda8b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:46.126470 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee316e2-1cc4-4a0e-9f2f-2cb646fda8b1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:46.154037 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1267/2528] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:41:46 2022] POST /identity/v3/projects => generated 393 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:41:46.158306 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf512e-bf7f-4002-8963-4349b387934d admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:46.168135 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf512e-bf7f-4002-8963-4349b387934d admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:46.223313 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d2513-a52e-4c3f-9d96-ebd3b0e7c874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:46.223911 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d2513-a52e-4c3f-9d96-ebd3b0e7c874 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:46.224189 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d2513-a52e-4c3f-9d96-ebd3b0e7c874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:46.224460 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d2513-a52e-4c3f-9d96-ebd3b0e7c874 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:46.225093 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d2513-a52e-4c3f-9d96-ebd3b0e7c874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:46.227011 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d2513-a52e-4c3f-9d96-ebd3b0e7c874 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:46.247597 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1262/2529] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:41:46 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:41:46.251650 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee316e2-1cc4-4a0e-9f2f-2cb646fda8b1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:46.261701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee316e2-1cc4-4a0e-9f2f-2cb646fda8b1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:46.266743 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e326c8-92b8-444c-b963-1d72b8fc8c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:46.267331 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e326c8-92b8-444c-b963-1d72b8fc8c69 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:46.267607 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e326c8-92b8-444c-b963-1d72b8fc8c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:46.267875 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e326c8-92b8-444c-b963-1d72b8fc8c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:46.268514 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e326c8-92b8-444c-b963-1d72b8fc8c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:46.270105 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e326c8-92b8-444c-b963-1d72b8fc8c69 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:46.279818 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1268/2530] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:41:46.283930 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d2513-a52e-4c3f-9d96-ebd3b0e7c874 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:46.293670 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d2513-a52e-4c3f-9d96-ebd3b0e7c874 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:46.298470 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f69ff7-2112-4fdb-afdc-9f5ae018e6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:46.299052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f69ff7-2112-4fdb-afdc-9f5ae018e6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:46.299332 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f69ff7-2112-4fdb-afdc-9f5ae018e6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:46.299607 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f69ff7-2112-4fdb-afdc-9f5ae018e6f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:46.300241 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f69ff7-2112-4fdb-afdc-9f5ae018e6f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:46.301837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f69ff7-2112-4fdb-afdc-9f5ae018e6f6 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:46.313095 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1263/2531] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:41:46.317064 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e326c8-92b8-444c-b963-1d72b8fc8c69 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:46.326919 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e326c8-92b8-444c-b963-1d72b8fc8c69 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:46.332286 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494f8b6-d2b0-4a6d-aad0-4b06c607e930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:46.332924 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494f8b6-d2b0-4a6d-aad0-4b06c607e930 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:46.333249 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494f8b6-d2b0-4a6d-aad0-4b06c607e930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:46.333534 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494f8b6-d2b0-4a6d-aad0-4b06c607e930 admin admin] PATH_INFO: `/v3/projects/4b23b428a6664464ae6feaf6ee2fbe25/users/e82200086afe4c25981030c15aea87bd/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:46.347835 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494f8b6-d2b0-4a6d-aad0-4b06c607e930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b23b428a6664464ae6feaf6ee2fbe25, user_id=e82200086afe4c25981030c15aea87bd, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:46.350540 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494f8b6-d2b0-4a6d-aad0-4b06c607e930 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:46.362807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1269/2532] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:41:46 2022] PUT /identity/v3/projects/4b23b428a6664464ae6feaf6ee2fbe25/users/e82200086afe4c25981030c15aea87bd/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:46.373138 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ff0d5-2672-4abd-9fd7-3e4d790b6a07 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:46.373424 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ff0d5-2672-4abd-9fd7-3e4d790b6a07 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:46.373701 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ff0d5-2672-4abd-9fd7-3e4d790b6a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:46.399169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:46.402981 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-181ff0d5-2672-4abd-9fd7-3e4d790b6a07 None None] MFA Rules not processed for user `e82200086afe4c25981030c15aea87bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:41:46.405143 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-181ff0d5-2672-4abd-9fd7-3e4d790b6a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:46.469296 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1264/2533] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:41:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:41:46.473713 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494f8b6-d2b0-4a6d-aad0-4b06c607e930 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:46.533458 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494f8b6-d2b0-4a6d-aad0-4b06c607e930 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:46.538097 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7242677-afd3-42d8-9daa-32bea4efebcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:46.538696 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7242677-afd3-42d8-9daa-32bea4efebcc admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:46.538977 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7242677-afd3-42d8-9daa-32bea4efebcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:46.539247 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7242677-afd3-42d8-9daa-32bea4efebcc admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:46.539878 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7242677-afd3-42d8-9daa-32bea4efebcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:46.541791 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7242677-afd3-42d8-9daa-32bea4efebcc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:46.567874 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1270/2534] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:41:46 2022] POST /identity/v3/projects => generated 391 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:41:46.571893 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ff0d5-2672-4abd-9fd7-3e4d790b6a07 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:46.582896 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ff0d5-2672-4abd-9fd7-3e4d790b6a07 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:46.638894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca8741-d24f-4250-84d3-6c831fd5c8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:46.639498 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca8741-d24f-4250-84d3-6c831fd5c8ec admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:46.639778 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca8741-d24f-4250-84d3-6c831fd5c8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:46.640052 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca8741-d24f-4250-84d3-6c831fd5c8ec admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:46.640672 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca8741-d24f-4250-84d3-6c831fd5c8ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:46.643149 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca8741-d24f-4250-84d3-6c831fd5c8ec admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:46.664417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1265/2535] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:41:46 2022] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:41:46.668400 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7242677-afd3-42d8-9daa-32bea4efebcc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:46.679635 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7242677-afd3-42d8-9daa-32bea4efebcc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:46.684292 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aafa95-c22f-4947-aaee-ae0176146d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:46.684893 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aafa95-c22f-4947-aaee-ae0176146d08 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:46.685207 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aafa95-c22f-4947-aaee-ae0176146d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:46.685484 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aafa95-c22f-4947-aaee-ae0176146d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:46.686119 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aafa95-c22f-4947-aaee-ae0176146d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:46.687693 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aafa95-c22f-4947-aaee-ae0176146d08 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:46.698568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1271/2536] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 12:41:46.702559 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca8741-d24f-4250-84d3-6c831fd5c8ec admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:46.712483 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca8741-d24f-4250-84d3-6c831fd5c8ec admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:46.717061 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200b38d-acf2-4b02-861e-55e9cbd1501f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:46.717727 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200b38d-acf2-4b02-861e-55e9cbd1501f admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:46.718008 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200b38d-acf2-4b02-861e-55e9cbd1501f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:46.718285 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200b38d-acf2-4b02-861e-55e9cbd1501f admin admin] PATH_INFO: `/v3/projects/66ab61fcd6864bbabbae0c62d159b4db/users/48e02d0d1ea640fa9472035f0473589a/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:46.733036 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200b38d-acf2-4b02-861e-55e9cbd1501f admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ab61fcd6864bbabbae0c62d159b4db, user_id=48e02d0d1ea640fa9472035f0473589a, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:46.736284 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200b38d-acf2-4b02-861e-55e9cbd1501f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:46.749069 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1266/2537] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:41:46 2022] PUT /identity/v3/projects/66ab61fcd6864bbabbae0c62d159b4db/users/48e02d0d1ea640fa9472035f0473589a/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:41:46.753620 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aafa95-c22f-4947-aaee-ae0176146d08 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:46.763371 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aafa95-c22f-4947-aaee-ae0176146d08 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:46.774817 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:46.822574 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40707f19-522f-49c6-b5e7-895f343a88d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:46.823268 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40707f19-522f-49c6-b5e7-895f343a88d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:46.823374 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40707f19-522f-49c6-b5e7-895f343a88d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:46.823629 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40707f19-522f-49c6-b5e7-895f343a88d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:46.824276 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40707f19-522f-49c6-b5e7-895f343a88d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:46.825913 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40707f19-522f-49c6-b5e7-895f343a88d6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:46.836112 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1272/2538] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:41:46.840104 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200b38d-acf2-4b02-861e-55e9cbd1501f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:46.850856 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200b38d-acf2-4b02-861e-55e9cbd1501f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:46.855664 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714791f-dcfe-4a80-b6b2-89549780fd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:46.856318 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714791f-dcfe-4a80-b6b2-89549780fd66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:46.856600 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714791f-dcfe-4a80-b6b2-89549780fd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:46.856880 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714791f-dcfe-4a80-b6b2-89549780fd66 admin admin] PATH_INFO: `/v3/projects/66ab61fcd6864bbabbae0c62d159b4db/users/48e02d0d1ea640fa9472035f0473589a/roles/e1b3a811029244d2a7e2664cd3246eec` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:46.858824 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714791f-dcfe-4a80-b6b2-89549780fd66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ab61fcd6864bbabbae0c62d159b4db, user_id=48e02d0d1ea640fa9472035f0473589a, role_id=e1b3a811029244d2a7e2664cd3246eec)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:46.862010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714791f-dcfe-4a80-b6b2-89549780fd66 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:46.872669 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1267/2539] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:41:46 2022] PUT /identity/v3/projects/66ab61fcd6864bbabbae0c62d159b4db/users/48e02d0d1ea640fa9472035f0473589a/roles/e1b3a811029244d2a7e2664cd3246eec => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:46.939137 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46399ea7-4e63-4587-9e85-f170c9797496 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:46.939422 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46399ea7-4e63-4587-9e85-f170c9797496 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:46.939701 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46399ea7-4e63-4587-9e85-f170c9797496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:46.966906 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-46399ea7-4e63-4587-9e85-f170c9797496 None None] MFA Rules not processed for user `48e02d0d1ea640fa9472035f0473589a`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:41:46.968110 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-46399ea7-4e63-4587-9e85-f170c9797496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:47.033869 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1273/2540] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:41:46 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:41:47.044444 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714791f-dcfe-4a80-b6b2-89549780fd66 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:47.046433 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4714791f-dcfe-4a80-b6b2-89549780fd66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:47.103783 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714791f-dcfe-4a80-b6b2-89549780fd66 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:47.108603 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a859bf-3a18-4410-a1c2-690c644556a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:47.109243 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a859bf-3a18-4410-a1c2-690c644556a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:47.109527 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a859bf-3a18-4410-a1c2-690c644556a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:47.109800 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a859bf-3a18-4410-a1c2-690c644556a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:47.120659 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a859bf-3a18-4410-a1c2-690c644556a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:47.122162 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a859bf-3a18-4410-a1c2-690c644556a2 service cinder] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:47.126210 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:47.133554 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1268/2541] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:41:47 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:41:47.180714 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46399ea7-4e63-4587-9e85-f170c9797496 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:47.182124 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-46399ea7-4e63-4587-9e85-f170c9797496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:47.193870 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46399ea7-4e63-4587-9e85-f170c9797496 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:47.197434 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894107c9-dd9f-4ab5-988b-93c1ee583601 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:47.198019 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894107c9-dd9f-4ab5-988b-93c1ee583601 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:47.198297 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894107c9-dd9f-4ab5-988b-93c1ee583601 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:47.198565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894107c9-dd9f-4ab5-988b-93c1ee583601 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:47.253716 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894107c9-dd9f-4ab5-988b-93c1ee583601 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:47.255110 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894107c9-dd9f-4ab5-988b-93c1ee583601 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:47.263645 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1274/2542] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:41:47 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:41:50.690348 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a859bf-3a18-4410-a1c2-690c644556a2 service cinder] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:50.751656 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a859bf-3a18-4410-a1c2-690c644556a2 service cinder] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:50.756141 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384563a-d915-4d66-80b7-451b4a23fef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:50.756752 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384563a-d915-4d66-80b7-451b4a23fef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:50.757030 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384563a-d915-4d66-80b7-451b4a23fef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:50.757330 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384563a-d915-4d66-80b7-451b4a23fef5 admin admin] PATH_INFO: `/v3/users/e82200086afe4c25981030c15aea87bd` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:50.758434 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384563a-d915-4d66-80b7-451b4a23fef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e82200086afe4c25981030c15aea87bd)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:50.760314 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384563a-d915-4d66-80b7-451b4a23fef5 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:50.806983 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1384563a-d915-4d66-80b7-451b4a23fef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e82200086afe4c25981030c15aea87bd'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:50.807585 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1384563a-d915-4d66-80b7-451b4a23fef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e82200086afe4c25981030c15aea87bd'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:50.808210 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1384563a-d915-4d66-80b7-451b4a23fef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e82200086afe4c25981030c15aea87bd'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:50.815010 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1384563a-d915-4d66-80b7-451b4a23fef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e82200086afe4c25981030c15aea87bd'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:50.822217 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-1384563a-d915-4d66-80b7-451b4a23fef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e82200086afe4c25981030c15aea87bd'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:50.839315 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1269/2543] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:41:50 2022] DELETE /identity/v3/users/e82200086afe4c25981030c15aea87bd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:50.843928 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5b759-0ea8-4b69-95d5-90cd972768bb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:50.844424 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5b759-0ea8-4b69-95d5-90cd972768bb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:50.844536 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5b759-0ea8-4b69-95d5-90cd972768bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:50.864254 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fba5b759-0ea8-4b69-95d5-90cd972768bb None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:41:50.865465 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fba5b759-0ea8-4b69-95d5-90cd972768bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:50.893745 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:50.921974 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1275/2544] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 12:41:50.932298 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384563a-d915-4d66-80b7-451b4a23fef5 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:50.933729 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1384563a-d915-4d66-80b7-451b4a23fef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:50.989584 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384563a-d915-4d66-80b7-451b4a23fef5 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:50.993480 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38b0e9-8be8-4676-93cf-cae417d423fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:50.994093 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38b0e9-8be8-4676-93cf-cae417d423fd service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:50.994439 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38b0e9-8be8-4676-93cf-cae417d423fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:50.994680 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38b0e9-8be8-4676-93cf-cae417d423fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:51.004064 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38b0e9-8be8-4676-93cf-cae417d423fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:51.005535 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38b0e9-8be8-4676-93cf-cae417d423fd service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:51.014837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1270/2545] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:41:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:41:51.290494 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5b759-0ea8-4b69-95d5-90cd972768bb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:51.291932 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fba5b759-0ea8-4b69-95d5-90cd972768bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:51.304133 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5b759-0ea8-4b69-95d5-90cd972768bb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:51.308818 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f6f3a-7fab-49d7-b5ba-804b40bb4c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:51.309535 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f6f3a-7fab-49d7-b5ba-804b40bb4c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:51.309805 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f6f3a-7fab-49d7-b5ba-804b40bb4c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:51.310077 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f6f3a-7fab-49d7-b5ba-804b40bb4c71 admin admin] PATH_INFO: `/v3/projects/4b23b428a6664464ae6feaf6ee2fbe25` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:51.311233 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f6f3a-7fab-49d7-b5ba-804b40bb4c71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b23b428a6664464ae6feaf6ee2fbe25)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:51.313170 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f6f3a-7fab-49d7-b5ba-804b40bb4c71 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:51.359970 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ee8f6f3a-7fab-49d7-b5ba-804b40bb4c71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b23b428a6664464ae6feaf6ee2fbe25', 'request_id': 'req-ee8f6f3a-7fab-49d7-b5ba-804b40bb4c71'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:51.367055 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ee8f6f3a-7fab-49d7-b5ba-804b40bb4c71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b23b428a6664464ae6feaf6ee2fbe25', 'request_id': 'req-ee8f6f3a-7fab-49d7-b5ba-804b40bb4c71'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:51.372596 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ee8f6f3a-7fab-49d7-b5ba-804b40bb4c71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b23b428a6664464ae6feaf6ee2fbe25', 'request_id': 'req-ee8f6f3a-7fab-49d7-b5ba-804b40bb4c71'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:51.383440 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ee8f6f3a-7fab-49d7-b5ba-804b40bb4c71 admin admin] The token cache is being invalidate because project 4b23b428a6664464ae6feaf6ee2fbe25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:41:51.383729 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ee8f6f3a-7fab-49d7-b5ba-804b40bb4c71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:51.384350 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ee8f6f3a-7fab-49d7-b5ba-804b40bb4c71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:51.385882 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1276/2546] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:41:51 2022] DELETE /identity/v3/projects/4b23b428a6664464ae6feaf6ee2fbe25 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:51.389810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38b0e9-8be8-4676-93cf-cae417d423fd service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:51.399923 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38b0e9-8be8-4676-93cf-cae417d423fd service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:51.416733 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:51.458598 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089d25a-aeea-46c7-8889-646df09d1895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:51.459216 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089d25a-aeea-46c7-8889-646df09d1895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:51.459499 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089d25a-aeea-46c7-8889-646df09d1895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:51.459802 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089d25a-aeea-46c7-8889-646df09d1895 admin admin] PATH_INFO: `/v3/users/48e02d0d1ea640fa9472035f0473589a` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:51.460917 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089d25a-aeea-46c7-8889-646df09d1895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48e02d0d1ea640fa9472035f0473589a)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:51.462867 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089d25a-aeea-46c7-8889-646df09d1895 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:51.507904 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9089d25a-aeea-46c7-8889-646df09d1895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e02d0d1ea640fa9472035f0473589a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:51.508549 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9089d25a-aeea-46c7-8889-646df09d1895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e02d0d1ea640fa9472035f0473589a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:51.509185 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9089d25a-aeea-46c7-8889-646df09d1895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e02d0d1ea640fa9472035f0473589a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:51.516050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9089d25a-aeea-46c7-8889-646df09d1895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e02d0d1ea640fa9472035f0473589a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:51.523900 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9089d25a-aeea-46c7-8889-646df09d1895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e02d0d1ea640fa9472035f0473589a'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:51.541015 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1271/2547] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:41:51 2022] DELETE /identity/v3/users/48e02d0d1ea640fa9472035f0473589a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:51.801750 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f6f3a-7fab-49d7-b5ba-804b40bb4c71 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:51.803352 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ee8f6f3a-7fab-49d7-b5ba-804b40bb4c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:51.819054 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f6f3a-7fab-49d7-b5ba-804b40bb4c71 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:51.874630 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9585f3-853f-4b3e-8eb3-21526f41c899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:51.875270 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9585f3-853f-4b3e-8eb3-21526f41c899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:51.875519 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9585f3-853f-4b3e-8eb3-21526f41c899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:51.875791 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9585f3-853f-4b3e-8eb3-21526f41c899 admin admin] PATH_INFO: `/v3/projects/66ab61fcd6864bbabbae0c62d159b4db` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:51.877426 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9585f3-853f-4b3e-8eb3-21526f41c899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ab61fcd6864bbabbae0c62d159b4db)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:51.879294 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9585f3-853f-4b3e-8eb3-21526f41c899 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:51.924926 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6d9585f3-853f-4b3e-8eb3-21526f41c899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ab61fcd6864bbabbae0c62d159b4db', 'request_id': 'req-6d9585f3-853f-4b3e-8eb3-21526f41c899'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:51.931767 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6d9585f3-853f-4b3e-8eb3-21526f41c899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ab61fcd6864bbabbae0c62d159b4db', 'request_id': 'req-6d9585f3-853f-4b3e-8eb3-21526f41c899'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:51.935624 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:51.938013 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6d9585f3-853f-4b3e-8eb3-21526f41c899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ab61fcd6864bbabbae0c62d159b4db', 'request_id': 'req-6d9585f3-853f-4b3e-8eb3-21526f41c899'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:51.950282 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6d9585f3-853f-4b3e-8eb3-21526f41c899 admin admin] The token cache is being invalidate because project 66ab61fcd6864bbabbae0c62d159b4db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:41:51.950565 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6d9585f3-853f-4b3e-8eb3-21526f41c899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:51.951188 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6d9585f3-853f-4b3e-8eb3-21526f41c899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:51.952629 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1277/2548] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:41:51 2022] DELETE /identity/v3/projects/66ab61fcd6864bbabbae0c62d159b4db => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:51.957482 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf887db9-f54f-49e0-af88-299a76f8b297 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:51.957993 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf887db9-f54f-49e0-af88-299a76f8b297 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:51.958095 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf887db9-f54f-49e0-af88-299a76f8b297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:51.976933 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-cf887db9-f54f-49e0-af88-299a76f8b297 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:41:51.978157 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-cf887db9-f54f-49e0-af88-299a76f8b297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:52.035161 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1272/2549] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:41:52.042768 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cf631-668b-4d2e-b956-bc82617ac52d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:52.043089 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cf631-668b-4d2e-b956-bc82617ac52d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:52.043370 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cf631-668b-4d2e-b956-bc82617ac52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:52.064623 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fc3cf631-668b-4d2e-b956-bc82617ac52d None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:41:52.065856 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fc3cf631-668b-4d2e-b956-bc82617ac52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:52.073765 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1278/2550] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:41:52.077939 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf887db9-f54f-49e0-af88-299a76f8b297 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:52.087688 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf887db9-f54f-49e0-af88-299a76f8b297 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:52.092363 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c701ea3-141f-4bb5-b0f3-b54db590459e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:52.093034 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c701ea3-141f-4bb5-b0f3-b54db590459e admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:52.093330 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c701ea3-141f-4bb5-b0f3-b54db590459e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:52.093579 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c701ea3-141f-4bb5-b0f3-b54db590459e admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:52.094228 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c701ea3-141f-4bb5-b0f3-b54db590459e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:41:52.094553 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c701ea3-141f-4bb5-b0f3-b54db590459e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:52.096109 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c701ea3-141f-4bb5-b0f3-b54db590459e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:52.108441 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1273/2551] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:41:52.113362 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cf631-668b-4d2e-b956-bc82617ac52d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:52.122488 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cf631-668b-4d2e-b956-bc82617ac52d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:52.127779 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8805c7-8ae5-4974-81ae-de05ecfd2234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:52.128367 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8805c7-8ae5-4974-81ae-de05ecfd2234 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:52.128646 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8805c7-8ae5-4974-81ae-de05ecfd2234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:52.128914 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8805c7-8ae5-4974-81ae-de05ecfd2234 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:52.129583 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8805c7-8ae5-4974-81ae-de05ecfd2234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:52.131441 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8805c7-8ae5-4974-81ae-de05ecfd2234 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:52.156996 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1279/2552] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:41:52 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:41:52.161096 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c701ea3-141f-4bb5-b0f3-b54db590459e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:52.171296 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c701ea3-141f-4bb5-b0f3-b54db590459e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:52.196633 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:52.230540 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984dcdc4-046d-42a8-851f-2e4dd7f4350a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:52.231270 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dcdc4-046d-42a8-851f-2e4dd7f4350a admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:52.231557 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dcdc4-046d-42a8-851f-2e4dd7f4350a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:52.231830 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dcdc4-046d-42a8-851f-2e4dd7f4350a admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:52.232454 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984dcdc4-046d-42a8-851f-2e4dd7f4350a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:52.234392 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984dcdc4-046d-42a8-851f-2e4dd7f4350a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:52.256463 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1274/2553] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:41:52 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:41:52.260844 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8805c7-8ae5-4974-81ae-de05ecfd2234 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:52.271092 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8805c7-8ae5-4974-81ae-de05ecfd2234 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:52.275705 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d189fe-ed0e-458c-8f98-1567ae2a4ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:52.276301 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d189fe-ed0e-458c-8f98-1567ae2a4ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:52.276584 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d189fe-ed0e-458c-8f98-1567ae2a4ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:52.276861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d189fe-ed0e-458c-8f98-1567ae2a4ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:52.277546 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d189fe-ed0e-458c-8f98-1567ae2a4ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:52.279126 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d189fe-ed0e-458c-8f98-1567ae2a4ba6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:52.289295 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1280/2554] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:41:52.293038 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984dcdc4-046d-42a8-851f-2e4dd7f4350a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:52.303613 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984dcdc4-046d-42a8-851f-2e4dd7f4350a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:52.308213 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe94f8-b79d-4735-99a1-cc49359eb9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:52.308803 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe94f8-b79d-4735-99a1-cc49359eb9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:52.309081 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe94f8-b79d-4735-99a1-cc49359eb9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:52.309382 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe94f8-b79d-4735-99a1-cc49359eb9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:52.310049 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe94f8-b79d-4735-99a1-cc49359eb9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:52.311620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe94f8-b79d-4735-99a1-cc49359eb9e6 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:52.322304 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1275/2555] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:41:52.326314 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d189fe-ed0e-458c-8f98-1567ae2a4ba6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:52.336304 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d189fe-ed0e-458c-8f98-1567ae2a4ba6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:52.340902 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882a981-b1a3-4915-9378-5e90cac37d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:52.341580 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882a981-b1a3-4915-9378-5e90cac37d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:52.341862 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882a981-b1a3-4915-9378-5e90cac37d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:52.342139 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882a981-b1a3-4915-9378-5e90cac37d48 admin admin] PATH_INFO: `/v3/projects/5b9e622d4b69441eab5eeb670eb75858/users/64000e3f561648b0ba1994cfa7887656/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:52.357242 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882a981-b1a3-4915-9378-5e90cac37d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b9e622d4b69441eab5eeb670eb75858, user_id=64000e3f561648b0ba1994cfa7887656, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:52.359894 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882a981-b1a3-4915-9378-5e90cac37d48 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:52.373291 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1281/2556] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:41:52 2022] PUT /identity/v3/projects/5b9e622d4b69441eab5eeb670eb75858/users/64000e3f561648b0ba1994cfa7887656/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:52.383202 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b677b-86a8-46e7-997a-53c4ba7697c3 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:52.383490 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b677b-86a8-46e7-997a-53c4ba7697c3 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:52.383767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b677b-86a8-46e7-997a-53c4ba7697c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:52.411286 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-1a0b677b-86a8-46e7-997a-53c4ba7697c3 None None] MFA Rules not processed for user `64000e3f561648b0ba1994cfa7887656`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:41:52.412496 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1a0b677b-86a8-46e7-997a-53c4ba7697c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:52.476181 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1276/2557] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:41:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:41:52.487892 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882a981-b1a3-4915-9378-5e90cac37d48 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:52.489625 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3882a981-b1a3-4915-9378-5e90cac37d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:52.544902 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882a981-b1a3-4915-9378-5e90cac37d48 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:52.549491 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df55c7-162a-4fcc-bb02-a851b561abe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:52.550090 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df55c7-162a-4fcc-bb02-a851b561abe1 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:52.550373 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df55c7-162a-4fcc-bb02-a851b561abe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:52.550651 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df55c7-162a-4fcc-bb02-a851b561abe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:52.559063 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df55c7-162a-4fcc-bb02-a851b561abe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:52.560477 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df55c7-162a-4fcc-bb02-a851b561abe1 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:52.569339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1282/2558] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:41:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:41:52.590723 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b677b-86a8-46e7-997a-53c4ba7697c3 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:52.655802 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b677b-86a8-46e7-997a-53c4ba7697c3 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:52.660964 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16941bdc-c968-4021-8465-6f47ba135af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:52.661619 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16941bdc-c968-4021-8465-6f47ba135af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:52.661899 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16941bdc-c968-4021-8465-6f47ba135af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:52.662174 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16941bdc-c968-4021-8465-6f47ba135af9 admin admin] PATH_INFO: `/v3/users/64000e3f561648b0ba1994cfa7887656` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:52.663327 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16941bdc-c968-4021-8465-6f47ba135af9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64000e3f561648b0ba1994cfa7887656)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:52.665266 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16941bdc-c968-4021-8465-6f47ba135af9 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:52.702936 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:52.714385 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-16941bdc-c968-4021-8465-6f47ba135af9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64000e3f561648b0ba1994cfa7887656'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:52.715053 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-16941bdc-c968-4021-8465-6f47ba135af9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64000e3f561648b0ba1994cfa7887656'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:52.715677 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-16941bdc-c968-4021-8465-6f47ba135af9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64000e3f561648b0ba1994cfa7887656'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:52.723390 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-16941bdc-c968-4021-8465-6f47ba135af9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64000e3f561648b0ba1994cfa7887656'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:52.730771 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-16941bdc-c968-4021-8465-6f47ba135af9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64000e3f561648b0ba1994cfa7887656'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:52.747645 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1277/2559] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:41:52 2022] DELETE /identity/v3/users/64000e3f561648b0ba1994cfa7887656 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:52.752171 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f9413-9dc5-4077-8dec-c089cad97562 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:52.752464 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f9413-9dc5-4077-8dec-c089cad97562 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:52.752771 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f9413-9dc5-4077-8dec-c089cad97562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:52.772031 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b76f9413-9dc5-4077-8dec-c089cad97562 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:41:52.773269 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b76f9413-9dc5-4077-8dec-c089cad97562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:52.832542 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1283/2560] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:41:52.842169 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16941bdc-c968-4021-8465-6f47ba135af9 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:52.843620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-16941bdc-c968-4021-8465-6f47ba135af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:52.899511 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16941bdc-c968-4021-8465-6f47ba135af9 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:52.903085 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6fc4e-0dc8-4ff9-bb0d-62e9c8796f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:52.903675 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6fc4e-0dc8-4ff9-bb0d-62e9c8796f25 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:52.903952 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6fc4e-0dc8-4ff9-bb0d-62e9c8796f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:52.904224 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6fc4e-0dc8-4ff9-bb0d-62e9c8796f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:52.913796 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6fc4e-0dc8-4ff9-bb0d-62e9c8796f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:52.915226 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6fc4e-0dc8-4ff9-bb0d-62e9c8796f25 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:52.924776 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1278/2561] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:41:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:41:53.190700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f9413-9dc5-4077-8dec-c089cad97562 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:53.192178 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b76f9413-9dc5-4077-8dec-c089cad97562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:53.205025 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f9413-9dc5-4077-8dec-c089cad97562 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:53.210390 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b23a06-b889-455f-83af-0b7a882b17a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:53.211040 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b23a06-b889-455f-83af-0b7a882b17a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:53.211327 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b23a06-b889-455f-83af-0b7a882b17a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:53.211606 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b23a06-b889-455f-83af-0b7a882b17a0 admin admin] PATH_INFO: `/v3/projects/5b9e622d4b69441eab5eeb670eb75858` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:53.212742 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b23a06-b889-455f-83af-0b7a882b17a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b9e622d4b69441eab5eeb670eb75858)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:53.214715 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b23a06-b889-455f-83af-0b7a882b17a0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:53.239184 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:53.263496 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-06b23a06-b889-455f-83af-0b7a882b17a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b9e622d4b69441eab5eeb670eb75858', 'request_id': 'req-06b23a06-b889-455f-83af-0b7a882b17a0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:53.271574 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-06b23a06-b889-455f-83af-0b7a882b17a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b9e622d4b69441eab5eeb670eb75858', 'request_id': 'req-06b23a06-b889-455f-83af-0b7a882b17a0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:53.277123 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-06b23a06-b889-455f-83af-0b7a882b17a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b9e622d4b69441eab5eeb670eb75858', 'request_id': 'req-06b23a06-b889-455f-83af-0b7a882b17a0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:53.287761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-06b23a06-b889-455f-83af-0b7a882b17a0 admin admin] The token cache is being invalidate because project 5b9e622d4b69441eab5eeb670eb75858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:41:53.288048 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-06b23a06-b889-455f-83af-0b7a882b17a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:53.288669 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-06b23a06-b889-455f-83af-0b7a882b17a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:41:53.290158 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1284/2562] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:41:53 2022] DELETE /identity/v3/projects/5b9e622d4b69441eab5eeb670eb75858 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:53.295105 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a7ca7-cc1e-4a37-8723-717acfe2dad4 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:53.295573 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a7ca7-cc1e-4a37-8723-717acfe2dad4 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:53.295676 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a7ca7-cc1e-4a37-8723-717acfe2dad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:53.315716 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-295a7ca7-cc1e-4a37-8723-717acfe2dad4 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:41:53.316918 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-295a7ca7-cc1e-4a37-8723-717acfe2dad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:53.375249 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1279/2563] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:41:53.384568 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6939d5-aaef-41f5-95ec-eb903e55fd1f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:53.384857 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6939d5-aaef-41f5-95ec-eb903e55fd1f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:53.385157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6939d5-aaef-41f5-95ec-eb903e55fd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:53.405145 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-cb6939d5-aaef-41f5-95ec-eb903e55fd1f None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:41:53.406365 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cb6939d5-aaef-41f5-95ec-eb903e55fd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:53.415528 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1285/2564] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:41:53.419820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a7ca7-cc1e-4a37-8723-717acfe2dad4 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:53.430310 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a7ca7-cc1e-4a37-8723-717acfe2dad4 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:53.434942 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7176a-9482-42f3-ac8a-0e4c179ca01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:53.435537 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7176a-9482-42f3-ac8a-0e4c179ca01a admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:53.435820 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7176a-9482-42f3-ac8a-0e4c179ca01a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:53.436096 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7176a-9482-42f3-ac8a-0e4c179ca01a admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:53.436740 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7176a-9482-42f3-ac8a-0e4c179ca01a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:41:53.437042 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7176a-9482-42f3-ac8a-0e4c179ca01a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:53.439302 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7176a-9482-42f3-ac8a-0e4c179ca01a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:53.450646 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1280/2565] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:41:53.454903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6939d5-aaef-41f5-95ec-eb903e55fd1f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:53.464038 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6939d5-aaef-41f5-95ec-eb903e55fd1f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:53.468712 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d8fdb-d845-49d0-8765-a88abd274efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:53.469339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d8fdb-d845-49d0-8765-a88abd274efc admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:53.469624 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d8fdb-d845-49d0-8765-a88abd274efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:53.469900 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d8fdb-d845-49d0-8765-a88abd274efc admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:53.470538 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d8fdb-d845-49d0-8765-a88abd274efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:53.472415 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d8fdb-d845-49d0-8765-a88abd274efc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:53.499186 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1286/2566] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:41:53 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:41:53.503821 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7176a-9482-42f3-ac8a-0e4c179ca01a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:53.514072 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7176a-9482-42f3-ac8a-0e4c179ca01a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:53.555368 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:41:53.572638 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6942d5e-f191-4787-9adf-e48c1530ae17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:53.573304 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6942d5e-f191-4787-9adf-e48c1530ae17 admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:53.573640 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6942d5e-f191-4787-9adf-e48c1530ae17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:53.573910 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6942d5e-f191-4787-9adf-e48c1530ae17 admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:53.574540 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6942d5e-f191-4787-9adf-e48c1530ae17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:53.576437 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6942d5e-f191-4787-9adf-e48c1530ae17 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:53.596222 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1281/2567] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:41:53 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:41:53.600488 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d8fdb-d845-49d0-8765-a88abd274efc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:53.617008 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d8fdb-d845-49d0-8765-a88abd274efc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:53.621638 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111d794-8c13-43fb-b23c-212be2baa437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:53.622238 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111d794-8c13-43fb-b23c-212be2baa437 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:53.622519 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111d794-8c13-43fb-b23c-212be2baa437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:53.622792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111d794-8c13-43fb-b23c-212be2baa437 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:53.623436 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111d794-8c13-43fb-b23c-212be2baa437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:53.625010 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111d794-8c13-43fb-b23c-212be2baa437 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:53.635428 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1287/2568] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:41:53.639335 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6942d5e-f191-4787-9adf-e48c1530ae17 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:53.649456 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6942d5e-f191-4787-9adf-e48c1530ae17 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:53.653959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12e9c5-4114-40f6-a3d0-ca27b1ef7bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:53.654546 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12e9c5-4114-40f6-a3d0-ca27b1ef7bdb admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:53.654846 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12e9c5-4114-40f6-a3d0-ca27b1ef7bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:53.655113 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12e9c5-4114-40f6-a3d0-ca27b1ef7bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:53.655749 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12e9c5-4114-40f6-a3d0-ca27b1ef7bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:53.657347 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12e9c5-4114-40f6-a3d0-ca27b1ef7bdb admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:53.667810 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1282/2569] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:41:53.671773 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111d794-8c13-43fb-b23c-212be2baa437 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:53.681931 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111d794-8c13-43fb-b23c-212be2baa437 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:53.686418 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ad76b-1b40-402e-9292-535f271fd268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:53.687074 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ad76b-1b40-402e-9292-535f271fd268 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:53.687356 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ad76b-1b40-402e-9292-535f271fd268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:53.687629 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ad76b-1b40-402e-9292-535f271fd268 admin admin] PATH_INFO: `/v3/projects/c026c6e0db9f4884a4c357069f858b8a/users/1cf761cad2bb47359a347f6f5d845e9c/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:53.702935 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ad76b-1b40-402e-9292-535f271fd268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c026c6e0db9f4884a4c357069f858b8a, user_id=1cf761cad2bb47359a347f6f5d845e9c, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:53.705608 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ad76b-1b40-402e-9292-535f271fd268 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:53.718577 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1288/2570] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:41:53 2022] PUT /identity/v3/projects/c026c6e0db9f4884a4c357069f858b8a/users/1cf761cad2bb47359a347f6f5d845e9c/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:41:53.728894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f1907-c25d-4571-8dd4-c914a6b39241 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:53.729228 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f1907-c25d-4571-8dd4-c914a6b39241 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:53.729504 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f1907-c25d-4571-8dd4-c914a6b39241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:53.757427 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-1d7f1907-c25d-4571-8dd4-c914a6b39241 None None] MFA Rules not processed for user `1cf761cad2bb47359a347f6f5d845e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:41:53.758632 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-1d7f1907-c25d-4571-8dd4-c914a6b39241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:53.820989 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1283/2571] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:41:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:41:53.832753 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ad76b-1b40-402e-9292-535f271fd268 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:41:53.834490 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-204ad76b-1b40-402e-9292-535f271fd268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:41:53.890212 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ad76b-1b40-402e-9292-535f271fd268 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:41:53.894481 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821fa7b-b5ad-4efb-89d0-161fb2fa8336 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c6b6b1cdc649dda3a9caa8d9713569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:41:53.895087 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821fa7b-b5ad-4efb-89d0-161fb2fa8336 service glance] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:41:53.895372 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821fa7b-b5ad-4efb-89d0-161fb2fa8336 service glance] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:41:53.895651 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821fa7b-b5ad-4efb-89d0-161fb2fa8336 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:41:53.904064 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821fa7b-b5ad-4efb-89d0-161fb2fa8336 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:41:53.905511 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821fa7b-b5ad-4efb-89d0-161fb2fa8336 service glance] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:41:53.914997 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1289/2572] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:41:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:42:03.817979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=46,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:03.910982 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=68,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:08.339225 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f1907-c25d-4571-8dd4-c914a6b39241 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:42:08.401087 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f1907-c25d-4571-8dd4-c914a6b39241 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:42:08.405566 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31223ace-3594-4a5d-90f0-b931c63eb688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:42:08.406186 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31223ace-3594-4a5d-90f0-b931c63eb688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:08.406468 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31223ace-3594-4a5d-90f0-b931c63eb688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:08.406741 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31223ace-3594-4a5d-90f0-b931c63eb688 admin admin] PATH_INFO: `/v3/users/1cf761cad2bb47359a347f6f5d845e9c` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:08.407850 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31223ace-3594-4a5d-90f0-b931c63eb688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cf761cad2bb47359a347f6f5d845e9c)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:42:08.409837 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31223ace-3594-4a5d-90f0-b931c63eb688 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:42:08.455522 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-31223ace-3594-4a5d-90f0-b931c63eb688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cf761cad2bb47359a347f6f5d845e9c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:08.456173 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-31223ace-3594-4a5d-90f0-b931c63eb688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cf761cad2bb47359a347f6f5d845e9c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:08.456778 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-31223ace-3594-4a5d-90f0-b931c63eb688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cf761cad2bb47359a347f6f5d845e9c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:08.463620 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-31223ace-3594-4a5d-90f0-b931c63eb688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cf761cad2bb47359a347f6f5d845e9c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:08.470362 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-31223ace-3594-4a5d-90f0-b931c63eb688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cf761cad2bb47359a347f6f5d845e9c'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:08.487099 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1284/2573] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:42:08 2022] DELETE /identity/v3/users/1cf761cad2bb47359a347f6f5d845e9c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:42:08.492075 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009708a-7a52-4aa3-bb8b-0eab1fb0c698 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:08.492542 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009708a-7a52-4aa3-bb8b-0eab1fb0c698 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:08.492664 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009708a-7a52-4aa3-bb8b-0eab1fb0c698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:08.512700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5009708a-7a52-4aa3-bb8b-0eab1fb0c698 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:42:08.513932 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5009708a-7a52-4aa3-bb8b-0eab1fb0c698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:42:08.570951 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1290/2574] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:42:08.580487 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31223ace-3594-4a5d-90f0-b931c63eb688 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:42:08.581941 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-31223ace-3594-4a5d-90f0-b931c63eb688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:42:08.638344 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31223ace-3594-4a5d-90f0-b931c63eb688 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:42:08.641930 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153beba-2fd2-4e0b-940f-b46cd6ae4a72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:42:08.642520 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153beba-2fd2-4e0b-940f-b46cd6ae4a72 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:08.642799 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153beba-2fd2-4e0b-940f-b46cd6ae4a72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:08.643071 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153beba-2fd2-4e0b-940f-b46cd6ae4a72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:08.652075 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153beba-2fd2-4e0b-940f-b46cd6ae4a72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:42:08.653503 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153beba-2fd2-4e0b-940f-b46cd6ae4a72 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:42:08.662896 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1285/2575] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:42:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:42:08.931700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009708a-7a52-4aa3-bb8b-0eab1fb0c698 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:42:08.933449 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5009708a-7a52-4aa3-bb8b-0eab1fb0c698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:42:08.946119 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009708a-7a52-4aa3-bb8b-0eab1fb0c698 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:42:08.950651 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f859e-dec9-493c-8636-79a7fa79da9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:42:08.951281 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f859e-dec9-493c-8636-79a7fa79da9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:08.951558 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f859e-dec9-493c-8636-79a7fa79da9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:08.951825 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f859e-dec9-493c-8636-79a7fa79da9b admin admin] PATH_INFO: `/v3/projects/c026c6e0db9f4884a4c357069f858b8a` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:08.952998 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f859e-dec9-493c-8636-79a7fa79da9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c026c6e0db9f4884a4c357069f858b8a)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:42:08.955007 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f859e-dec9-493c-8636-79a7fa79da9b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:42:09.000792 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-985f859e-dec9-493c-8636-79a7fa79da9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c026c6e0db9f4884a4c357069f858b8a', 'request_id': 'req-985f859e-dec9-493c-8636-79a7fa79da9b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:09.007990 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-985f859e-dec9-493c-8636-79a7fa79da9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c026c6e0db9f4884a4c357069f858b8a', 'request_id': 'req-985f859e-dec9-493c-8636-79a7fa79da9b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:09.013494 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-985f859e-dec9-493c-8636-79a7fa79da9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c026c6e0db9f4884a4c357069f858b8a', 'request_id': 'req-985f859e-dec9-493c-8636-79a7fa79da9b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:09.024263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-985f859e-dec9-493c-8636-79a7fa79da9b admin admin] The token cache is being invalidate because project c026c6e0db9f4884a4c357069f858b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:42:09.024551 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-985f859e-dec9-493c-8636-79a7fa79da9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:09.025219 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-985f859e-dec9-493c-8636-79a7fa79da9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:09.026676 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1291/2576] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:42:08 2022] DELETE /identity/v3/projects/c026c6e0db9f4884a4c357069f858b8a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:42:09.031521 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a7d60-c04b-4843-8392-94be17d2abef None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:09.031813 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a7d60-c04b-4843-8392-94be17d2abef None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:09.032091 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a7d60-c04b-4843-8392-94be17d2abef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:09.052342 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ec0a7d60-c04b-4843-8392-94be17d2abef None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:42:09.053573 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ec0a7d60-c04b-4843-8392-94be17d2abef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:42:09.070201 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:09.115907 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1286/2577] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:42:09.123632 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b992d-0ef8-4b6d-a511-c91677c16b53 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:09.123918 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b992d-0ef8-4b6d-a511-c91677c16b53 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:09.124215 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b992d-0ef8-4b6d-a511-c91677c16b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:09.143531 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-801b992d-0ef8-4b6d-a511-c91677c16b53 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:42:09.145244 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-801b992d-0ef8-4b6d-a511-c91677c16b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:42:09.152979 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1292/2578] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:42:09.157012 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a7d60-c04b-4843-8392-94be17d2abef None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:42:09.167320 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a7d60-c04b-4843-8392-94be17d2abef None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:42:09.172168 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899d187-19be-4ab8-bfe8-ba0c65a450ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:42:09.172760 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899d187-19be-4ab8-bfe8-ba0c65a450ad admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:09.173043 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899d187-19be-4ab8-bfe8-ba0c65a450ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:09.173351 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899d187-19be-4ab8-bfe8-ba0c65a450ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:09.173997 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899d187-19be-4ab8-bfe8-ba0c65a450ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:42:09.174299 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899d187-19be-4ab8-bfe8-ba0c65a450ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:42:09.175869 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899d187-19be-4ab8-bfe8-ba0c65a450ad admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:42:09.187050 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1287/2579] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 12:42:09.192611 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b992d-0ef8-4b6d-a511-c91677c16b53 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:42:09.201798 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b992d-0ef8-4b6d-a511-c91677c16b53 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:42:09.206974 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fb884-7762-43aa-8fe9-fe8f23eb4737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:42:09.207591 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fb884-7762-43aa-8fe9-fe8f23eb4737 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:09.207872 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fb884-7762-43aa-8fe9-fe8f23eb4737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:09.208149 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fb884-7762-43aa-8fe9-fe8f23eb4737 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:09.208771 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fb884-7762-43aa-8fe9-fe8f23eb4737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:42:09.210683 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fb884-7762-43aa-8fe9-fe8f23eb4737 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:42:09.237248 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1293/2580] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:42:09 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:42:09.241387 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899d187-19be-4ab8-bfe8-ba0c65a450ad admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:42:09.251323 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899d187-19be-4ab8-bfe8-ba0c65a450ad admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:42:09.308284 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b509c-4f2a-41c2-a270-9890295b893e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:42:09.308893 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b509c-4f2a-41c2-a270-9890295b893e admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:09.309207 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b509c-4f2a-41c2-a270-9890295b893e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:09.309486 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b509c-4f2a-41c2-a270-9890295b893e admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:09.310113 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b509c-4f2a-41c2-a270-9890295b893e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:42:09.312054 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b509c-4f2a-41c2-a270-9890295b893e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:42:09.333026 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1288/2581] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:42:09 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 12:42:09.337172 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fb884-7762-43aa-8fe9-fe8f23eb4737 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:42:09.347903 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fb884-7762-43aa-8fe9-fe8f23eb4737 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:42:09.352664 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078663d8-5f25-49f6-a869-6caaef566a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:42:09.353286 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078663d8-5f25-49f6-a869-6caaef566a79 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:09.353570 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078663d8-5f25-49f6-a869-6caaef566a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:09.353848 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078663d8-5f25-49f6-a869-6caaef566a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:09.354492 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078663d8-5f25-49f6-a869-6caaef566a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:42:09.356069 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078663d8-5f25-49f6-a869-6caaef566a79 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:42:09.365747 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1294/2582] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:42:09.369474 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b509c-4f2a-41c2-a270-9890295b893e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:42:09.379375 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b509c-4f2a-41c2-a270-9890295b893e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:42:09.384028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73066289-92b1-47c7-bae6-b2b2b15d5244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:42:09.384621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73066289-92b1-47c7-bae6-b2b2b15d5244 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:09.384902 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73066289-92b1-47c7-bae6-b2b2b15d5244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:09.385209 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73066289-92b1-47c7-bae6-b2b2b15d5244 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:09.385852 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73066289-92b1-47c7-bae6-b2b2b15d5244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:42:09.387426 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73066289-92b1-47c7-bae6-b2b2b15d5244 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:42:09.398410 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1289/2583] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:42:09.402292 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078663d8-5f25-49f6-a869-6caaef566a79 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:42:09.412732 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078663d8-5f25-49f6-a869-6caaef566a79 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:42:09.417318 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f19907-78f8-4b07-80b3-e765e4458a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:42:09.417952 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f19907-78f8-4b07-80b3-e765e4458a00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:09.418234 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f19907-78f8-4b07-80b3-e765e4458a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:09.418510 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f19907-78f8-4b07-80b3-e765e4458a00 admin admin] PATH_INFO: `/v3/projects/087a7f777d1640a1b08f07444a503ce4/users/1e79ee235cb046f28e72cba77f9c458f/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:09.432808 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f19907-78f8-4b07-80b3-e765e4458a00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=087a7f777d1640a1b08f07444a503ce4, user_id=1e79ee235cb046f28e72cba77f9c458f, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:42:09.435458 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f19907-78f8-4b07-80b3-e765e4458a00 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:42:09.449004 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1295/2584] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:42:09 2022] PUT /identity/v3/projects/087a7f777d1640a1b08f07444a503ce4/users/1e79ee235cb046f28e72cba77f9c458f/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:42:09.459685 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8aa860-eb37-47a2-8a7b-17f15eec1ae1 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:09.459979 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8aa860-eb37-47a2-8a7b-17f15eec1ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:09.460264 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8aa860-eb37-47a2-8a7b-17f15eec1ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:09.487276 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-db8aa860-eb37-47a2-8a7b-17f15eec1ae1 None None] MFA Rules not processed for user `1e79ee235cb046f28e72cba77f9c458f`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:42:09.488483 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-db8aa860-eb37-47a2-8a7b-17f15eec1ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:42:09.551060 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1290/2585] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:42:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:42:09.562482 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f19907-78f8-4b07-80b3-e765e4458a00 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:42:09.564252 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-69f19907-78f8-4b07-80b3-e765e4458a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:42:09.586605 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:09.621972 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f19907-78f8-4b07-80b3-e765e4458a00 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:42:09.625563 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84949e19-348b-4e14-b9b2-28896c823aad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c6b6b1cdc649dda3a9caa8d9713569', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:42:09.626161 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84949e19-348b-4e14-b9b2-28896c823aad service glance] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:09.626444 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84949e19-348b-4e14-b9b2-28896c823aad service glance] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:09.626719 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84949e19-348b-4e14-b9b2-28896c823aad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:09.635381 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84949e19-348b-4e14-b9b2-28896c823aad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:42:09.636785 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84949e19-348b-4e14-b9b2-28896c823aad service glance] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:42:09.646777 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1296/2586] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:42:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:42:19.548129 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:19.641461 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=17 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:30.066004 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8aa860-eb37-47a2-8a7b-17f15eec1ae1 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:42:30.127032 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8aa860-eb37-47a2-8a7b-17f15eec1ae1 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:42:30.131691 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d05e9-728e-4a85-865d-3d7c9b0f7f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:42:30.132317 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d05e9-728e-4a85-865d-3d7c9b0f7f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:30.132603 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d05e9-728e-4a85-865d-3d7c9b0f7f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:30.132879 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d05e9-728e-4a85-865d-3d7c9b0f7f2a admin admin] PATH_INFO: `/v3/users/1e79ee235cb046f28e72cba77f9c458f` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:30.134044 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d05e9-728e-4a85-865d-3d7c9b0f7f2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e79ee235cb046f28e72cba77f9c458f)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:42:30.136028 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d05e9-728e-4a85-865d-3d7c9b0f7f2a admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:42:30.182018 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9d3d05e9-728e-4a85-865d-3d7c9b0f7f2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e79ee235cb046f28e72cba77f9c458f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:30.182693 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9d3d05e9-728e-4a85-865d-3d7c9b0f7f2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e79ee235cb046f28e72cba77f9c458f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:30.183328 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9d3d05e9-728e-4a85-865d-3d7c9b0f7f2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e79ee235cb046f28e72cba77f9c458f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:30.190272 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9d3d05e9-728e-4a85-865d-3d7c9b0f7f2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e79ee235cb046f28e72cba77f9c458f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:30.197642 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-9d3d05e9-728e-4a85-865d-3d7c9b0f7f2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e79ee235cb046f28e72cba77f9c458f'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:30.214886 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1291/2587] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:42:30 2022] DELETE /identity/v3/users/1e79ee235cb046f28e72cba77f9c458f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:42:30.219336 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab69462-6955-4563-a72d-1a3ebcbce569 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:30.219833 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab69462-6955-4563-a72d-1a3ebcbce569 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:30.219944 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab69462-6955-4563-a72d-1a3ebcbce569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:30.239113 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6ab69462-6955-4563-a72d-1a3ebcbce569 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:42:30.240311 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6ab69462-6955-4563-a72d-1a3ebcbce569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:42:30.298169 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1297/2588] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:42:30.308407 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d05e9-728e-4a85-865d-3d7c9b0f7f2a admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:42:30.309812 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-9d3d05e9-728e-4a85-865d-3d7c9b0f7f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:42:30.365129 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d05e9-728e-4a85-865d-3d7c9b0f7f2a admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:42:30.369518 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf0cbc-6807-4633-968c-2c067ce9fb25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:42:30.370114 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf0cbc-6807-4633-968c-2c067ce9fb25 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:30.370393 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf0cbc-6807-4633-968c-2c067ce9fb25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:30.370664 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf0cbc-6807-4633-968c-2c067ce9fb25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:30.379539 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf0cbc-6807-4633-968c-2c067ce9fb25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:42:30.380951 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf0cbc-6807-4633-968c-2c067ce9fb25 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:42:30.390482 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1292/2589] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 12:42:30.648493 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab69462-6955-4563-a72d-1a3ebcbce569 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:42:30.650011 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6ab69462-6955-4563-a72d-1a3ebcbce569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:42:30.661938 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab69462-6955-4563-a72d-1a3ebcbce569 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:42:30.668026 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef67c3-4d74-4fce-acbf-f87aff29a9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:42:30.668861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef67c3-4d74-4fce-acbf-f87aff29a9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:30.669202 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef67c3-4d74-4fce-acbf-f87aff29a9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:30.669484 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef67c3-4d74-4fce-acbf-f87aff29a9ef admin admin] PATH_INFO: `/v3/projects/087a7f777d1640a1b08f07444a503ce4` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:30.670649 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef67c3-4d74-4fce-acbf-f87aff29a9ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=087a7f777d1640a1b08f07444a503ce4)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:42:30.673646 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef67c3-4d74-4fce-acbf-f87aff29a9ef admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:42:30.720595 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-36ef67c3-4d74-4fce-acbf-f87aff29a9ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '087a7f777d1640a1b08f07444a503ce4', 'request_id': 'req-36ef67c3-4d74-4fce-acbf-f87aff29a9ef'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:30.727946 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-36ef67c3-4d74-4fce-acbf-f87aff29a9ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '087a7f777d1640a1b08f07444a503ce4', 'request_id': 'req-36ef67c3-4d74-4fce-acbf-f87aff29a9ef'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:30.733445 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-36ef67c3-4d74-4fce-acbf-f87aff29a9ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '087a7f777d1640a1b08f07444a503ce4', 'request_id': 'req-36ef67c3-4d74-4fce-acbf-f87aff29a9ef'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:30.744199 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-36ef67c3-4d74-4fce-acbf-f87aff29a9ef admin admin] The token cache is being invalidate because project 087a7f777d1640a1b08f07444a503ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:42:30.744488 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-36ef67c3-4d74-4fce-acbf-f87aff29a9ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:30.745127 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-36ef67c3-4d74-4fce-acbf-f87aff29a9ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:30.746721 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1298/2590] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:42:30 2022] DELETE /identity/v3/projects/087a7f777d1640a1b08f07444a503ce4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:42:30.752127 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5a20b-9853-4efe-9c9e-8b83a5325af3 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:30.752411 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5a20b-9853-4efe-9c9e-8b83a5325af3 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:30.752706 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5a20b-9853-4efe-9c9e-8b83a5325af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:30.772231 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-4bf5a20b-9853-4efe-9c9e-8b83a5325af3 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:42:30.774007 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-4bf5a20b-9853-4efe-9c9e-8b83a5325af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:42:30.790627 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:30.833584 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1293/2591] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:42:30.842014 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3180977-7300-41df-a9c2-cb24a49dec2e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:30.842300 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3180977-7300-41df-a9c2-cb24a49dec2e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:30.842572 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3180977-7300-41df-a9c2-cb24a49dec2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:30.863064 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b3180977-7300-41df-a9c2-cb24a49dec2e None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:42:30.864263 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b3180977-7300-41df-a9c2-cb24a49dec2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:42:30.872032 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1299/2592] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:42:30.876278 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5a20b-9853-4efe-9c9e-8b83a5325af3 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:42:30.887417 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5a20b-9853-4efe-9c9e-8b83a5325af3 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:42:30.892330 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7c29a-e595-4e4f-a4c0-081647716f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:42:30.892969 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7c29a-e595-4e4f-a4c0-081647716f6f admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:30.893286 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7c29a-e595-4e4f-a4c0-081647716f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:30.893561 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7c29a-e595-4e4f-a4c0-081647716f6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:30.894206 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7c29a-e595-4e4f-a4c0-081647716f6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 12:42:30.894508 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7c29a-e595-4e4f-a4c0-081647716f6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:42:30.896087 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7c29a-e595-4e4f-a4c0-081647716f6f admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:42:30.908017 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1294/2593] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Oct 31 12:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 12:42:30.912142 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3180977-7300-41df-a9c2-cb24a49dec2e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:42:30.921228 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3180977-7300-41df-a9c2-cb24a49dec2e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:42:30.926044 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03906b4-8e6a-4a31-8119-5b27e4aca9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:42:30.926630 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03906b4-8e6a-4a31-8119-5b27e4aca9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:30.926908 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03906b4-8e6a-4a31-8119-5b27e4aca9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:30.927181 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03906b4-8e6a-4a31-8119-5b27e4aca9f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:30.927797 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03906b4-8e6a-4a31-8119-5b27e4aca9f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:42:30.929700 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03906b4-8e6a-4a31-8119-5b27e4aca9f9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:42:30.965546 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1300/2594] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Oct 31 12:42:30 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:42:30.969570 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7c29a-e595-4e4f-a4c0-081647716f6f admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:42:30.979621 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7c29a-e595-4e4f-a4c0-081647716f6f admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:42:31.035332 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15aa1e-d341-4561-b789-71f2b0b2760e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:42:31.035918 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15aa1e-d341-4561-b789-71f2b0b2760e admin admin] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:31.036197 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15aa1e-d341-4561-b789-71f2b0b2760e admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:31.036468 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15aa1e-d341-4561-b789-71f2b0b2760e admin admin] PATH_INFO: `/v3/users` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:31.037092 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15aa1e-d341-4561-b789-71f2b0b2760e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:42:31.039068 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15aa1e-d341-4561-b789-71f2b0b2760e admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:42:31.058570 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1295/2595] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Oct 31 12:42:30 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 12:42:31.065628 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03906b4-8e6a-4a31-8119-5b27e4aca9f9 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:42:31.076423 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03906b4-8e6a-4a31-8119-5b27e4aca9f9 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:42:31.080906 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b95d9f-b334-4bad-8988-7894385a71e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:42:31.081539 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b95d9f-b334-4bad-8988-7894385a71e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:31.081821 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b95d9f-b334-4bad-8988-7894385a71e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:31.082096 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b95d9f-b334-4bad-8988-7894385a71e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:31.082746 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b95d9f-b334-4bad-8988-7894385a71e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:42:31.084371 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b95d9f-b334-4bad-8988-7894385a71e8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:42:31.094910 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1301/2596] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:42:31.098959 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15aa1e-d341-4561-b789-71f2b0b2760e admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:42:31.108894 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15aa1e-d341-4561-b789-71f2b0b2760e admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:42:31.113460 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd5339-6691-46c1-b3b6-bc99afeed2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:42:31.114047 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd5339-6691-46c1-b3b6-bc99afeed2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:31.114326 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd5339-6691-46c1-b3b6-bc99afeed2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:31.114605 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd5339-6691-46c1-b3b6-bc99afeed2a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:31.115246 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd5339-6691-46c1-b3b6-bc99afeed2a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:42:31.116802 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd5339-6691-46c1-b3b6-bc99afeed2a2 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:42:31.127143 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1296/2597] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Oct 31 12:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 12:42:31.131147 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b95d9f-b334-4bad-8988-7894385a71e8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:42:31.141279 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b95d9f-b334-4bad-8988-7894385a71e8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:42:31.145870 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03d872-52e9-4cbe-828c-62dc348d9e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:42:31.146527 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03d872-52e9-4cbe-828c-62dc348d9e6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:31.146807 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03d872-52e9-4cbe-828c-62dc348d9e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:31.147082 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03d872-52e9-4cbe-828c-62dc348d9e6c admin admin] PATH_INFO: `/v3/projects/19d226bdfe6e4a3aa3478cfaad1fdf8f/users/62edc4c0985747a18fd1e34c1dc50ab5/roles/b7c6f84505634b978e58bb6f62bd88a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:31.163055 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03d872-52e9-4cbe-828c-62dc348d9e6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d226bdfe6e4a3aa3478cfaad1fdf8f, user_id=62edc4c0985747a18fd1e34c1dc50ab5, role_id=b7c6f84505634b978e58bb6f62bd88a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:42:31.165719 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03d872-52e9-4cbe-828c-62dc348d9e6c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:42:31.178581 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1302/2598] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Oct 31 12:42:31 2022] PUT /identity/v3/projects/19d226bdfe6e4a3aa3478cfaad1fdf8f/users/62edc4c0985747a18fd1e34c1dc50ab5/roles/b7c6f84505634b978e58bb6f62bd88a0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 12:42:31.190536 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe91054-a878-45c6-92cd-60cb122c7f77 None None] REQUEST_METHOD: `POST` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:31.190827 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe91054-a878-45c6-92cd-60cb122c7f77 None None] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:31.191106 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe91054-a878-45c6-92cd-60cb122c7f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:31.218744 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.auth.core [None req-ffe91054-a878-45c6-92cd-60cb122c7f77 None None] MFA Rules not processed for user `62edc4c0985747a18fd1e34c1dc50ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=81457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:42:31.219961 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-ffe91054-a878-45c6-92cd-60cb122c7f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:42:31.282574 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1297/2599] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:42:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:42:31.293804 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03d872-52e9-4cbe-828c-62dc348d9e6c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:42:31.295553 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ae03d872-52e9-4cbe-828c-62dc348d9e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:42:31.309726 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:31.353521 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03d872-52e9-4cbe-828c-62dc348d9e6c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:42:31.357157 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d1c1f-ef16-4370-8e21-a1c3a2a1e9d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ffd08478684105b83c4e74566ca6a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:42:31.357761 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d1c1f-ef16-4370-8e21-a1c3a2a1e9d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:31.358043 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d1c1f-ef16-4370-8e21-a1c3a2a1e9d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:31.358318 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d1c1f-ef16-4370-8e21-a1c3a2a1e9d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:31.366358 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d1c1f-ef16-4370-8e21-a1c3a2a1e9d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:42:31.368257 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d1c1f-ef16-4370-8e21-a1c3a2a1e9d1 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:42:31.376851 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1303/2600] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:42:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:42:31.402065 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe91054-a878-45c6-92cd-60cb122c7f77 None None] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:42:31.420563 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:31.464215 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe91054-a878-45c6-92cd-60cb122c7f77 None None] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:42:31.468751 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd703f-5ff8-4667-8aa6-d729b747a9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:42:31.469396 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd703f-5ff8-4667-8aa6-d729b747a9f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:31.469679 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd703f-5ff8-4667-8aa6-d729b747a9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:31.469955 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd703f-5ff8-4667-8aa6-d729b747a9f1 admin admin] PATH_INFO: `/v3/users/62edc4c0985747a18fd1e34c1dc50ab5` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:31.471110 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd703f-5ff8-4667-8aa6-d729b747a9f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62edc4c0985747a18fd1e34c1dc50ab5)` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:42:31.473011 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd703f-5ff8-4667-8aa6-d729b747a9f1 admin admin] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:42:31.518506 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a6fd703f-5ff8-4667-8aa6-d729b747a9f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62edc4c0985747a18fd1e34c1dc50ab5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:31.519218 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a6fd703f-5ff8-4667-8aa6-d729b747a9f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62edc4c0985747a18fd1e34c1dc50ab5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:31.519848 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a6fd703f-5ff8-4667-8aa6-d729b747a9f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62edc4c0985747a18fd1e34c1dc50ab5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:31.527600 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a6fd703f-5ff8-4667-8aa6-d729b747a9f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62edc4c0985747a18fd1e34c1dc50ab5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:31.536139 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.notifications [None req-a6fd703f-5ff8-4667-8aa6-d729b747a9f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62edc4c0985747a18fd1e34c1dc50ab5'} {{(pid=81457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:31.557853 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1298/2601] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Oct 31 12:42:31 2022] DELETE /identity/v3/users/62edc4c0985747a18fd1e34c1dc50ab5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:42:31.562579 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2abc41-a3da-46e1-871f-31bd742a39e8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:31.562981 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2abc41-a3da-46e1-871f-31bd742a39e8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:31.563383 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2abc41-a3da-46e1-871f-31bd742a39e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:31.583528 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2a2abc41-a3da-46e1-871f-31bd742a39e8 None None] MFA Rules not processed for user `c1e64987ec354c7fb596a7e6d0af67ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 12:42:31.584768 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2a2abc41-a3da-46e1-871f-31bd742a39e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:42:31.646466 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1304/2602] 10.222.0.18 () {58 vars in 958 bytes} [Mon Oct 31 12:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 12:42:31.656767 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd703f-5ff8-4667-8aa6-d729b747a9f1 admin admin] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:42:31.658325 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-a6fd703f-5ff8-4667-8aa6-d729b747a9f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:42:31.715281 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd703f-5ff8-4667-8aa6-d729b747a9f1 admin admin] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:42:31.718901 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d02fa0-517a-4a17-aa62-3db08a1eb7c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7179d21011064d5b91d0e35a51b8adae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:42:31.719528 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d02fa0-517a-4a17-aa62-3db08a1eb7c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:31.719806 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d02fa0-517a-4a17-aa62-3db08a1eb7c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:31.720080 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d02fa0-517a-4a17-aa62-3db08a1eb7c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:31.729454 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d02fa0-517a-4a17-aa62-3db08a1eb7c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:42:31.730864 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d02fa0-517a-4a17-aa62-3db08a1eb7c7 service neutron] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:42:31.740103 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1299/2603] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:42:32.004691 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2abc41-a3da-46e1-871f-31bd742a39e8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:42:32.006139 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2a2abc41-a3da-46e1-871f-31bd742a39e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:42:32.017861 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2abc41-a3da-46e1-871f-31bd742a39e8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:42:32.022395 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ec204-e017-41c8-a124-80d0d432c572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e64987ec354c7fb596a7e6d0af67ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '771b2157d2a94a5f8b2df37d397dbb5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:42:32.023528 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ec204-e017-41c8-a124-80d0d432c572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:42:32.023806 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ec204-e017-41c8-a124-80d0d432c572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:42:32.024077 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ec204-e017-41c8-a124-80d0d432c572 admin admin] PATH_INFO: `/v3/projects/19d226bdfe6e4a3aa3478cfaad1fdf8f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:42:32.025281 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ec204-e017-41c8-a124-80d0d432c572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19d226bdfe6e4a3aa3478cfaad1fdf8f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:42:32.027162 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ec204-e017-41c8-a124-80d0d432c572 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:42:32.074090 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-356ec204-e017-41c8-a124-80d0d432c572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19d226bdfe6e4a3aa3478cfaad1fdf8f', 'request_id': 'req-356ec204-e017-41c8-a124-80d0d432c572'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:32.081696 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-356ec204-e017-41c8-a124-80d0d432c572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19d226bdfe6e4a3aa3478cfaad1fdf8f', 'request_id': 'req-356ec204-e017-41c8-a124-80d0d432c572'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:32.088419 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-356ec204-e017-41c8-a124-80d0d432c572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19d226bdfe6e4a3aa3478cfaad1fdf8f', 'request_id': 'req-356ec204-e017-41c8-a124-80d0d432c572'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:32.099339 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-356ec204-e017-41c8-a124-80d0d432c572 admin admin] The token cache is being invalidate because project 19d226bdfe6e4a3aa3478cfaad1fdf8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 12:42:32.099623 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-356ec204-e017-41c8-a124-80d0d432c572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:32.100243 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-356ec204-e017-41c8-a124-80d0d432c572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 12:42:32.102335 dv-cinder-796170-6-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1305/2604] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Oct 31 12:42:32 2022] DELETE /identity/v3/projects/19d226bdfe6e4a3aa3478cfaad1fdf8f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 12:42:41.736057 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:42:42.096334 dv-cinder-796170-6-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 12:45:49.861763 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d02fa0-517a-4a17-aa62-3db08a1eb7c7 service neutron] Authenticating user token {{(pid=81457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 12:45:49.863168 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-f8d02fa0-517a-4a17-aa62-3db08a1eb7c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:45:49.931865 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d02fa0-517a-4a17-aa62-3db08a1eb7c7 service neutron] Validating token access rules against request {{(pid=81457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 12:45:49.989724 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78007cec-2cf3-49d4-9e04-0bef69101dd3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18c015b8317b4517911f69bef21a0573', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786ee416a639447ab3698d1f56d04e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 12:45:49.990321 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78007cec-2cf3-49d4-9e04-0bef69101dd3 service placement] REQUEST_METHOD: `GET` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 12:45:49.990601 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78007cec-2cf3-49d4-9e04-0bef69101dd3 service placement] SCRIPT_NAME: `/identity` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 12:45:49.990875 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78007cec-2cf3-49d4-9e04-0bef69101dd3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 12:45:49.992590 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.fernet_utils [None req-78007cec-2cf3-49d4-9e04-0bef69101dd3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 12:45:50.003512 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78007cec-2cf3-49d4-9e04-0bef69101dd3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 12:45:50.005058 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78007cec-2cf3-49d4-9e04-0bef69101dd3 service placement] RBAC: Authorization granted {{(pid=81457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 12:45:50.014740 dv-cinder-796170-6-smb devstack@keystone.service[81457]: [pid: 81457|app: 0|req: 1300/2605] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Oct 31 12:45:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 12:46:00.010549 dv-cinder-796170-6-smb devstack@keystone.service[81457]: DEBUG dbcounter [-] [81457] Writing DB stats keystone:SELECT=58 {{(pid=81457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}